2026-06-02T08:16:40.561548952Z [disk usage checker] Started
2026-06-02T08:16:40.565224394Z [disk usage checker] Volume usage percentage: current = 28 ; allowed = 70
2026-06-02T08:16:40.913112246Z Gathering data for ns/openshift-cluster-version...
2026-06-02T08:16:41.031134072Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T08:16:41.113115860Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T08:16:41.188049873Z Gathering data for ns/default...
2026-06-02T08:16:41.455829741Z Gathering data for ns/openshift...
2026-06-02T08:16:41.868838987Z Gathering data for ns/kube-system...
2026-06-02T08:16:42.491525579Z Gathering data for ns/openshift-etcd...
2026-06-02T08:16:42.772530096Z Wrote inspect data to must-gather.
2026-06-02T08:16:42.772685008Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T08:16:42.772685008Z     namespaces "assisted-installer" not found
2026-06-02T08:16:43.014362887Z Waiting on subprocesses to finish execution.
2026-06-02T08:16:43.018796768Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-02T08:16:43.021042875Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-02T08:16:43.028327610Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-02T08:16:43.033854082Z INFO: Gathering HAProxy config files
2026-06-02T08:16:43.102282087Z INFO: Collecting host service logs for crio
2026-06-02T08:16:43.102690587Z INFO: Collecting host service logs for kubelet
2026-06-02T08:16:43.103048260Z INFO: Collecting host service logs for rpm-ostreed
2026-06-02T08:16:43.103375611Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-02T08:16:43.103711668Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-02T08:16:43.104045545Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-02T08:16:43.107216242Z INFO: Collecting host service logs for NetworkManager
2026-06-02T08:16:43.107582561Z INFO: Collecting host service logs for openvswitch
2026-06-02T08:16:43.107920683Z INFO: Collecting host service logs for ovs-configuration
2026-06-02T08:16:43.108275999Z INFO: Collecting host service logs for ovsdb-server
2026-06-02T08:16:43.108607464Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-02T08:16:43.109453362Z INFO: Waiting for worker host service log collection to complete ...
2026-06-02T08:16:43.111164242Z INFO: Waiting for node performance related collection to complete ...
2026-06-02T08:16:43.723152105Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-02T08:16:43.730931016Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-02T08:16:43.790390830Z No resources found in openshift-etcd namespace.
2026-06-02T08:16:43.800139677Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-02T08:16:43.933050779Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-fk9sn
2026-06-02T08:16:43.933118079Z insights-runtime-extractor-6lgmz
2026-06-02T08:16:43.933136997Z insights-runtime-extractor-9psv8
2026-06-02T08:16:43.933164649Z insights-runtime-extractor-f2s25
2026-06-02T08:16:44.118259412Z No resources found
2026-06-02T08:16:44.132930949Z Wrote inspect data to must-gather.
2026-06-02T08:16:44.237178119Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-02T08:16:44.341018244Z INFO: "metallb-operator" not detected. Skipping.
2026-06-02T08:16:44.391034835Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-02T08:16:44.391125644Z INFO: on-disk MachineConfig config collection complete.
2026-06-02T08:16:44.399241051Z INFO: Worker host service log collection to complete.
2026-06-02T08:16:44.490704924Z error: the server doesn't have a resource type "performanceprofile"
2026-06-02T08:16:44.766386816Z Wrote inspect data to must-gather.
2026-06-02T08:16:44.769012358Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-02T08:16:44.900068770Z No resources found
2026-06-02T08:16:44.937329418Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-02T08:16:44.937329418Z See 'oc rsync -h' for help and examples
2026-06-02T08:16:44.969798307Z ERROR: No running kube-apiserver pods found
2026-06-02T08:16:45.033050064Z Wrote inspect data to must-gather.
2026-06-02T08:16:45.045077205Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-02T08:16:45.127194914Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T08:16:45.147599942Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-02T08:16:45.250277894Z Wrote inspect data to must-gather.
2026-06-02T08:16:45.260728254Z INFO: 'previous-logs' folder not found on ip-10-0-134-166.ec2.internal, skipping...
2026-06-02T08:16:45.279385793Z tar: Removing leading `/' from member names
2026-06-02T08:16:45.281910560Z Wrote inspect data to must-gather.
2026-06-02T08:16:45.286883391Z INFO: HAProxy config collection complete.
2026-06-02T08:16:45.291436437Z Wrote inspect data to must-gather.
2026-06-02T08:16:45.352213356Z Wrote inspect data to must-gather.
2026-06-02T08:16:45.360510545Z Gathering data for ns/openshift-monitoring...
2026-06-02T08:16:45.440017622Z Wrote inspect data to must-gather.
2026-06-02T08:16:45.449767195Z error: the server doesn't have a resource type "machineconfigs"
2026-06-02T08:16:45.542301814Z INFO: 'previous-logs' folder not found on ip-10-0-141-156.ec2.internal, skipping...
2026-06-02T08:16:45.571929188Z [disk usage checker] Volume usage percentage: current = 28 ; allowed = 70
2026-06-02T08:16:45.644561235Z INFO: Getting rules from prometheus-k8s-0
2026-06-02T08:16:45.678625614Z Wrote inspect data to must-gather.
2026-06-02T08:16:45.708346914Z Wrote inspect data to must-gather.
2026-06-02T08:16:45.805280080Z INFO: 'previous-logs' folder not found on ip-10-0-143-2.ec2.internal, skipping...
2026-06-02T08:16:45.805306976Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-02T08:16:45.805330863Z INFO: Machine Config Daemon termination log collection complete.
2026-06-02T08:16:45.886100572Z Wrote inspect data to must-gather.
2026-06-02T08:16:45.946911752Z Wrote inspect data to must-gather.
2026-06-02T08:16:46.032667311Z INFO: Getting status/config from prometheus-k8s-0
2026-06-02T08:16:46.032939977Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-02T08:16:46.221667861Z INFO: INTERCONNECT MODE
2026-06-02T08:16:46.221764986Z INFO: Gathering ovn-kubernetes DBs
2026-06-02T08:16:46.232266134Z Wrote inspect data to must-gather.
2026-06-02T08:16:46.380389449Z INFO: Gathering OVN_Northbound from ovnkube-node-5tw5b...
2026-06-02T08:16:46.380600768Z INFO: Gathering OVN_Northbound from ovnkube-node-pkpgd...
2026-06-02T08:16:46.380797939Z INFO: Gathering OVN_Northbound from ovnkube-node-rxq7g...
2026-06-02T08:16:46.381050407Z INFO: Gathering OVN_Southbound from ovnkube-node-5tw5b...
2026-06-02T08:16:46.381318274Z INFO: Gathering OVN_Southbound from ovnkube-node-pkpgd...
2026-06-02T08:16:46.381556404Z INFO: Gathering OVN_Southbound from ovnkube-node-rxq7g...
2026-06-02T08:16:46.478260241Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-02T08:16:46.490794441Z Wrote inspect data to must-gather.
2026-06-02T08:16:46.669490807Z tar: Removing leading `/' from member names
2026-06-02T08:16:46.678043023Z tar: Removing leading `/' from member names
2026-06-02T08:16:46.699140417Z tar: Removing leading `/' from member names
2026-06-02T08:16:46.705183958Z tar: Removing leading `/' from member names
2026-06-02T08:16:46.705214353Z tar: Removing leading `/' from member names
2026-06-02T08:16:46.706862094Z tar: Removing leading `/' from member names
2026-06-02T08:16:46.781871510Z Wrote inspect data to must-gather.
2026-06-02T08:16:46.819606990Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-02T08:16:46.823229510Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T08:16:47.011499215Z Wrote inspect data to must-gather.
2026-06-02T08:16:47.077009735Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-02T08:16:47.169916441Z INFO: Waiting for network log collection to complete ...
2026-06-02T08:16:47.169974723Z INFO: Waiting for ovnk database copies to complete ...
2026-06-02T08:16:47.170361761Z INFO: Copying ovnk databases complete.
2026-06-02T08:16:47.171974065Z 2.8M	must-gather/network_logs/ovnk_database_store
2026-06-02T08:16:47.174526721Z ovnk_database_store/
2026-06-02T08:16:47.174578891Z ovnk_database_store/ovnkube-node-5tw5b_nbdb
2026-06-02T08:16:47.182148321Z ovnk_database_store/ovnkube-node-pkpgd_nbdb
2026-06-02T08:16:47.189794579Z ovnk_database_store/ovnkube-node-pkpgd_sbdb
2026-06-02T08:16:47.208244782Z ovnk_database_store/ovnkube-node-rxq7g_sbdb
2026-06-02T08:16:47.224646214Z ovnk_database_store/ovnkube-node-rxq7g_nbdb
2026-06-02T08:16:47.231588044Z ovnk_database_store/ovnkube-node-5tw5b_sbdb
2026-06-02T08:16:47.237115949Z Wrote inspect data to must-gather.
2026-06-02T08:16:47.252490379Z INFO: Network log collection complete.
2026-06-02T08:16:47.315875677Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-02T08:16:47.424248015Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T08:16:47.520092734Z Wrote inspect data to must-gather.
2026-06-02T08:16:47.583536612Z Gathering data for ns/openshift-network-console...
2026-06-02T08:16:47.704911771Z INFO: Getting status from alertmanager-main-0
2026-06-02T08:16:47.809604172Z Wrote inspect data to must-gather.
2026-06-02T08:16:47.994174466Z Gathering data for ns/openshift-console-operator...
2026-06-02T08:16:48.070073959Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-02T08:16:48.073495446Z INFO: Fallback to identify the container image from release info
2026-06-02T08:16:48.328454626Z Gathering data for ns/openshift-console...
2026-06-02T08:16:48.731774740Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-02T08:16:48.739335770Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-02T08:16:48.866570184Z daemonset.apps/perf-node-gather-daemonset created
2026-06-02T08:16:48.996282066Z Waiting for performance profile collector pods to become ready: 1
2026-06-02T08:16:49.069436785Z Gathering data for ns/openshift-dns-operator...
2026-06-02T08:16:49.335161331Z Gathering data for ns/openshift-dns...
2026-06-02T08:16:49.877349343Z Gathering data for ns/openshift-image-registry...
2026-06-02T08:16:50.115430988Z Waiting for performance profile collector pods to become ready: 2
2026-06-02T08:16:50.327245554Z Gathering data for ns/openshift-ingress-operator...
2026-06-02T08:16:50.576709137Z [disk usage checker] Volume usage percentage: current = 28 ; allowed = 70
2026-06-02T08:16:50.619733381Z Gathering data for ns/openshift-ingress...
2026-06-02T08:16:50.932742601Z Gathering data for ns/openshift-ingress-canary...
2026-06-02T08:16:51.240644904Z Waiting for performance profile collector pods to become ready: 3
2026-06-02T08:16:51.295599408Z Gathering data for ns/openshift-insights...
2026-06-02T08:16:52.346615276Z Waiting for performance profile collector pods to become ready: 4
2026-06-02T08:16:53.032276906Z Gathering data for ns/openshift-jobset-operator...
2026-06-02T08:16:53.452491545Z Waiting for performance profile collector pods to become ready: 5
2026-06-02T08:16:53.769925075Z Gathering data for ns/openshift-config...
2026-06-02T08:16:54.004142373Z Gathering data for ns/openshift-config-managed...
2026-06-02T08:16:54.438016025Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-02T08:16:54.576113038Z Waiting for performance profile collector pods to become ready: 6
2026-06-02T08:16:54.679442035Z Gathering data for ns/openshift-kube-apiserver...
2026-06-02T08:16:54.901758611Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-02T08:16:55.161182853Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-02T08:16:55.447230293Z Gathering data for ns/openshift-kube-scheduler...
2026-06-02T08:16:55.582163925Z [disk usage checker] Volume usage percentage: current = 28 ; allowed = 70
2026-06-02T08:16:55.697029823Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-02T08:16:55.702971583Z Waiting for performance profile collector pods to become ready: 7
2026-06-02T08:16:55.944630947Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-02T08:16:56.240839196Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-02T08:16:56.508465628Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-02T08:16:56.824174155Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-02T08:16:56.979963292Z Gathering data for ns/openshift-multus...
2026-06-02T08:16:57.071782349Z Collecting performance related data for node ip-10-0-143-2.ec2.internal
2026-06-02T08:16:57.078648348Z Collecting performance related data for node ip-10-0-141-156.ec2.internal
2026-06-02T08:16:57.085904912Z Collecting performance related data for node ip-10-0-134-166.ec2.internal
2026-06-02T08:16:58.413619872Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-02T08:16:59.789683457Z Gathering data for ns/openshift-host-network...
2026-06-02T08:17:00.109181529Z Gathering data for ns/openshift-network-diagnostics...
2026-06-02T08:17:00.588626951Z [disk usage checker] Volume usage percentage: current = 28 ; allowed = 70
2026-06-02T08:17:00.598283946Z Gathering data for ns/openshift-network-node-identity...
2026-06-02T08:17:00.970530883Z Gathering data for ns/openshift-network-operator...
2026-06-02T08:17:01.314510048Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-02T08:17:01.598872650Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-02T08:17:02.048397723Z Gathering data for ns/openshift-apiserver-operator...
2026-06-02T08:17:02.376609510Z Gathering data for ns/openshift-apiserver...
2026-06-02T08:17:02.748344823Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-02T08:17:03.035559833Z Gathering data for ns/openshift-controller-manager...
2026-06-02T08:17:03.276047674Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-02T08:17:03.890221587Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-02T08:17:04.160543847Z Gathering data for ns/openshift-service-ca-operator...
2026-06-02T08:17:04.451036912Z Gathering data for ns/openshift-service-ca...
2026-06-02T08:17:04.781528859Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-02T08:17:05.535077930Z Collecting kubelet logs for node ip-10-0-143-2.ec2.internal
2026-06-02T08:17:05.536933888Z Collecting kubelet logs for node ip-10-0-141-156.ec2.internal
2026-06-02T08:17:05.538799892Z Collecting kubelet logs for node ip-10-0-134-166.ec2.internal
2026-06-02T08:17:05.594532353Z [disk usage checker] Volume usage percentage: current = 28 ; allowed = 70
2026-06-02T08:17:05.676410396Z Wrote inspect data to must-gather.
2026-06-02T08:17:05.676458693Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T08:17:05.676458693Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-02T08:17:05.844836683Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-02T08:17:05.850528156Z INFO: Node performance data collection complete.
2026-06-02T08:17:05.985632557Z error: the server doesn't have a resource type "clusters"
2026-06-02T08:17:06.096694136Z Caches written to disk