2026-05-21T18:19:40.219698178Z [disk usage checker] Started
2026-05-21T18:19:40.223203608Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-05-21T18:19:40.452519417Z Gathering data for ns/openshift-cluster-version...
2026-05-21T18:19:40.628985112Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-05-21T18:19:40.732366742Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-21T18:19:40.832566453Z Gathering data for ns/default...
2026-05-21T18:19:41.196654573Z Gathering data for ns/openshift...
2026-05-21T18:19:41.678306863Z Gathering data for ns/kube-system...
2026-05-21T18:19:42.466908017Z Gathering data for ns/openshift-etcd...
2026-05-21T18:19:42.733419429Z Waiting on subprocesses to finish execution.
2026-05-21T18:19:42.743020243Z INFO: Collecting host service logs for crio
2026-05-21T18:19:42.743291306Z INFO: Collecting host service logs for kubelet
2026-05-21T18:19:42.743473224Z INFO: Gathering machine config daemon's old logs from all nodes
2026-05-21T18:19:42.743583248Z INFO: Collecting host service logs for rpm-ostreed
2026-05-21T18:19:42.743920315Z INFO: Collecting host service logs for ostree-finalize-staged
2026-05-21T18:19:42.744229715Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-05-21T18:19:42.744527499Z INFO: Collecting host service logs for machine-config-daemon-host
2026-05-21T18:19:42.744863114Z INFO: Collecting host service logs for NetworkManager
2026-05-21T18:19:42.745167400Z INFO: Collecting host service logs for openvswitch
2026-05-21T18:19:42.745524988Z INFO: Collecting host service logs for ovs-configuration
2026-05-21T18:19:42.745902672Z INFO: Collecting host service logs for ovsdb-server
2026-05-21T18:19:42.746245188Z INFO: Collecting host service logs for ovs-vswitchd
2026-05-21T18:19:42.746644118Z INFO: Waiting for worker host service log collection to complete ...
2026-05-21T18:19:42.747528113Z INFO: Gathering HAProxy config files
2026-05-21T18:19:42.751796150Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-05-21T18:19:42.763404942Z INFO: Waiting for node performance related collection to complete ...
2026-05-21T18:19:42.768145611Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-05-21T18:19:43.024577856Z Wrote inspect data to must-gather.
2026-05-21T18:19:43.024676462Z error: inspection completed with the errors occurred while gathering data:
2026-05-21T18:19:43.024676462Z     namespaces "assisted-installer" not found
2026-05-21T18:19:43.212636940Z INFO: "sriov-network-operator" not detected. Skipping.
2026-05-21T18:19:43.777532308Z No resources found
2026-05-21T18:19:43.993088350Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-05-21T18:19:43.993174186Z INFO: on-disk MachineConfig config collection complete.
2026-05-21T18:19:44.083308906Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-05-21T18:19:44.111299533Z INFO: Found 1 replicas - prometheus-k8s-0
2026-05-21T18:19:44.114462301Z Wrote inspect data to must-gather.
2026-05-21T18:19:44.218591448Z error: the server doesn't have a resource type "performanceprofile"
2026-05-21T18:19:44.269764065Z No resources found in openshift-etcd namespace.
2026-05-21T18:19:44.348354601Z INFO: "metallb-operator" not detected. Skipping.
2026-05-21T18:19:44.392582629Z No resources found
2026-05-21T18:19:44.594778516Z INFO: Collecting Insights Archives from insights-operator-78bdfb888c-r9drk
2026-05-21T18:19:44.594863135Z insights-runtime-extractor-4bzkb
2026-05-21T18:19:44.594887321Z insights-runtime-extractor-lcxqs
2026-05-21T18:19:44.594907219Z insights-runtime-extractor-mwzc6
2026-05-21T18:19:44.610698890Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-05-21T18:19:44.817983198Z INFO: Worker host service log collection to complete.
2026-05-21T18:19:44.835308862Z ERROR: No running kube-apiserver pods found
2026-05-21T18:19:45.032327543Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-21T18:19:45.183395877Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-05-21T18:19:45.239123156Z Wrote inspect data to must-gather.
2026-05-21T18:19:45.286524339Z INFO: 'previous-logs' folder not found on ip-10-0-131-243.ec2.internal, skipping...
2026-05-21T18:19:45.320206831Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-05-21T18:19:45.332229339Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-05-21T18:19:45.352701665Z Wrote inspect data to must-gather.
2026-05-21T18:19:45.373570547Z Wrote inspect data to must-gather.
2026-05-21T18:19:45.405100860Z Wrote inspect data to must-gather.
2026-05-21T18:19:45.454906582Z INFO: Waiting for HAProxy config collection to complete ...
2026-05-21T18:19:45.478769391Z Wrote inspect data to must-gather.
2026-05-21T18:19:45.508440468Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-05-21T18:19:45.508440468Z See 'oc rsync -h' for help and examples
2026-05-21T18:19:45.751086459Z error: the server doesn't have a resource type "machineconfigs"
2026-05-21T18:19:45.846443478Z INFO: 'previous-logs' folder not found on ip-10-0-135-125.ec2.internal, skipping...
2026-05-21T18:19:45.863941855Z tar: Removing leading `/' from member names
2026-05-21T18:19:45.869916837Z INFO: HAProxy config collection complete.
2026-05-21T18:19:45.896318629Z INFO: Getting rules from prometheus-k8s-0
2026-05-21T18:19:45.910554548Z Wrote inspect data to must-gather.
2026-05-21T18:19:46.100569353Z Wrote inspect data to must-gather.
2026-05-21T18:19:46.206242059Z INFO: 'previous-logs' folder not found on ip-10-0-141-214.ec2.internal, skipping...
2026-05-21T18:19:46.206344264Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-05-21T18:19:46.206401173Z INFO: Machine Config Daemon termination log collection complete.
2026-05-21T18:19:46.244786582Z Gathering data for ns/kuadrant-system...
2026-05-21T18:19:46.281610167Z Wrote inspect data to must-gather.
2026-05-21T18:19:46.381133623Z INFO: Getting status/config from prometheus-k8s-0
2026-05-21T18:19:46.393570643Z Wrote inspect data to must-gather.
2026-05-21T18:19:46.595656935Z Wrote inspect data to must-gather.
2026-05-21T18:19:46.629901890Z error: the server doesn't have a resource type "kubeletconfigs"
2026-05-21T18:19:46.924154242Z INFO: Getting status/flags from prometheus-k8s-0
2026-05-21T18:19:46.932532687Z Wrote inspect data to must-gather.
2026-05-21T18:19:46.979390592Z INFO: INTERCONNECT MODE
2026-05-21T18:19:46.979427970Z INFO: Gathering ovn-kubernetes DBs
2026-05-21T18:19:47.240516216Z INFO: Gathering OVN_Northbound from ovnkube-node-4ht7c...
2026-05-21T18:19:47.240893704Z INFO: Gathering OVN_Northbound from ovnkube-node-92r2p...
2026-05-21T18:19:47.241189317Z INFO: Gathering OVN_Northbound from ovnkube-node-bfsjz...
2026-05-21T18:19:47.241534575Z INFO: Gathering OVN_Southbound from ovnkube-node-4ht7c...
2026-05-21T18:19:47.241849698Z INFO: Gathering OVN_Southbound from ovnkube-node-92r2p...
2026-05-21T18:19:47.242148492Z INFO: Gathering OVN_Southbound from ovnkube-node-bfsjz...
2026-05-21T18:19:47.264021842Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-05-21T18:19:47.343581437Z Wrote inspect data to must-gather.
2026-05-21T18:19:47.391863834Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-05-21T18:19:47.584234309Z tar: Removing leading `/' from member names
2026-05-21T18:19:47.636980631Z tar: Removing leading `/' from member names
2026-05-21T18:19:47.636980631Z tar: Removing leading `/' from member names
2026-05-21T18:19:47.672392635Z tar: Removing leading `/' from member names
2026-05-21T18:19:47.710250950Z tar: Removing leading `/' from member names
2026-05-21T18:19:47.754159325Z tar: Removing leading `/' from member names
2026-05-21T18:19:47.780940234Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-05-21T18:19:47.799939189Z Wrote inspect data to must-gather.
2026-05-21T18:19:48.082245954Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-05-21T18:19:48.083030700Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-21T18:19:48.230972164Z Wrote inspect data to must-gather.
2026-05-21T18:19:48.336319115Z Gathering data for ns/openshift-monitoring...
2026-05-21T18:19:48.348659466Z INFO: Waiting for network log collection to complete ...
2026-05-21T18:19:48.348864307Z INFO: Waiting for ovnk database copies to complete ...
2026-05-21T18:19:48.349274407Z INFO: Copying ovnk databases complete.
2026-05-21T18:19:48.350798971Z 4.2M	must-gather/network_logs/ovnk_database_store
2026-05-21T18:19:48.353229552Z ovnk_database_store/
2026-05-21T18:19:48.353282617Z ovnk_database_store/ovnkube-node-92r2p_sbdb
2026-05-21T18:19:48.415272907Z ovnk_database_store/ovnkube-node-4ht7c_nbdb
2026-05-21T18:19:48.427701731Z ovnk_database_store/ovnkube-node-4ht7c_sbdb
2026-05-21T18:19:48.456313859Z ovnk_database_store/ovnkube-node-bfsjz_sbdb
2026-05-21T18:19:48.488478009Z ovnk_database_store/ovnkube-node-92r2p_nbdb
2026-05-21T18:19:48.498643395Z ovnk_database_store/ovnkube-node-bfsjz_nbdb
2026-05-21T18:19:48.516545734Z INFO: Network log collection complete.
2026-05-21T18:19:48.581055862Z INFO: Getting status from alertmanager-main-0
2026-05-21T18:19:48.624633783Z Wrote inspect data to must-gather.
2026-05-21T18:19:48.958177810Z Wrote inspect data to must-gather.
2026-05-21T18:19:49.227209747Z Wrote inspect data to must-gather.
2026-05-21T18:19:49.507013313Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-05-21T18:19:49.509280840Z INFO: Fallback to identify the container image from release info
2026-05-21T18:19:50.073757132Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:934b226bb305ecfe687cdb9684d7d4cf04b130e6254c2817dd1a6112d4829bda
2026-05-21T18:19:50.222411088Z daemonset.apps/perf-node-gather-daemonset created
2026-05-21T18:19:50.345554774Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-05-21T18:19:50.375725401Z Waiting for performance profile collector pods to become ready: 1
2026-05-21T18:19:50.537252570Z Gathering data for ns/openshift-network-console...
2026-05-21T18:19:51.069264357Z Gathering data for ns/openshift-console-operator...
2026-05-21T18:19:51.526535815Z Waiting for performance profile collector pods to become ready: 2
2026-05-21T18:19:51.543952318Z Gathering data for ns/openshift-console...
2026-05-21T18:19:52.052568966Z Gathering data for ns/openshift-cluster-storage-operator...
2026-05-21T18:19:52.488372388Z Gathering data for ns/openshift-dns-operator...
2026-05-21T18:19:52.504227252Z Wrote inspect data to must-gather.
2026-05-21T18:19:52.650297291Z Waiting for performance profile collector pods to become ready: 3
2026-05-21T18:19:52.836098446Z Gathering data for ns/openshift-dns...
2026-05-21T18:19:53.526046544Z Gathering data for ns/openshift-image-registry...
2026-05-21T18:19:53.786405139Z Waiting for performance profile collector pods to become ready: 4
2026-05-21T18:19:54.095153504Z Gathering data for ns/openshift-ingress-operator...
2026-05-21T18:19:54.586435044Z Gathering data for ns/openshift-ingress...
2026-05-21T18:19:54.901242443Z Waiting for performance profile collector pods to become ready: 5
2026-05-21T18:19:55.352639131Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-05-21T18:19:55.397069482Z Gathering data for ns/openshift-ingress-canary...
2026-05-21T18:19:55.903131561Z Gathering data for ns/openshift-insights...
2026-05-21T18:19:56.019511995Z Waiting for performance profile collector pods to become ready: 6
2026-05-21T18:19:57.139020521Z Waiting for performance profile collector pods to become ready: 7
2026-05-21T18:19:58.006678476Z Gathering data for ns/opendatahub...
2026-05-21T18:19:58.256654574Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-05-21T18:19:58.524393326Z Collecting performance related data for node ip-10-0-141-214.ec2.internal
2026-05-21T18:19:58.531225296Z Collecting performance related data for node ip-10-0-135-125.ec2.internal
2026-05-21T18:19:58.539165925Z Collecting performance related data for node ip-10-0-131-243.ec2.internal
2026-05-21T18:19:59.695103935Z Gathering data for ns/openshift-lws-operator...
2026-05-21T18:20:00.358468636Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-05-21T18:20:01.029549613Z Gathering data for ns/openshift-config...
2026-05-21T18:20:01.394115622Z Gathering data for ns/openshift-config-managed...
2026-05-21T18:20:01.898706643Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-05-21T18:20:02.213265496Z Gathering data for ns/openshift-kube-apiserver...
2026-05-21T18:20:02.515880935Z Gathering data for ns/openshift-kube-controller-manager...
2026-05-21T18:20:02.889743551Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-05-21T18:20:03.251260066Z Gathering data for ns/openshift-kube-scheduler...
2026-05-21T18:20:03.584140079Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-05-21T18:20:03.942198703Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-05-21T18:20:04.313320574Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-05-21T18:20:04.727055733Z Gathering data for ns/openshift-user-workload-monitoring...
2026-05-21T18:20:05.363864124Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-05-21T18:20:05.404526462Z Gathering data for ns/openshift-multus...
2026-05-21T18:20:06.840160992Z Gathering data for ns/openshift-ovn-kubernetes...
2026-05-21T18:20:07.155289018Z Collecting kubelet logs for node ip-10-0-141-214.ec2.internal
2026-05-21T18:20:07.157939896Z Collecting kubelet logs for node ip-10-0-135-125.ec2.internal
2026-05-21T18:20:07.159788753Z Collecting kubelet logs for node ip-10-0-131-243.ec2.internal
2026-05-21T18:20:07.522089926Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-05-21T18:20:07.527039017Z INFO: Node performance data collection complete.
2026-05-21T18:20:08.405348133Z Gathering data for ns/openshift-host-network...
2026-05-21T18:20:08.765763389Z Gathering data for ns/openshift-network-diagnostics...
2026-05-21T18:20:09.338365170Z Gathering data for ns/openshift-network-node-identity...
2026-05-21T18:20:09.800641399Z Gathering data for ns/openshift-network-operator...
2026-05-21T18:20:10.195004870Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-05-21T18:20:10.368595618Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-05-21T18:20:10.533241904Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-05-21T18:20:11.034920590Z Gathering data for ns/openshift-apiserver-operator...
2026-05-21T18:20:11.366913130Z Gathering data for ns/openshift-apiserver...
2026-05-21T18:20:11.820018798Z Gathering data for ns/openshift-controller-manager-operator...
2026-05-21T18:20:12.133144215Z Gathering data for ns/openshift-controller-manager...
2026-05-21T18:20:12.466987557Z Gathering data for ns/openshift-cluster-samples-operator...
2026-05-21T18:20:13.138654962Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-05-21T18:20:13.480822836Z Gathering data for ns/openshift-service-ca-operator...
2026-05-21T18:20:13.831157683Z Gathering data for ns/openshift-service-ca...
2026-05-21T18:20:14.239306287Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-05-21T18:20:15.308263658Z Wrote inspect data to must-gather.
2026-05-21T18:20:15.308305947Z error: inspection completed with the errors occurred while gathering data:
2026-05-21T18:20:15.308305947Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-05-21T18:20:15.373161221Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-05-21T18:20:15.447280794Z error: the server doesn't have a resource type "clusters"
2026-05-21T18:20:15.632710490Z Caches written to disk