2026-06-02T20:40:58.023017157Z [disk usage checker] Started
2026-06-02T20:40:58.026616889Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-06-02T20:40:58.266765238Z Gathering data for ns/openshift-cluster-version...
2026-06-02T20:40:58.428679111Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T20:40:58.529513844Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T20:40:58.640244933Z Gathering data for ns/default...
2026-06-02T20:40:59.294097258Z Gathering data for ns/openshift...
2026-06-02T20:40:59.779209358Z Gathering data for ns/kube-system...
2026-06-02T20:41:00.529799584Z Waiting on subprocesses to finish execution.
2026-06-02T20:41:00.535894315Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-02T20:41:00.537686309Z INFO: Gathering HAProxy config files
2026-06-02T20:41:00.538893570Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-02T20:41:00.546593575Z INFO: Collecting host service logs for crio
2026-06-02T20:41:00.546925769Z INFO: Collecting host service logs for kubelet
2026-06-02T20:41:00.547273230Z INFO: Collecting host service logs for rpm-ostreed
2026-06-02T20:41:00.547631077Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-02T20:41:00.548017377Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-02T20:41:00.548476727Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-02T20:41:00.548812490Z INFO: Collecting host service logs for NetworkManager
2026-06-02T20:41:00.549141426Z INFO: Collecting host service logs for openvswitch
2026-06-02T20:41:00.549495875Z INFO: Collecting host service logs for ovs-configuration
2026-06-02T20:41:00.549870440Z INFO: Collecting host service logs for ovsdb-server
2026-06-02T20:41:00.550208071Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-02T20:41:00.550718470Z INFO: Waiting for worker host service log collection to complete ...
2026-06-02T20:41:00.551659532Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-02T20:41:00.622576638Z Gathering data for ns/openshift-etcd...
2026-06-02T20:41:00.903297461Z INFO: Waiting for node performance related collection to complete ...
2026-06-02T20:41:01.346988424Z No resources found
2026-06-02T20:41:01.368093522Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-02T20:41:01.675251204Z error: the server doesn't have a resource type "performanceprofile"
2026-06-02T20:41:01.752680100Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-02T20:41:01.860072131Z Wrote inspect data to must-gather.
2026-06-02T20:41:02.081871406Z INFO: "metallb-operator" not detected. Skipping.
2026-06-02T20:41:02.220231473Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-02T20:41:02.422642717Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-02T20:41:02.423207585Z INFO: on-disk MachineConfig config collection complete.
2026-06-02T20:41:02.428976753Z Wrote inspect data to must-gather.
2026-06-02T20:41:02.429083571Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T20:41:02.429083571Z     namespaces "assisted-installer" not found
2026-06-02T20:41:02.625700936Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-2dsqx
2026-06-02T20:41:02.625774958Z insights-runtime-extractor-k4gvw
2026-06-02T20:41:02.625812564Z insights-runtime-extractor-nxgbz
2026-06-02T20:41:02.625833118Z insights-runtime-extractor-v8648
2026-06-02T20:41:02.737979621Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T20:41:02.951399985Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-02T20:41:03.016042803Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-02T20:41:03.040677955Z INFO: Worker host service log collection to complete.
2026-06-02T20:41:03.113013828Z No resources found in openshift-etcd namespace.
2026-06-02T20:41:03.119701257Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-06-02T20:41:03.339347652Z Wrote inspect data to must-gather.
2026-06-02T20:41:03.397477709Z Wrote inspect data to must-gather.
2026-06-02T20:41:03.504214384Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-02T20:41:03.528585128Z No resources found
2026-06-02T20:41:03.543133559Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-02T20:41:03.543133559Z See 'oc rsync -h' for help and examples
2026-06-02T20:41:03.621474887Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-02T20:41:03.738508753Z Wrote inspect data to must-gather.
2026-06-02T20:41:03.789843006Z INFO: 'previous-logs' folder not found on ip-10-0-132-46.ec2.internal, skipping...
2026-06-02T20:41:03.837097388Z ERROR: No running kube-apiserver pods found
2026-06-02T20:41:03.885268001Z Wrote inspect data to must-gather.
2026-06-02T20:41:04.030998968Z tar: Removing leading `/' from member names
2026-06-02T20:41:04.040244097Z INFO: HAProxy config collection complete.
2026-06-02T20:41:04.052299646Z INFO: Getting rules from prometheus-k8s-0
2026-06-02T20:41:04.086774523Z Wrote inspect data to must-gather.
2026-06-02T20:41:04.198540497Z Gathering data for ns/kuadrant-system...
2026-06-02T20:41:04.240476196Z INFO: 'previous-logs' folder not found on ip-10-0-134-118.ec2.internal, skipping...
2026-06-02T20:41:04.273653835Z Wrote inspect data to must-gather.
2026-06-02T20:41:04.348447215Z error: the server doesn't have a resource type "machineconfigs"
2026-06-02T20:41:04.563076488Z INFO: 'previous-logs' folder not found on ip-10-0-137-123.ec2.internal, skipping...
2026-06-02T20:41:04.563183407Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-02T20:41:04.563233981Z INFO: Machine Config Daemon termination log collection complete.
2026-06-02T20:41:04.634937890Z INFO: Getting status/config from prometheus-k8s-0
2026-06-02T20:41:04.815815318Z Wrote inspect data to must-gather.
2026-06-02T20:41:04.880675395Z Wrote inspect data to must-gather.
2026-06-02T20:41:05.175448555Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-02T20:41:05.370702428Z Wrote inspect data to must-gather.
2026-06-02T20:41:05.428745542Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-02T20:41:05.472512031Z Wrote inspect data to must-gather.
2026-06-02T20:41:05.600079593Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-02T20:41:05.645860776Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T20:41:05.763922361Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-02T20:41:05.870255677Z INFO: INTERCONNECT MODE
2026-06-02T20:41:05.870347807Z INFO: Gathering ovn-kubernetes DBs
2026-06-02T20:41:06.069187807Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-02T20:41:06.099070613Z INFO: Gathering OVN_Northbound from ovnkube-node-jmkdm...
2026-06-02T20:41:06.099366251Z INFO: Gathering OVN_Northbound from ovnkube-node-qwd9g...
2026-06-02T20:41:06.099669023Z INFO: Gathering OVN_Northbound from ovnkube-node-vq2bj...
2026-06-02T20:41:06.099973044Z INFO: Gathering OVN_Southbound from ovnkube-node-jmkdm...
2026-06-02T20:41:06.100262574Z INFO: Gathering OVN_Southbound from ovnkube-node-qwd9g...
2026-06-02T20:41:06.100577929Z INFO: Gathering OVN_Southbound from ovnkube-node-vq2bj...
2026-06-02T20:41:06.114654273Z Wrote inspect data to must-gather.
2026-06-02T20:41:06.405871053Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T20:41:06.583638264Z tar: Removing leading `/' from member names
2026-06-02T20:41:06.612866482Z tar: Removing leading `/' from member names
2026-06-02T20:41:06.670608899Z tar: Removing leading `/' from member names
2026-06-02T20:41:06.683956596Z tar: Removing leading `/' from member names
2026-06-02T20:41:06.789457356Z tar: Removing leading `/' from member names
2026-06-02T20:41:06.812429393Z tar: Removing leading `/' from member names
2026-06-02T20:41:06.817718797Z INFO: Getting status from alertmanager-main-0
2026-06-02T20:41:06.856479200Z Gathering data for ns/openshift-monitoring...
2026-06-02T20:41:07.022216516Z Wrote inspect data to must-gather.
2026-06-02T20:41:07.412699519Z INFO: Waiting for network log collection to complete ...
2026-06-02T20:41:07.412875802Z INFO: Waiting for ovnk database copies to complete ...
2026-06-02T20:41:07.413518474Z INFO: Copying ovnk databases complete.
2026-06-02T20:41:07.415657697Z 4.5M	must-gather/network_logs/ovnk_database_store
2026-06-02T20:41:07.420444221Z ovnk_database_store/
2026-06-02T20:41:07.420444221Z ovnk_database_store/ovnkube-node-jmkdm_nbdb
2026-06-02T20:41:07.431879804Z ovnk_database_store/ovnkube-node-qwd9g_sbdb
2026-06-02T20:41:07.454354141Z ovnk_database_store/ovnkube-node-jmkdm_sbdb
2026-06-02T20:41:07.476527460Z ovnk_database_store/ovnkube-node-qwd9g_nbdb
2026-06-02T20:41:07.486713827Z ovnk_database_store/ovnkube-node-vq2bj_sbdb
2026-06-02T20:41:07.512327451Z ovnk_database_store/ovnkube-node-vq2bj_nbdb
2026-06-02T20:41:07.527172367Z INFO: Network log collection complete.
2026-06-02T20:41:07.545700012Z Wrote inspect data to must-gather.
2026-06-02T20:41:07.975749203Z Wrote inspect data to must-gather.
2026-06-02T20:41:08.124798863Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-06-02T20:41:08.384546460Z Wrote inspect data to must-gather.
2026-06-02T20:41:08.826666142Z Wrote inspect data to must-gather.
2026-06-02T20:41:09.298648504Z Gathering data for ns/openshift-network-console...
2026-06-02T20:41:09.384230115Z Wrote inspect data to must-gather.
2026-06-02T20:41:09.680717749Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-02T20:41:09.683524302Z INFO: Fallback to identify the container image from release info
2026-06-02T20:41:09.880163828Z Gathering data for ns/openshift-console-operator...
2026-06-02T20:41:10.288406405Z Wrote inspect data to must-gather.
2026-06-02T20:41:10.329239154Z Gathering data for ns/openshift-console...
2026-06-02T20:41:10.506129000Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-02T20:41:10.623109726Z daemonset.apps/perf-node-gather-daemonset created
2026-06-02T20:41:10.757508118Z Waiting for performance profile collector pods to become ready: 1
2026-06-02T20:41:10.869835494Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-02T20:41:11.353609180Z Gathering data for ns/openshift-dns-operator...
2026-06-02T20:41:11.790115724Z Gathering data for ns/openshift-dns...
2026-06-02T20:41:11.878544494Z Waiting for performance profile collector pods to become ready: 2
2026-06-02T20:41:12.475588331Z Gathering data for ns/openshift-image-registry...
2026-06-02T20:41:13.006729570Z Gathering data for ns/openshift-ingress-operator...
2026-06-02T20:41:13.019140188Z Waiting for performance profile collector pods to become ready: 3
2026-06-02T20:41:13.129704541Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-06-02T20:41:13.407935368Z Gathering data for ns/openshift-ingress...
2026-06-02T20:41:14.153820359Z Waiting for performance profile collector pods to become ready: 4
2026-06-02T20:41:14.299341305Z Gathering data for ns/openshift-ingress-canary...
2026-06-02T20:41:14.806743983Z Gathering data for ns/openshift-insights...
2026-06-02T20:41:15.266242404Z Waiting for performance profile collector pods to become ready: 5
2026-06-02T20:41:16.381959427Z Waiting for performance profile collector pods to become ready: 6
2026-06-02T20:41:17.174489886Z Gathering data for ns/opendatahub...
2026-06-02T20:41:17.514061825Z Waiting for performance profile collector pods to become ready: 7
2026-06-02T20:41:18.135175538Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-06-02T20:41:18.632585824Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-02T20:41:18.891873243Z Collecting performance related data for node ip-10-0-132-46.ec2.internal
2026-06-02T20:41:18.898792770Z Collecting performance related data for node ip-10-0-134-118.ec2.internal
2026-06-02T20:41:18.906873963Z Collecting performance related data for node ip-10-0-137-123.ec2.internal
2026-06-02T20:41:19.192995840Z Gathering data for ns/openshift-lws-operator...
2026-06-02T20:41:21.059422550Z Gathering data for ns/openshift-config...
2026-06-02T20:41:21.493427919Z Gathering data for ns/openshift-config-managed...
2026-06-02T20:41:22.077994268Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-02T20:41:22.418034748Z Gathering data for ns/openshift-kube-apiserver...
2026-06-02T20:41:22.764139472Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-02T20:41:23.142709767Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-06-02T20:41:23.167545752Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-02T20:41:23.555047836Z Gathering data for ns/openshift-kube-scheduler...
2026-06-02T20:41:23.884689896Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-02T20:41:24.333723047Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-02T20:41:24.767190160Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-02T20:41:25.149954706Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-02T20:41:25.885951785Z Gathering data for ns/openshift-multus...
2026-06-02T20:41:27.639083686Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-02T20:41:27.658743060Z Collecting kubelet logs for node ip-10-0-132-46.ec2.internal
2026-06-02T20:41:27.660965924Z Collecting kubelet logs for node ip-10-0-134-118.ec2.internal
2026-06-02T20:41:27.662630885Z Collecting kubelet logs for node ip-10-0-137-123.ec2.internal
2026-06-02T20:41:28.030402544Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-02T20:41:28.035173730Z INFO: Node performance data collection complete.
2026-06-02T20:41:28.147824948Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-06-02T20:41:29.384832346Z Gathering data for ns/openshift-host-network...
2026-06-02T20:41:29.756637316Z Gathering data for ns/openshift-network-diagnostics...
2026-06-02T20:41:30.391164632Z Gathering data for ns/openshift-network-node-identity...
2026-06-02T20:41:30.956019939Z Gathering data for ns/openshift-network-operator...
2026-06-02T20:41:31.445288099Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-02T20:41:31.808284331Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-02T20:41:32.427310025Z Gathering data for ns/openshift-apiserver-operator...
2026-06-02T20:41:32.833487111Z Gathering data for ns/openshift-apiserver...
2026-06-02T20:41:33.156317422Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-06-02T20:41:33.354805585Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-02T20:41:33.673905332Z Gathering data for ns/openshift-controller-manager...
2026-06-02T20:41:34.031835248Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-02T20:41:34.932350654Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-02T20:41:35.293363816Z Gathering data for ns/openshift-service-ca-operator...
2026-06-02T20:41:35.685528923Z Gathering data for ns/openshift-service-ca...
2026-06-02T20:41:36.123480890Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-02T20:41:37.328020838Z Wrote inspect data to must-gather.
2026-06-02T20:41:37.328063594Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T20:41:37.328063594Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-02T20:41:37.467000751Z error: the server doesn't have a resource type "clusters"
2026-06-02T20:41:37.650669254Z Caches written to disk