2026-09-18T03:14:03.073443620Z [disk usage checker] Started
2026-09-18T03:14:03.077239594Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-18T03:14:03.279618153Z Gathering data for ns/openshift-cluster-version...
2026-09-18T03:14:03.430583467Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-18T03:14:03.534999202Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-18T03:14:03.623627280Z Gathering data for ns/default...
2026-09-18T03:14:03.937074649Z Gathering data for ns/openshift...
2026-09-18T03:14:04.382471908Z Gathering data for ns/kube-system...
2026-09-18T03:14:05.400793003Z Gathering data for ns/openshift-etcd...
2026-09-18T03:14:05.732794134Z Waiting on subprocesses to finish execution.
2026-09-18T03:14:05.739136103Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-18T03:14:05.746622508Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-18T03:14:05.749261507Z INFO: Gathering HAProxy config files
2026-09-18T03:14:05.753059251Z INFO: Collecting host service logs for crio
2026-09-18T03:14:05.753443706Z INFO: Collecting host service logs for kubelet
2026-09-18T03:14:05.753780648Z INFO: Collecting host service logs for rpm-ostreed
2026-09-18T03:14:05.754168551Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-18T03:14:05.754507229Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-18T03:14:05.754831783Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-18T03:14:05.755175186Z INFO: Collecting host service logs for NetworkManager
2026-09-18T03:14:05.755495946Z INFO: Collecting host service logs for openvswitch
2026-09-18T03:14:05.755835339Z INFO: Collecting host service logs for ovs-configuration
2026-09-18T03:14:05.756296028Z INFO: Collecting host service logs for ovsdb-server
2026-09-18T03:14:05.756631305Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-18T03:14:05.757001647Z INFO: Waiting for worker host service log collection to complete ...
2026-09-18T03:14:05.764293465Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-18T03:14:05.771857579Z Wrote inspect data to must-gather.
2026-09-18T03:14:05.771951560Z error: inspection completed with the errors occurred while gathering data:
2026-09-18T03:14:05.771951560Z     namespaces "assisted-installer" not found
2026-09-18T03:14:05.773520901Z Executing Istio gather script
2026-09-18T03:14:05.828320212Z INFO: Waiting for node performance related collection to complete ...
2026-09-18T03:14:06.293273068Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-18T03:14:06.581750557Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-18T03:14:06.660591552Z No resources found
2026-09-18T03:14:06.786312787Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-18T03:14:06.786408127Z INFO: on-disk MachineConfig config collection complete.
2026-09-18T03:14:06.865623876Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-18T03:14:06.881756381Z Wrote inspect data to must-gather.
2026-09-18T03:14:06.973967280Z error: the server doesn't have a resource type "performanceprofile"
2026-09-18T03:14:07.016920012Z No resources found in openshift-etcd namespace.
2026-09-18T03:14:07.059511824Z INFO: Collecting Insights Archives from insights-operator-6f9c644dd9-w2kbk
2026-09-18T03:14:07.059609223Z insights-runtime-extractor-ms2lx
2026-09-18T03:14:07.059631559Z insights-runtime-extractor-txzqb
2026-09-18T03:14:07.059651308Z insights-runtime-extractor-xz2wb
2026-09-18T03:14:07.178807805Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-18T03:14:07.250559157Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-18T03:14:07.316603894Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-18T03:14:07.416238341Z INFO: Worker host service log collection to complete.
2026-09-18T03:14:07.455493505Z Wrote inspect data to must-gather.
2026-09-18T03:14:07.757713582Z No resources found
2026-09-18T03:14:07.778064890Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-18T03:14:07.778064890Z See 'oc rsync -h' for help and examples
2026-09-18T03:14:07.784561946Z INFO: "metallb-operator" not detected. Skipping.
2026-09-18T03:14:07.873370597Z Wrote inspect data to must-gather.
2026-09-18T03:14:07.936786255Z Wrote inspect data to must-gather.
2026-09-18T03:14:07.966285787Z tar: Removing leading `/' from member names
2026-09-18T03:14:07.968839486Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-18T03:14:07.970368049Z INFO: HAProxy config collection complete.
2026-09-18T03:14:07.975379919Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-18T03:14:08.059155637Z Wrote inspect data to must-gather.
2026-09-18T03:14:08.105911023Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-18T03:14:08.118491133Z Wrote inspect data to must-gather.
2026-09-18T03:14:08.163264412Z Gathering data for ns/openshift-monitoring...
2026-09-18T03:14:08.247776350Z Wrote inspect data to must-gather.
2026-09-18T03:14:08.250983027Z ERROR: No running kube-apiserver pods found
2026-09-18T03:14:08.315031945Z error: the server doesn't have a resource type "machineconfigs"
2026-09-18T03:14:08.331211222Z INFO: 'previous-logs' folder not found on ip-10-0-137-88.ec2.internal, skipping...
2026-09-18T03:14:08.378387617Z Wrote inspect data to must-gather.
2026-09-18T03:14:08.492789932Z INFO: Getting rules from prometheus-k8s-0
2026-09-18T03:14:08.502048788Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-18T03:14:08.651577548Z INFO: 'previous-logs' folder not found on ip-10-0-139-228.ec2.internal, skipping...
2026-09-18T03:14:08.672776898Z Wrote inspect data to must-gather.
2026-09-18T03:14:08.766641774Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-18T03:14:08.777212620Z Wrote inspect data to must-gather.
2026-09-18T03:14:08.937526232Z INFO: 'previous-logs' folder not found on ip-10-0-142-11.ec2.internal, skipping...
2026-09-18T03:14:08.937628629Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-18T03:14:08.937679883Z INFO: Machine Config Daemon termination log collection complete.
2026-09-18T03:14:08.939115059Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-18T03:14:08.959837124Z Wrote inspect data to must-gather.
2026-09-18T03:14:08.984016336Z INFO: Getting status/config from prometheus-k8s-0
2026-09-18T03:14:09.163298984Z Wrote inspect data to must-gather.
2026-09-18T03:14:09.237891045Z INFO: INTERCONNECT MODE
2026-09-18T03:14:09.237922251Z INFO: Gathering ovn-kubernetes DBs
2026-09-18T03:14:09.381375511Z Wrote inspect data to must-gather.
2026-09-18T03:14:09.393676695Z INFO: Gathering OVN_Northbound from ovnkube-node-4d76r...
2026-09-18T03:14:09.394039578Z INFO: Gathering OVN_Northbound from ovnkube-node-l79qw...
2026-09-18T03:14:09.394351135Z INFO: Gathering OVN_Northbound from ovnkube-node-llhfb...
2026-09-18T03:14:09.394645376Z INFO: Gathering OVN_Southbound from ovnkube-node-4d76r...
2026-09-18T03:14:09.394895342Z INFO: Gathering OVN_Southbound from ovnkube-node-l79qw...
2026-09-18T03:14:09.395197991Z INFO: Gathering OVN_Southbound from ovnkube-node-llhfb...
2026-09-18T03:14:09.702414335Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-18T03:14:09.768052473Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-18T03:14:09.783006205Z Wrote inspect data to must-gather.
2026-09-18T03:14:09.813351634Z tar: Removing leading `/' from member names
2026-09-18T03:14:09.874318699Z tar: Removing leading `/' from member names
2026-09-18T03:14:09.874466954Z tar: Removing leading `/' from member names
2026-09-18T03:14:09.889870685Z tar: Removing leading `/' from member names
2026-09-18T03:14:09.897554056Z tar: Removing leading `/' from member names
2026-09-18T03:14:09.936902920Z tar: Removing leading `/' from member names
2026-09-18T03:14:09.979926081Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:14:10.027458258Z Wrote inspect data to must-gather.
2026-09-18T03:14:10.036883116Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-18T03:14:10.208043653Z INFO: Waiting for network log collection to complete ...
2026-09-18T03:14:10.208105466Z INFO: Waiting for ovnk database copies to complete ...
2026-09-18T03:14:10.208582294Z INFO: Copying ovnk databases complete.
2026-09-18T03:14:10.210732822Z 2.8M	must-gather/network_logs/ovnk_database_store
2026-09-18T03:14:10.212736620Z ovnk_database_store/
2026-09-18T03:14:10.212736620Z ovnk_database_store/ovnkube-node-l79qw_nbdb
2026-09-18T03:14:10.222008264Z ovnk_database_store/ovnkube-node-4d76r_nbdb
2026-09-18T03:14:10.226207181Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:14:10.227047095Z ovnk_database_store/ovnkube-node-4d76r_sbdb
2026-09-18T03:14:10.228593228Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-18T03:14:10.242221540Z ovnk_database_store/ovnkube-node-l79qw_sbdb
2026-09-18T03:14:10.251599916Z Wrote inspect data to must-gather.
2026-09-18T03:14:10.259297256Z ovnk_database_store/ovnkube-node-llhfb_sbdb
2026-09-18T03:14:10.273664781Z ovnk_database_store/ovnkube-node-llhfb_nbdb
2026-09-18T03:14:10.282040871Z INFO: Network log collection complete.
2026-09-18T03:14:10.324183221Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-18T03:14:10.407807550Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:14:10.456830732Z Wrote inspect data to must-gather.
2026-09-18T03:14:10.583969926Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-18T03:14:10.623621281Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:14:10.626701732Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-18T03:14:10.668422145Z Wrote inspect data to must-gather.
2026-09-18T03:14:10.770582365Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-18T03:14:10.817032496Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:14:10.914211332Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-18T03:14:10.917108400Z INFO: Fallback to identify the container image from release info
2026-09-18T03:14:10.996265841Z INFO: Getting status from alertmanager-main-0
2026-09-18T03:14:11.041192290Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:14:11.044161135Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-18T03:14:11.260104991Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:14:11.354601398Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-18T03:14:11.448807649Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:14:11.450993632Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-18T03:14:11.542284168Z Gathering data for ns/openshift-network-console...
2026-09-18T03:14:11.571032145Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea
2026-09-18T03:14:11.630180340Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:14:11.704138027Z daemonset.apps/perf-node-gather-daemonset created
2026-09-18T03:14:11.820911410Z Waiting for performance profile collector pods to become ready: 1
2026-09-18T03:14:11.824496344Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:14:12.140053763Z Gathering data for ns/openshift-console-operator...
2026-09-18T03:14:12.504573771Z Done executing Istio gather script
2026-09-18T03:14:12.729671154Z Gathering data for ns/openshift-console...
2026-09-18T03:14:12.939474334Z Waiting for performance profile collector pods to become ready: 2
2026-09-18T03:14:13.123503962Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-18T03:14:13.268473395Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-18T03:14:13.859024078Z Gathering data for ns/openshift-dns-operator...
2026-09-18T03:14:14.050360517Z Waiting for performance profile collector pods to become ready: 3
2026-09-18T03:14:14.180056120Z Gathering data for ns/openshift-dns...
2026-09-18T03:14:14.910701633Z Gathering data for ns/openshift-image-registry...
2026-09-18T03:14:15.155510636Z Waiting for performance profile collector pods to become ready: 4
2026-09-18T03:14:15.596644315Z Gathering data for ns/openshift-ingress-operator...
2026-09-18T03:14:15.972038667Z Gathering data for ns/openshift-ingress...
2026-09-18T03:14:16.278693072Z Waiting for performance profile collector pods to become ready: 5
2026-09-18T03:14:16.329039316Z Gathering data for ns/openshift-ingress-canary...
2026-09-18T03:14:16.705202261Z Gathering data for ns/openshift-insights...
2026-09-18T03:14:17.398876039Z Waiting for performance profile collector pods to become ready: 6
2026-09-18T03:14:18.127929891Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-18T03:14:18.503050320Z Waiting for performance profile collector pods to become ready: 7
2026-09-18T03:14:18.705311672Z Gathering data for ns/openshift-jobset-operator...
2026-09-18T03:14:19.499139972Z Gathering data for ns/openshift-config...
2026-09-18T03:14:19.620411577Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-18T03:14:19.788525033Z Gathering data for ns/openshift-config-managed...
2026-09-18T03:14:19.876809130Z Collecting performance related data for node ip-10-0-139-228.ec2.internal
2026-09-18T03:14:19.883472151Z Collecting performance related data for node ip-10-0-142-11.ec2.internal
2026-09-18T03:14:19.890704504Z Collecting performance related data for node ip-10-0-137-88.ec2.internal
2026-09-18T03:14:20.281127693Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-18T03:14:20.734678434Z Gathering data for ns/openshift-kube-apiserver...
2026-09-18T03:14:21.110341029Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-18T03:14:21.479124167Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-18T03:14:21.837992987Z Gathering data for ns/openshift-kube-scheduler...
2026-09-18T03:14:22.116372504Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-18T03:14:22.502314666Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-18T03:14:23.053977695Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-18T03:14:23.133745656Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-18T03:14:23.393693499Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-18T03:14:23.920997538Z Gathering data for ns/openshift-multus...
2026-09-18T03:14:26.154147633Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-18T03:14:27.806114331Z Gathering data for ns/openshift-host-network...
2026-09-18T03:14:28.060769677Z Collecting kubelet logs for node ip-10-0-139-228.ec2.internal
2026-09-18T03:14:28.062924795Z Collecting kubelet logs for node ip-10-0-142-11.ec2.internal
2026-09-18T03:14:28.065033586Z Collecting kubelet logs for node ip-10-0-137-88.ec2.internal
2026-09-18T03:14:28.139711398Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-18T03:14:28.202522112Z Gathering data for ns/openshift-network-diagnostics...
2026-09-18T03:14:28.404887183Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-mdtc7 namespace
2026-09-18T03:14:28.413541394Z INFO: Node performance data collection complete.
2026-09-18T03:14:28.862668066Z Gathering data for ns/openshift-network-node-identity...
2026-09-18T03:14:29.430983908Z Gathering data for ns/openshift-network-operator...
2026-09-18T03:14:29.958867449Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-18T03:14:30.344147710Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-18T03:14:31.096491573Z Gathering data for ns/openshift-apiserver-operator...
2026-09-18T03:14:31.466255111Z Gathering data for ns/openshift-apiserver...
2026-09-18T03:14:32.034071808Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-18T03:14:32.457585022Z Gathering data for ns/openshift-controller-manager...
2026-09-18T03:14:32.888490915Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-18T03:14:33.145383342Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-18T03:14:33.738195921Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-18T03:14:34.131003226Z Gathering data for ns/openshift-service-ca-operator...
2026-09-18T03:14:34.566049543Z Gathering data for ns/openshift-service-ca...
2026-09-18T03:14:35.083169369Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-18T03:14:36.142965642Z Wrote inspect data to must-gather.
2026-09-18T03:14:36.143004118Z error: inspection completed with the errors occurred while gathering data:
2026-09-18T03:14:36.143004118Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-18T03:14:36.261174102Z error: the server doesn't have a resource type "clusters"
2026-09-18T03:14:36.397492070Z Caches written to disk