2026-06-15T00:58:44.951511429Z [disk usage checker] Started
2026-06-15T00:58:44.954914160Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-15T00:58:45.138880347Z Gathering data for ns/openshift-cluster-version...
2026-06-15T00:58:45.259654641Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-15T00:58:45.332957119Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-15T00:58:45.399994201Z Gathering data for ns/default...
2026-06-15T00:58:45.642891070Z Gathering data for ns/openshift...
2026-06-15T00:58:45.995076383Z Gathering data for ns/kube-system...
2026-06-15T00:58:46.569945439Z Gathering data for ns/openshift-etcd...
2026-06-15T00:58:46.855261544Z Wrote inspect data to must-gather.
2026-06-15T00:58:46.855298371Z error: inspection completed with the errors occurred while gathering data:
2026-06-15T00:58:46.855298371Z     namespaces "assisted-installer" not found
2026-06-15T00:58:47.442041805Z Waiting on subprocesses to finish execution.
2026-06-15T00:58:47.452159141Z Executing Istio gather script
2026-06-15T00:58:47.453994312Z INFO: Gathering HAProxy config files
2026-06-15T00:58:47.454022418Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-15T00:58:47.458052995Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-15T00:58:47.458406308Z INFO: Collecting host service logs for crio
2026-06-15T00:58:47.458699498Z INFO: Collecting host service logs for kubelet
2026-06-15T00:58:47.459040546Z INFO: Collecting host service logs for rpm-ostreed
2026-06-15T00:58:47.459364175Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-15T00:58:47.459681573Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-15T00:58:47.459994479Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-15T00:58:47.460306830Z INFO: Collecting host service logs for NetworkManager
2026-06-15T00:58:47.460655466Z INFO: Collecting host service logs for openvswitch
2026-06-15T00:58:47.460928821Z INFO: Collecting host service logs for ovs-configuration
2026-06-15T00:58:47.461355888Z INFO: Collecting host service logs for ovsdb-server
2026-06-15T00:58:47.461713099Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-15T00:58:47.462063690Z INFO: Waiting for worker host service log collection to complete ...
2026-06-15T00:58:47.466655326Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-15T00:58:47.669518697Z INFO: Waiting for node performance related collection to complete ...
2026-06-15T00:58:47.939215089Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-15T00:58:48.143140229Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-15T00:58:48.201605046Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-15T00:58:48.275358989Z INFO: Collecting Insights Archives from insights-operator-5bbd86d6bd-2mn6k
2026-06-15T00:58:48.275407892Z insights-runtime-extractor-nk5m5
2026-06-15T00:58:48.275427867Z insights-runtime-extractor-pdf8q
2026-06-15T00:58:48.275447145Z insights-runtime-extractor-szrh2
2026-06-15T00:58:48.375807482Z Wrote inspect data to must-gather.
2026-06-15T00:58:48.432454188Z No resources found in openshift-etcd namespace.
2026-06-15T00:58:48.468678461Z INFO: "metallb-operator" not detected. Skipping.
2026-06-15T00:58:48.494136085Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-15T00:58:48.494241214Z INFO: on-disk MachineConfig config collection complete.
2026-06-15T00:58:48.692161844Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-15T00:58:48.721703555Z error: the server doesn't have a resource type "performanceprofile"
2026-06-15T00:58:48.751961231Z No resources found
2026-06-15T00:58:49.048916559Z Wrote inspect data to must-gather.
2026-06-15T00:58:49.105569887Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-15T00:58:49.105569887Z See 'oc rsync -h' for help and examples
2026-06-15T00:58:49.116933460Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-15T00:58:49.152354010Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-15T00:58:49.229598618Z No resources found
2026-06-15T00:58:49.295637360Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-15T00:58:49.364460456Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-15T00:58:49.430429111Z INFO: Worker host service log collection to complete.
2026-06-15T00:58:49.460945319Z Wrote inspect data to must-gather.
2026-06-15T00:58:49.509661504Z Wrote inspect data to must-gather.
2026-06-15T00:58:49.716621196Z Wrote inspect data to must-gather.
2026-06-15T00:58:49.721031794Z Wrote inspect data to must-gather.
2026-06-15T00:58:49.743125827Z ERROR: No running kube-apiserver pods found
2026-06-15T00:58:49.836370978Z tar: Removing leading `/' from member names
2026-06-15T00:58:49.841191483Z INFO: HAProxy config collection complete.
2026-06-15T00:58:49.842790245Z Wrote inspect data to must-gather.
2026-06-15T00:58:49.854275656Z INFO: 'previous-logs' folder not found on ip-10-0-137-70.ec2.internal, skipping...
2026-06-15T00:58:49.964265941Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-15T00:58:50.002341008Z INFO: Getting rules from prometheus-k8s-0
2026-06-15T00:58:50.033038232Z error: the server doesn't have a resource type "machineconfigs"
2026-06-15T00:58:50.057791630Z Wrote inspect data to must-gather.
2026-06-15T00:58:50.144152770Z Gathering data for ns/openshift-monitoring...
2026-06-15T00:58:50.202096481Z INFO: 'previous-logs' folder not found on ip-10-0-139-176.ec2.internal, skipping...
2026-06-15T00:58:50.248281039Z error: the server doesn't have a resource type "machineconfigpools"
2026-06-15T00:58:50.371213322Z Wrote inspect data to must-gather.
2026-06-15T00:58:50.481760697Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-06-15T00:58:50.489405392Z INFO: Getting status/config from prometheus-k8s-0
2026-06-15T00:58:50.510327351Z INFO: 'previous-logs' folder not found on ip-10-0-139-5.ec2.internal, skipping...
2026-06-15T00:58:50.510425052Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-15T00:58:50.510475090Z INFO: Machine Config Daemon termination log collection complete.
2026-06-15T00:58:50.518903479Z Wrote inspect data to must-gather.
2026-06-15T00:58:50.637350519Z Wrote inspect data to must-gather.
2026-06-15T00:58:50.679175991Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-15T00:58:50.879336612Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-15T00:58:50.899893249Z Wrote inspect data to must-gather.
2026-06-15T00:58:50.914995939Z INFO: INTERCONNECT MODE
2026-06-15T00:58:50.915025496Z INFO: Gathering ovn-kubernetes DBs
2026-06-15T00:58:51.025171669Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-06-15T00:58:51.069679010Z INFO: Gathering OVN_Northbound from ovnkube-node-4z9ss...
2026-06-15T00:58:51.069946009Z INFO: Gathering OVN_Northbound from ovnkube-node-j2hwv...
2026-06-15T00:58:51.070654074Z INFO: Gathering OVN_Northbound from ovnkube-node-xd7q9...
2026-06-15T00:58:51.070900291Z INFO: Gathering OVN_Southbound from ovnkube-node-4z9ss...
2026-06-15T00:58:51.071135354Z INFO: Gathering OVN_Southbound from ovnkube-node-j2hwv...
2026-06-15T00:58:51.071427418Z INFO: Gathering OVN_Southbound from ovnkube-node-xd7q9...
2026-06-15T00:58:51.120535379Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-15T00:58:51.133730386Z Wrote inspect data to must-gather.
2026-06-15T00:58:51.321776988Z Wrote inspect data to /must-gather/istio.
2026-06-15T00:58:51.357045129Z tar: Removing leading `/' from member names
2026-06-15T00:58:51.383287799Z tar: Removing leading `/' from member names
2026-06-15T00:58:51.411034545Z tar: Removing leading `/' from member names
2026-06-15T00:58:51.445492053Z tar: Removing leading `/' from member names
2026-06-15T00:58:51.445667425Z tar: Removing leading `/' from member names
2026-06-15T00:58:51.449524669Z tar: Removing leading `/' from member names
2026-06-15T00:58:51.488210844Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-15T00:58:51.502387539Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-15T00:58:51.533025954Z Wrote inspect data to must-gather.
2026-06-15T00:58:51.588650039Z Wrote inspect data to /must-gather/istio.
2026-06-15T00:58:51.591885433Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-06-15T00:58:51.757351869Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-15T00:58:51.790355989Z Wrote inspect data to must-gather.
2026-06-15T00:58:51.813528465Z Wrote inspect data to /must-gather/istio.
2026-06-15T00:58:51.893814370Z INFO: Waiting for network log collection to complete ...
2026-06-15T00:58:51.893854209Z INFO: Waiting for ovnk database copies to complete ...
2026-06-15T00:58:51.894230941Z INFO: Copying ovnk databases complete.
2026-06-15T00:58:51.895784489Z 2.5M	must-gather/network_logs/ovnk_database_store
2026-06-15T00:58:51.897939740Z ovnk_database_store/
2026-06-15T00:58:51.897939740Z ovnk_database_store/ovnkube-node-4z9ss_nbdb
2026-06-15T00:58:51.905189647Z ovnk_database_store/ovnkube-node-4z9ss_sbdb
2026-06-15T00:58:51.923915408Z ovnk_database_store/ovnkube-node-xd7q9_sbdb
2026-06-15T00:58:51.940877196Z ovnk_database_store/ovnkube-node-j2hwv_nbdb
2026-06-15T00:58:51.948187272Z ovnk_database_store/ovnkube-node-j2hwv_sbdb
2026-06-15T00:58:51.964162166Z ovnk_database_store/ovnkube-node-xd7q9_nbdb
2026-06-15T00:58:51.975175730Z INFO: Network log collection complete.
2026-06-15T00:58:52.027214567Z Wrote inspect data to must-gather.
2026-06-15T00:58:52.057935730Z Wrote inspect data to /must-gather/istio.
2026-06-15T00:58:52.060385177Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-06-15T00:58:52.145347942Z INFO: Getting status from alertmanager-main-0
2026-06-15T00:58:52.166859645Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-15T00:58:52.258888065Z Wrote inspect data to /must-gather/istio.
2026-06-15T00:58:52.316812616Z Wrote inspect data to must-gather.
2026-06-15T00:58:52.349582023Z Gathering data for ns/openshift-network-console...
2026-06-15T00:58:52.469110878Z Wrote inspect data to /must-gather/istio.
2026-06-15T00:58:52.471266053Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-06-15T00:58:52.611337202Z Wrote inspect data to must-gather.
2026-06-15T00:58:52.685623013Z Wrote inspect data to /must-gather/istio.
2026-06-15T00:58:52.744950836Z Gathering data for ns/openshift-console-operator...
2026-06-15T00:58:52.871756559Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-15T00:58:52.874115119Z INFO: Fallback to identify the container image from release info
2026-06-15T00:58:52.889046832Z Wrote inspect data to /must-gather/istio.
2026-06-15T00:58:52.891706068Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-06-15T00:58:53.049693269Z Wrote inspect data to /must-gather/istio.
2026-06-15T00:58:53.098228003Z Gathering data for ns/openshift-console...
2026-06-15T00:58:53.227893244Z Wrote inspect data to /must-gather/istio.
2026-06-15T00:58:53.437228131Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d66a6b2ec52dede5d83ce04f6abfc519df1fd7dc36248741e03ecb9bf8d1762
2026-06-15T00:58:53.564243975Z daemonset.apps/perf-node-gather-daemonset created
2026-06-15T00:58:53.593024144Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-15T00:58:53.713810480Z Waiting for performance profile collector pods to become ready: 1
2026-06-15T00:58:53.877780027Z Done executing Istio gather script
2026-06-15T00:58:54.068393636Z Gathering data for ns/openshift-dns-operator...
2026-06-15T00:58:54.302284293Z Gathering data for ns/openshift-dns...
2026-06-15T00:58:54.772253013Z Gathering data for ns/openshift-image-registry...
2026-06-15T00:58:54.822581131Z Waiting for performance profile collector pods to become ready: 2
2026-06-15T00:58:54.971090826Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-15T00:58:55.152415643Z Gathering data for ns/openshift-ingress-operator...
2026-06-15T00:58:55.419080141Z Gathering data for ns/openshift-ingress...
2026-06-15T00:58:55.684275274Z Gathering data for ns/openshift-ingress-canary...
2026-06-15T00:58:55.944337175Z Waiting for performance profile collector pods to become ready: 3
2026-06-15T00:58:56.013849983Z Gathering data for ns/openshift-insights...
2026-06-15T00:58:57.049453827Z Waiting for performance profile collector pods to become ready: 4
2026-06-15T00:58:57.672943918Z Gathering data for ns/openshift-config...
2026-06-15T00:58:57.927487058Z Gathering data for ns/openshift-config-managed...
2026-06-15T00:58:58.147198168Z Waiting for performance profile collector pods to become ready: 5
2026-06-15T00:58:58.264810935Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-15T00:58:58.475180997Z Gathering data for ns/openshift-kube-apiserver...
2026-06-15T00:58:58.681859218Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-15T00:58:58.911046052Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-15T00:58:59.138176430Z Gathering data for ns/openshift-kube-scheduler...
2026-06-15T00:58:59.264829476Z Waiting for performance profile collector pods to become ready: 6
2026-06-15T00:58:59.353414707Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-15T00:58:59.584697651Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-15T00:58:59.836246292Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-15T00:58:59.976280444Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-15T00:59:00.081941065Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-15T00:59:00.376782662Z Waiting for performance profile collector pods to become ready: 7
2026-06-15T00:59:00.498604827Z Gathering data for ns/openshift-multus...
2026-06-15T00:59:01.491934485Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-15T00:59:01.642376251Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-15T00:59:01.724314970Z Collecting performance related data for node ip-10-0-139-5.ec2.internal
2026-06-15T00:59:01.731161570Z Collecting performance related data for node ip-10-0-137-70.ec2.internal
2026-06-15T00:59:01.738431930Z Collecting performance related data for node ip-10-0-139-176.ec2.internal
2026-06-15T00:59:02.796170898Z Gathering data for ns/openshift-host-network...
2026-06-15T00:59:03.152705577Z Gathering data for ns/openshift-network-diagnostics...
2026-06-15T00:59:03.584949635Z Gathering data for ns/openshift-network-node-identity...
2026-06-15T00:59:03.956668727Z Gathering data for ns/openshift-network-operator...
2026-06-15T00:59:04.305597970Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-15T00:59:04.538480397Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-15T00:59:04.953291092Z Gathering data for ns/openshift-apiserver-operator...
2026-06-15T00:59:04.983607675Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-15T00:59:05.196174935Z Gathering data for ns/openshift-apiserver...
2026-06-15T00:59:05.532327722Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-15T00:59:05.754492853Z Gathering data for ns/openshift-controller-manager...
2026-06-15T00:59:05.983051319Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-15T00:59:06.579187851Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-15T00:59:06.817888985Z Gathering data for ns/openshift-service-ca-operator...
2026-06-15T00:59:07.102557554Z Gathering data for ns/openshift-service-ca...
2026-06-15T00:59:07.412704248Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-15T00:59:08.211045792Z Wrote inspect data to must-gather.
2026-06-15T00:59:08.211097064Z error: inspection completed with the errors occurred while gathering data:
2026-06-15T00:59:08.211097064Z     [skipping gathering secrets/support due to error: secrets "support" not found, skipping gathering daemonsets.apps/ovn-ipsec-containerized due to error: daemonsets.apps "ovn-ipsec-containerized" not found]
2026-06-15T00:59:09.160259866Z Collecting kubelet logs for node ip-10-0-139-5.ec2.internal
2026-06-15T00:59:09.161996083Z Collecting kubelet logs for node ip-10-0-137-70.ec2.internal
2026-06-15T00:59:09.163620624Z Collecting kubelet logs for node ip-10-0-139-176.ec2.internal
2026-06-15T00:59:09.448817854Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-9n24f namespace
2026-06-15T00:59:09.452990271Z INFO: Node performance data collection complete.
2026-06-15T00:59:09.574771823Z error: the server doesn't have a resource type "clusters"
2026-06-15T00:59:09.735782838Z Caches written to disk