2026-09-11T06:28:02.443875690Z [disk usage checker] Started
2026-09-11T06:28:02.447108482Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-09-11T06:28:02.636295515Z Gathering data for ns/openshift-cluster-version...
2026-09-11T06:28:02.761337345Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-11T06:28:02.843648885Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-11T06:28:02.926968700Z Gathering data for ns/default...
2026-09-11T06:28:03.242471984Z Gathering data for ns/openshift...
2026-09-11T06:28:03.623527852Z Gathering data for ns/kube-system...
2026-09-11T06:28:04.261261377Z Gathering data for ns/openshift-etcd...
2026-09-11T06:28:04.546857198Z Wrote inspect data to must-gather.
2026-09-11T06:28:04.546891169Z error: inspection completed with the errors occurred while gathering data:
2026-09-11T06:28:04.546891169Z     namespaces "assisted-installer" not found
2026-09-11T06:28:04.939776059Z Waiting on subprocesses to finish execution.
2026-09-11T06:28:04.946424935Z Executing Istio gather script
2026-09-11T06:28:04.946981926Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-11T06:28:04.947047983Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-11T06:28:04.955295019Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-11T06:28:04.955328322Z INFO: Collecting host service logs for crio
2026-09-11T06:28:04.955616398Z INFO: Collecting host service logs for kubelet
2026-09-11T06:28:04.955906916Z INFO: Collecting host service logs for rpm-ostreed
2026-09-11T06:28:04.956188677Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-11T06:28:04.956544915Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-11T06:28:04.957118648Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-11T06:28:04.957455375Z INFO: Collecting host service logs for NetworkManager
2026-09-11T06:28:04.957819614Z INFO: Collecting host service logs for openvswitch
2026-09-11T06:28:04.958158077Z INFO: Collecting host service logs for ovs-configuration
2026-09-11T06:28:04.958504077Z INFO: Collecting host service logs for ovsdb-server
2026-09-11T06:28:04.958844785Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-11T06:28:04.959229639Z INFO: Waiting for worker host service log collection to complete ...
2026-09-11T06:28:04.960331207Z INFO: Gathering HAProxy config files
2026-09-11T06:28:05.066822579Z INFO: Waiting for node performance related collection to complete ...
2026-09-11T06:28:05.216866816Z No resources found in openshift-etcd namespace.
2026-09-11T06:28:05.586035043Z Wrote inspect data to must-gather.
2026-09-11T06:28:05.705817984Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-11T06:28:05.705913422Z INFO: on-disk MachineConfig config collection complete.
2026-09-11T06:28:05.724222122Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-11T06:28:05.854834825Z error: the server doesn't have a resource type "performanceprofile"
2026-09-11T06:28:05.896914588Z ERROR: No running kube-apiserver pods found
2026-09-11T06:28:05.918234372Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-11T06:28:06.218088652Z No resources found
2026-09-11T06:28:06.307878774Z INFO: "metallb-operator" not detected. Skipping.
2026-09-11T06:28:06.468943675Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-11T06:28:06.584830795Z INFO: Collecting Insights Archives from insights-operator-5844b856db-24ts6
2026-09-11T06:28:06.584830795Z insights-runtime-extractor-58xtc
2026-09-11T06:28:06.584830795Z insights-runtime-extractor-fcq2r
2026-09-11T06:28:06.584830795Z insights-runtime-extractor-q7h22
2026-09-11T06:28:06.597647601Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-11T06:28:06.641756708Z Wrote inspect data to must-gather.
2026-09-11T06:28:06.723438802Z INFO: Worker host service log collection to complete.
2026-09-11T06:28:06.913997016Z INFO: 'previous-logs' folder not found on ip-10-0-132-32.ec2.internal, skipping...
2026-09-11T06:28:06.969138046Z No resources found
2026-09-11T06:28:07.035071207Z Wrote inspect data to must-gather.
2026-09-11T06:28:07.052659268Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-11T06:28:07.154894084Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-11T06:28:07.170702309Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-11T06:28:07.276207159Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-11T06:28:07.276207159Z See 'oc rsync -h' for help and examples
2026-09-11T06:28:07.325905625Z Wrote inspect data to must-gather.
2026-09-11T06:28:07.403751813Z Wrote inspect data to must-gather.
2026-09-11T06:28:07.461972009Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-09-11T06:28:07.474307259Z error: the server doesn't have a resource type "machineconfigs"
2026-09-11T06:28:07.490947823Z Wrote inspect data to must-gather.
2026-09-11T06:28:07.509839666Z Wrote inspect data to must-gather.
2026-09-11T06:28:07.525660167Z Gathering data for ns/openshift-monitoring...
2026-09-11T06:28:07.566623455Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-11T06:28:07.599778264Z tar: Removing leading `/' from member names
2026-09-11T06:28:07.604772091Z INFO: 'previous-logs' folder not found on ip-10-0-139-145.ec2.internal, skipping...
2026-09-11T06:28:07.608503420Z INFO: HAProxy config collection complete.
2026-09-11T06:28:07.703294673Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-11T06:28:07.836606146Z Wrote inspect data to must-gather.
2026-09-11T06:28:07.900774469Z INFO: 'previous-logs' folder not found on ip-10-0-139-247.ec2.internal, skipping...
2026-09-11T06:28:07.900888871Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-11T06:28:07.901495842Z INFO: Machine Config Daemon termination log collection complete.
2026-09-11T06:28:07.969517931Z Wrote inspect data to must-gather.
2026-09-11T06:28:08.041086275Z INFO: Getting rules from prometheus-k8s-0
2026-09-11T06:28:08.125058763Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-11T06:28:08.138943375Z Wrote inspect data to must-gather.
2026-09-11T06:28:08.147659107Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-11T06:28:08.368446271Z Wrote inspect data to must-gather.
2026-09-11T06:28:08.371831984Z Wrote inspect data to must-gather.
2026-09-11T06:28:08.429806708Z INFO: Getting status/config from prometheus-k8s-0
2026-09-11T06:28:08.589999681Z Wrote inspect data to must-gather.
2026-09-11T06:28:08.656116605Z INFO: INTERCONNECT MODE
2026-09-11T06:28:08.656155915Z INFO: Gathering ovn-kubernetes DBs
2026-09-11T06:28:08.833646438Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-11T06:28:08.834757545Z Wrote inspect data to must-gather.
2026-09-11T06:28:08.844655726Z INFO: Gathering OVN_Northbound from ovnkube-node-4phpp...
2026-09-11T06:28:08.844923223Z INFO: Gathering OVN_Northbound from ovnkube-node-ccqfl...
2026-09-11T06:28:08.845231779Z INFO: Gathering OVN_Northbound from ovnkube-node-lvcvk...
2026-09-11T06:28:08.845560571Z INFO: Gathering OVN_Southbound from ovnkube-node-4phpp...
2026-09-11T06:28:08.845858576Z INFO: Gathering OVN_Southbound from ovnkube-node-ccqfl...
2026-09-11T06:28:08.846164111Z INFO: Gathering OVN_Southbound from ovnkube-node-lvcvk...
2026-09-11T06:28:08.932850417Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-11T06:28:09.011993286Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-11T06:28:09.155439970Z tar: Removing leading `/' from member names
2026-09-11T06:28:09.182741741Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-11T06:28:09.195266030Z tar: Removing leading `/' from member names
2026-09-11T06:28:09.212054048Z Wrote inspect data to must-gather.
2026-09-11T06:28:09.220210966Z tar: Removing leading `/' from member names
2026-09-11T06:28:09.242128197Z tar: Removing leading `/' from member names
2026-09-11T06:28:09.247577466Z tar: Removing leading `/' from member names
2026-09-11T06:28:09.260335192Z tar: Removing leading `/' from member names
2026-09-11T06:28:09.326655033Z Wrote inspect data to /must-gather/istio.
2026-09-11T06:28:09.457309348Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-11T06:28:09.491198078Z Wrote inspect data to must-gather.
2026-09-11T06:28:09.562553232Z Wrote inspect data to /must-gather/istio.
2026-09-11T06:28:09.571484371Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-11T06:28:09.677266408Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-11T06:28:09.717952632Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-11T06:28:09.732185982Z INFO: Waiting for network log collection to complete ...
2026-09-11T06:28:09.732228210Z INFO: Waiting for ovnk database copies to complete ...
2026-09-11T06:28:09.732667064Z INFO: Copying ovnk databases complete.
2026-09-11T06:28:09.734730985Z 2.8M	must-gather/network_logs/ovnk_database_store
2026-09-11T06:28:09.737450958Z ovnk_database_store/
2026-09-11T06:28:09.737499946Z ovnk_database_store/ovnkube-node-lvcvk_nbdb
2026-09-11T06:28:09.746904316Z ovnk_database_store/ovnkube-node-ccqfl_nbdb
2026-09-11T06:28:09.754698418Z ovnk_database_store/ovnkube-node-ccqfl_sbdb
2026-09-11T06:28:09.772560903Z ovnk_database_store/ovnkube-node-4phpp_nbdb
2026-09-11T06:28:09.781264229Z ovnk_database_store/ovnkube-node-lvcvk_sbdb
2026-09-11T06:28:09.799126600Z ovnk_database_store/ovnkube-node-4phpp_sbdb
2026-09-11T06:28:09.800911224Z Wrote inspect data to /must-gather/istio.
2026-09-11T06:28:09.816764214Z INFO: Network log collection complete.
2026-09-11T06:28:09.849948055Z Wrote inspect data to must-gather.
2026-09-11T06:28:09.882270524Z Gathering data for ns/openshift-network-console...
2026-09-11T06:28:10.030709453Z Wrote inspect data to /must-gather/istio.
2026-09-11T06:28:10.032764134Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-11T06:28:10.120009066Z INFO: Getting status from alertmanager-main-0
2026-09-11T06:28:10.148325566Z W0911 06:28:10.148282    1526 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-09-11T06:28:10.164385361Z Wrote inspect data to must-gather.
2026-09-11T06:28:10.255199499Z Wrote inspect data to /must-gather/istio.
2026-09-11T06:28:10.355692762Z Gathering data for ns/openshift-console-operator...
2026-09-11T06:28:10.443395262Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-11T06:28:10.445930662Z INFO: Fallback to identify the container image from release info
2026-09-11T06:28:10.476617457Z Wrote inspect data to /must-gather/istio.
2026-09-11T06:28:10.478928165Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-11T06:28:10.680817404Z Wrote inspect data to /must-gather/istio.
2026-09-11T06:28:10.741110302Z Gathering data for ns/openshift-console...
2026-09-11T06:28:10.884831313Z Wrote inspect data to /must-gather/istio.
2026-09-11T06:28:10.888355696Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-11T06:28:11.061682298Z Wrote inspect data to /must-gather/istio.
2026-09-11T06:28:11.105258061Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:667babb345aeb39d2681913fd91a5c163d48d4ab8a3ba0d3156502181ea1177a
2026-09-11T06:28:11.244075647Z daemonset.apps/perf-node-gather-daemonset created
2026-09-11T06:28:11.264186261Z Wrote inspect data to /must-gather/istio.
2026-09-11T06:28:11.353617629Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-11T06:28:11.378121840Z Waiting for performance profile collector pods to become ready: 1
2026-09-11T06:28:11.861238907Z Gathering data for ns/openshift-dns-operator...
2026-09-11T06:28:11.990801523Z Done executing Istio gather script
2026-09-11T06:28:12.153659088Z Gathering data for ns/openshift-dns...
2026-09-11T06:28:12.472091153Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-09-11T06:28:12.487729498Z Waiting for performance profile collector pods to become ready: 2
2026-09-11T06:28:12.699771346Z Gathering data for ns/openshift-image-registry...
2026-09-11T06:28:13.126852990Z Gathering data for ns/openshift-ingress-operator...
2026-09-11T06:28:13.416862604Z Gathering data for ns/openshift-ingress...
2026-09-11T06:28:13.598913597Z Waiting for performance profile collector pods to become ready: 3
2026-09-11T06:28:13.727175225Z Gathering data for ns/openshift-ingress-canary...
2026-09-11T06:28:14.075858095Z Gathering data for ns/openshift-insights...
2026-09-11T06:28:14.712568602Z Waiting for performance profile collector pods to become ready: 4
2026-09-11T06:28:15.819628968Z Gathering data for ns/openshift-jobset-operator...
2026-09-11T06:28:15.823873086Z Waiting for performance profile collector pods to become ready: 5
2026-09-11T06:28:16.576822981Z Gathering data for ns/openshift-config...
2026-09-11T06:28:16.812796445Z Gathering data for ns/openshift-config-managed...
2026-09-11T06:28:16.943923041Z Waiting for performance profile collector pods to become ready: 6
2026-09-11T06:28:17.260238626Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-11T06:28:17.477885455Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-09-11T06:28:17.500515578Z Gathering data for ns/openshift-kube-apiserver...
2026-09-11T06:28:17.729796123Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-11T06:28:18.025207467Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-11T06:28:18.071702335Z Waiting for performance profile collector pods to become ready: 7
2026-09-11T06:28:18.283988060Z Gathering data for ns/openshift-kube-scheduler...
2026-09-11T06:28:18.558435119Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-11T06:28:18.817013552Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-11T06:28:19.116530809Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-11T06:28:19.207003682Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-11T06:28:19.431883398Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-11T06:28:19.454880498Z Collecting performance related data for node ip-10-0-132-32.ec2.internal
2026-09-11T06:28:19.462659558Z Collecting performance related data for node ip-10-0-139-145.ec2.internal
2026-09-11T06:28:19.473005919Z Collecting performance related data for node ip-10-0-139-247.ec2.internal
2026-09-11T06:28:19.975925862Z Gathering data for ns/openshift-multus...
2026-09-11T06:28:21.321259672Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-11T06:28:22.485187898Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-09-11T06:28:22.522978485Z Gathering data for ns/openshift-host-network...
2026-09-11T06:28:22.799382106Z Gathering data for ns/openshift-network-diagnostics...
2026-09-11T06:28:23.355245985Z Gathering data for ns/openshift-network-node-identity...
2026-09-11T06:28:23.741410338Z Gathering data for ns/openshift-network-operator...
2026-09-11T06:28:24.097692846Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-11T06:28:24.343453169Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-11T06:28:24.819025314Z Gathering data for ns/openshift-apiserver-operator...
2026-09-11T06:28:25.133556878Z Gathering data for ns/openshift-apiserver...
2026-09-11T06:28:25.499335932Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-11T06:28:25.797853207Z Gathering data for ns/openshift-controller-manager...
2026-09-11T06:28:26.041414255Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-11T06:28:26.668171123Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-11T06:28:26.944249027Z Gathering data for ns/openshift-service-ca-operator...
2026-09-11T06:28:27.255771115Z Gathering data for ns/openshift-service-ca...
2026-09-11T06:28:27.489782128Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-09-11T06:28:27.591426134Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-11T06:28:27.713764595Z Collecting kubelet logs for node ip-10-0-132-32.ec2.internal
2026-09-11T06:28:27.715716853Z Collecting kubelet logs for node ip-10-0-139-145.ec2.internal
2026-09-11T06:28:27.717515913Z Collecting kubelet logs for node ip-10-0-139-247.ec2.internal
2026-09-11T06:28:28.040102998Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-slvxw namespace
2026-09-11T06:28:28.044635768Z INFO: Node performance data collection complete.
2026-09-11T06:28:28.505894380Z Wrote inspect data to must-gather.
2026-09-11T06:28:28.505938799Z error: inspection completed with the errors occurred while gathering data:
2026-09-11T06:28:28.505938799Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-11T06:28:28.629957218Z error: the server doesn't have a resource type "clusters"
2026-09-11T06:28:28.759159163Z Caches written to disk