2026-09-09T12:34:48.489765572Z [disk usage checker] Started
2026-09-09T12:34:48.493456294Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-09T12:34:48.686259166Z Gathering data for ns/openshift-cluster-version...
2026-09-09T12:34:48.809725222Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-09T12:34:48.889902757Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-09T12:34:48.969136285Z Gathering data for ns/default...
2026-09-09T12:34:49.243962167Z Gathering data for ns/openshift...
2026-09-09T12:34:49.625686618Z Gathering data for ns/kube-system...
2026-09-09T12:34:50.287814911Z Gathering data for ns/openshift-etcd...
2026-09-09T12:34:50.560799719Z Wrote inspect data to must-gather.
2026-09-09T12:34:50.560868970Z error: inspection completed with the errors occurred while gathering data:
2026-09-09T12:34:50.560868970Z     namespaces "assisted-installer" not found
2026-09-09T12:34:50.957934597Z Waiting on subprocesses to finish execution.
2026-09-09T12:34:50.963916095Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-09T12:34:50.968979089Z INFO: Gathering HAProxy config files
2026-09-09T12:34:50.974254377Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-09T12:34:50.976646157Z Executing Istio gather script
2026-09-09T12:34:50.976788535Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-09T12:34:50.978283093Z INFO: Collecting host service logs for crio
2026-09-09T12:34:50.978540805Z INFO: Collecting host service logs for kubelet
2026-09-09T12:34:50.978804596Z INFO: Collecting host service logs for rpm-ostreed
2026-09-09T12:34:50.979108917Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-09T12:34:50.979397534Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-09T12:34:50.979689740Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-09T12:34:50.980009758Z INFO: Collecting host service logs for NetworkManager
2026-09-09T12:34:50.980290044Z INFO: Collecting host service logs for openvswitch
2026-09-09T12:34:50.980580539Z INFO: Collecting host service logs for ovs-configuration
2026-09-09T12:34:50.980903997Z INFO: Collecting host service logs for ovsdb-server
2026-09-09T12:34:50.981197907Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-09T12:34:50.981533413Z INFO: Waiting for worker host service log collection to complete ...
2026-09-09T12:34:51.022446675Z INFO: Waiting for node performance related collection to complete ...
2026-09-09T12:34:51.340025201Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-09T12:34:51.460037921Z INFO: "metallb-operator" not detected. Skipping.
2026-09-09T12:34:51.571620662Z INFO: Collecting Insights Archives from insights-operator-76bcd6ccf5-bvckc
2026-09-09T12:34:51.571708241Z insights-runtime-extractor-bxs84
2026-09-09T12:34:51.571733052Z insights-runtime-extractor-gf2mr
2026-09-09T12:34:51.571752024Z insights-runtime-extractor-w4dk7
2026-09-09T12:34:51.957350028Z No resources found
2026-09-09T12:34:51.964325347Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-09T12:34:51.998599663Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-09T12:34:52.036810826Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-09T12:34:52.036880289Z INFO: on-disk MachineConfig config collection complete.
2026-09-09T12:34:52.099805609Z Wrote inspect data to must-gather.
2026-09-09T12:34:52.186490501Z error: the server doesn't have a resource type "performanceprofile"
2026-09-09T12:34:52.217247693Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-09T12:34:52.334379903Z No resources found in openshift-etcd namespace.
2026-09-09T12:34:52.620978689Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-09T12:34:52.620978689Z See 'oc rsync -h' for help and examples
2026-09-09T12:34:52.676673967Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-09T12:34:52.726369843Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-09T12:34:52.796151228Z ERROR: No running kube-apiserver pods found
2026-09-09T12:34:52.836412745Z Wrote inspect data to must-gather.
2026-09-09T12:34:53.115789937Z Wrote inspect data to must-gather.
2026-09-09T12:34:53.132629703Z Wrote inspect data to must-gather.
2026-09-09T12:34:53.138943727Z Wrote inspect data to must-gather.
2026-09-09T12:34:53.157254879Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-09T12:34:53.163435483Z INFO: Worker host service log collection to complete.
2026-09-09T12:34:53.345275148Z No resources found
2026-09-09T12:34:53.352746136Z Wrote inspect data to must-gather.
2026-09-09T12:34:53.356128898Z Wrote inspect data to must-gather.
2026-09-09T12:34:53.358625538Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-09T12:34:53.417740083Z Gathering data for ns/openshift-monitoring...
2026-09-09T12:34:53.466379202Z INFO: 'previous-logs' folder not found on ip-10-0-130-55.ec2.internal, skipping...
2026-09-09T12:34:53.467251727Z error: the server doesn't have a resource type "machineconfigs"
2026-09-09T12:34:53.502069426Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-09T12:34:53.567037682Z tar: Removing leading `/' from member names
2026-09-09T12:34:53.575195479Z INFO: HAProxy config collection complete.
2026-09-09T12:34:53.669792076Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-09T12:34:53.676236507Z Wrote inspect data to must-gather.
2026-09-09T12:34:53.690585140Z INFO: Getting rules from prometheus-k8s-0
2026-09-09T12:34:53.767435224Z INFO: 'previous-logs' folder not found on ip-10-0-140-191.ec2.internal, skipping...
2026-09-09T12:34:53.810530216Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-09T12:34:53.908581129Z Wrote inspect data to must-gather.
2026-09-09T12:34:53.937157787Z Wrote inspect data to must-gather.
2026-09-09T12:34:54.029586276Z INFO: 'previous-logs' folder not found on ip-10-0-143-179.ec2.internal, skipping...
2026-09-09T12:34:54.029757244Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-09T12:34:54.029757244Z INFO: Machine Config Daemon termination log collection complete.
2026-09-09T12:34:54.059139034Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-09T12:34:54.160626579Z INFO: Getting status/config from prometheus-k8s-0
2026-09-09T12:34:54.177690711Z Wrote inspect data to must-gather.
2026-09-09T12:34:54.274291355Z Wrote inspect data to must-gather.
2026-09-09T12:34:54.456244881Z INFO: INTERCONNECT MODE
2026-09-09T12:34:54.456279531Z INFO: Gathering ovn-kubernetes DBs
2026-09-09T12:34:54.478593256Z Wrote inspect data to must-gather.
2026-09-09T12:34:54.581752939Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-09T12:34:54.588523970Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-09T12:34:54.613680772Z INFO: Gathering OVN_Northbound from ovnkube-node-4wxbl...
2026-09-09T12:34:54.613969899Z INFO: Gathering OVN_Northbound from ovnkube-node-cbcmf...
2026-09-09T12:34:54.614213825Z INFO: Gathering OVN_Northbound from ovnkube-node-pjfct...
2026-09-09T12:34:54.614484075Z INFO: Gathering OVN_Southbound from ovnkube-node-4wxbl...
2026-09-09T12:34:54.614758468Z INFO: Gathering OVN_Southbound from ovnkube-node-cbcmf...
2026-09-09T12:34:54.615068741Z INFO: Gathering OVN_Southbound from ovnkube-node-pjfct...
2026-09-09T12:34:54.740382697Z Wrote inspect data to must-gather.
2026-09-09T12:34:54.887918244Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-09T12:34:54.910901199Z Wrote inspect data to /must-gather/istio.
2026-09-09T12:34:54.936365142Z tar: Removing leading `/' from member names
2026-09-09T12:34:54.954076538Z tar: Removing leading `/' from member names
2026-09-09T12:34:54.958165720Z tar: Removing leading `/' from member names
2026-09-09T12:34:54.984073735Z tar: Removing leading `/' from member names
2026-09-09T12:34:55.009845849Z tar: Removing leading `/' from member names
2026-09-09T12:34:55.021941566Z tar: Removing leading `/' from member names
2026-09-09T12:34:55.080506575Z Wrote inspect data to must-gather.
2026-09-09T12:34:55.162880439Z Wrote inspect data to /must-gather/istio.
2026-09-09T12:34:55.166035183Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-09T12:34:55.172823066Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-09T12:34:55.307393541Z Wrote inspect data to must-gather.
2026-09-09T12:34:55.389839001Z Wrote inspect data to /must-gather/istio.
2026-09-09T12:34:55.427618301Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-09T12:34:55.436719169Z INFO: Waiting for network log collection to complete ...
2026-09-09T12:34:55.436841409Z INFO: Waiting for ovnk database copies to complete ...
2026-09-09T12:34:55.437371128Z INFO: Copying ovnk databases complete.
2026-09-09T12:34:55.440950973Z 3.4M	must-gather/network_logs/ovnk_database_store
2026-09-09T12:34:55.447024636Z ovnk_database_store/
2026-09-09T12:34:55.447076551Z ovnk_database_store/ovnkube-node-cbcmf_sbdb
2026-09-09T12:34:55.471526557Z ovnk_database_store/ovnkube-node-4wxbl_nbdb
2026-09-09T12:34:55.481168526Z ovnk_database_store/ovnkube-node-4wxbl_sbdb
2026-09-09T12:34:55.507557339Z ovnk_database_store/ovnkube-node-cbcmf_nbdb
2026-09-09T12:34:55.515958007Z ovnk_database_store/ovnkube-node-pjfct_sbdb
2026-09-09T12:34:55.536512295Z ovnk_database_store/ovnkube-node-pjfct_nbdb
2026-09-09T12:34:55.548321565Z INFO: Network log collection complete.
2026-09-09T12:34:55.551939489Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-09T12:34:55.555798712Z Wrote inspect data to must-gather.
2026-09-09T12:34:55.623003444Z Wrote inspect data to /must-gather/istio.
2026-09-09T12:34:55.625558972Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-09T12:34:55.768554885Z Wrote inspect data to must-gather.
2026-09-09T12:34:55.802233077Z INFO: Getting status from alertmanager-main-0
2026-09-09T12:34:55.821797272Z Wrote inspect data to /must-gather/istio.
2026-09-09T12:34:56.025682660Z Wrote inspect data to /must-gather/istio.
2026-09-09T12:34:56.027945105Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-09T12:34:56.036613090Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-09T12:34:56.038869801Z INFO: Fallback to identify the container image from release info
2026-09-09T12:34:56.170402352Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-09T12:34:56.239901995Z Wrote inspect data to /must-gather/istio.
2026-09-09T12:34:56.335470198Z Gathering data for ns/openshift-network-console...
2026-09-09T12:34:56.423328475Z Wrote inspect data to /must-gather/istio.
2026-09-09T12:34:56.426465173Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-09T12:34:56.560867658Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f39c1daa89e19c5e987a3b759e646ffab6c1b2ab94a97ded81ddf13e73d0399
2026-09-09T12:34:56.584247337Z Wrote inspect data to /must-gather/istio.
2026-09-09T12:34:56.691824463Z daemonset.apps/perf-node-gather-daemonset created
2026-09-09T12:34:56.777940645Z Gathering data for ns/openshift-console-operator...
2026-09-09T12:34:56.794269582Z Wrote inspect data to /must-gather/istio.
2026-09-09T12:34:56.821551766Z Waiting for performance profile collector pods to become ready: 1
2026-09-09T12:34:57.168864328Z Gathering data for ns/openshift-console...
2026-09-09T12:34:57.436114635Z Done executing Istio gather script
2026-09-09T12:34:57.643415789Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-09T12:34:57.942526286Z Waiting for performance profile collector pods to become ready: 2
2026-09-09T12:34:58.099556430Z Gathering data for ns/openshift-dns-operator...
2026-09-09T12:34:58.375835941Z Gathering data for ns/openshift-dns...
2026-09-09T12:34:58.508209677Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-09T12:34:58.951405291Z Gathering data for ns/openshift-image-registry...
2026-09-09T12:34:59.052735750Z Waiting for performance profile collector pods to become ready: 3
2026-09-09T12:34:59.440913980Z Gathering data for ns/openshift-ingress-operator...
2026-09-09T12:34:59.742863391Z Gathering data for ns/openshift-ingress...
2026-09-09T12:35:00.170208376Z Waiting for performance profile collector pods to become ready: 4
2026-09-09T12:35:00.174689035Z Gathering data for ns/openshift-ingress-canary...
2026-09-09T12:35:00.539077344Z Gathering data for ns/openshift-insights...
2026-09-09T12:35:01.272835615Z Waiting for performance profile collector pods to become ready: 5
2026-09-09T12:35:02.372834771Z Waiting for performance profile collector pods to become ready: 6
2026-09-09T12:35:02.509312030Z Gathering data for ns/openshift-config...
2026-09-09T12:35:02.762955649Z Gathering data for ns/openshift-config-managed...
2026-09-09T12:35:03.172527415Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-09T12:35:03.478330419Z Gathering data for ns/openshift-kube-apiserver...
2026-09-09T12:35:03.490541801Z Waiting for performance profile collector pods to become ready: 7
2026-09-09T12:35:03.514259967Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-09T12:35:03.726153231Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-09T12:35:04.017725587Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-09T12:35:04.333598234Z Gathering data for ns/openshift-kube-scheduler...
2026-09-09T12:35:04.613866238Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-09T12:35:04.616836324Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-09T12:35:04.861663580Z Collecting performance related data for node ip-10-0-130-55.ec2.internal
2026-09-09T12:35:04.870145575Z Collecting performance related data for node ip-10-0-140-191.ec2.internal
2026-09-09T12:35:04.878180191Z Collecting performance related data for node ip-10-0-143-179.ec2.internal
2026-09-09T12:35:04.948932172Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-09T12:35:05.361018107Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-09T12:35:05.741622672Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-09T12:35:06.324758423Z Gathering data for ns/openshift-multus...
2026-09-09T12:35:07.820519767Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-09T12:35:08.521076123Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-09T12:35:09.088595887Z Gathering data for ns/openshift-host-network...
2026-09-09T12:35:09.448165287Z Gathering data for ns/openshift-network-diagnostics...
2026-09-09T12:35:10.049659649Z Gathering data for ns/openshift-network-node-identity...
2026-09-09T12:35:10.540131114Z Gathering data for ns/openshift-network-operator...
2026-09-09T12:35:10.940616558Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-09T12:35:11.228982659Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-09T12:35:11.736845393Z Gathering data for ns/openshift-apiserver-operator...
2026-09-09T12:35:12.083170667Z Gathering data for ns/openshift-apiserver...
2026-09-09T12:35:12.464728378Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-09T12:35:12.516986941Z Collecting kubelet logs for node ip-10-0-130-55.ec2.internal
2026-09-09T12:35:12.519830053Z Collecting kubelet logs for node ip-10-0-140-191.ec2.internal
2026-09-09T12:35:12.521846235Z Collecting kubelet logs for node ip-10-0-143-179.ec2.internal
2026-09-09T12:35:12.750129365Z Gathering data for ns/openshift-controller-manager...
2026-09-09T12:35:12.873452726Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-5dqgk namespace
2026-09-09T12:35:12.878480975Z INFO: Node performance data collection complete.
2026-09-09T12:35:13.030866522Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-09T12:35:13.527496072Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-09T12:35:13.671807240Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-09T12:35:13.998137869Z Gathering data for ns/openshift-service-ca-operator...
2026-09-09T12:35:14.301719665Z Gathering data for ns/openshift-service-ca...
2026-09-09T12:35:14.650720918Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-09T12:35:15.505492854Z Wrote inspect data to must-gather.
2026-09-09T12:35:15.505533108Z error: inspection completed with the errors occurred while gathering data:
2026-09-09T12:35:15.505533108Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-09T12:35:15.627549413Z error: the server doesn't have a resource type "clusters"
2026-09-09T12:35:15.757666140Z Caches written to disk