2026-09-07T11:41:18.558886855Z [disk usage checker] Started 2026-09-07T11:41:18.562214159Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-07T11:41:18.747903426Z Gathering data for ns/openshift-cluster-version... 2026-09-07T11:41:18.887719453Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-09-07T11:41:18.967919307Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-09-07T11:41:19.045591036Z Gathering data for ns/default... 2026-09-07T11:41:19.312066682Z Gathering data for ns/openshift... 2026-09-07T11:41:19.721898899Z Gathering data for ns/kube-system... 2026-09-07T11:41:20.349505436Z Gathering data for ns/openshift-etcd... 2026-09-07T11:41:20.624859819Z Wrote inspect data to must-gather. 2026-09-07T11:41:20.624890809Z error: inspection completed with the errors occurred while gathering data: 2026-09-07T11:41:20.624890809Z namespaces "assisted-installer" not found 2026-09-07T11:41:20.988206168Z Waiting on subprocesses to finish execution. 2026-09-07T11:41:20.995459590Z INFO: Gathering machine config daemon's old logs from all nodes 2026-09-07T11:41:20.999294739Z INFO: Collecting host service logs for crio 2026-09-07T11:41:20.999565985Z INFO: Collecting host service logs for kubelet 2026-09-07T11:41:20.999855196Z INFO: Collecting host service logs for rpm-ostreed 2026-09-07T11:41:21.000161514Z INFO: Collecting host service logs for ostree-finalize-staged 2026-09-07T11:41:21.000458712Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-09-07T11:41:21.000765358Z INFO: Collecting host service logs for machine-config-daemon-host 2026-09-07T11:41:21.001059979Z INFO: Collecting host service logs for NetworkManager 2026-09-07T11:41:21.001353848Z INFO: Collecting host service logs for openvswitch 2026-09-07T11:41:21.001653993Z INFO: Collecting host service logs for ovs-configuration 2026-09-07T11:41:21.001952646Z INFO: Collecting host service logs for ovsdb-server 2026-09-07T11:41:21.002245985Z INFO: Collecting host service logs for ovs-vswitchd 2026-09-07T11:41:21.002688259Z INFO: Waiting for worker host service log collection to complete ... 2026-09-07T11:41:21.007024489Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-09-07T11:41:21.008205493Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-09-07T11:41:21.022067049Z INFO: Gathering HAProxy config files 2026-09-07T11:41:21.034455360Z Executing Istio gather script 2026-09-07T11:41:21.255483378Z INFO: Waiting for node performance related collection to complete ... 2026-09-07T11:41:21.639808967Z No resources found in openshift-etcd namespace. 2026-09-07T11:41:21.950196257Z No resources found 2026-09-07T11:41:22.005612326Z Wrote inspect data to must-gather. 2026-09-07T11:41:22.057186092Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-09-07T11:41:22.093692620Z INFO: Found 1 replicas - prometheus-k8s-0 2026-09-07T11:41:22.163075894Z INFO: Collecting Insights Archives from insights-operator-76bcd6ccf5-dwmnm 2026-09-07T11:41:22.163126622Z insights-runtime-extractor-58pqw 2026-09-07T11:41:22.163163478Z insights-runtime-extractor-6jrlv 2026-09-07T11:41:22.163195557Z insights-runtime-extractor-zkccb 2026-09-07T11:41:22.230724463Z INFO: "sriov-network-operator" not detected. Skipping. 2026-09-07T11:41:22.377309581Z INFO: "metallb-operator" not detected. Skipping. 2026-09-07T11:41:22.383782386Z INFO: Worker host service log collection to complete. 2026-09-07T11:41:22.421121724Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-09-07T11:41:22.505020358Z error: the server doesn't have a resource type "performanceprofile" 2026-09-07T11:41:22.514268896Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-09-07T11:41:22.517660199Z INFO: on-disk MachineConfig config collection complete. 2026-09-07T11:41:22.570495085Z INFO: Waiting for HAProxy config collection to complete ... 2026-09-07T11:41:22.621409211Z ERROR: No running kube-apiserver pods found 2026-09-07T11:41:22.700006909Z Wrote inspect data to must-gather. 2026-09-07T11:41:22.864527135Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-09-07T11:41:22.864527135Z See 'oc rsync -h' for help and examples 2026-09-07T11:41:23.041237084Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-09-07T11:41:23.080853002Z No resources found 2026-09-07T11:41:23.115357796Z Wrote inspect data to must-gather. 2026-09-07T11:41:23.270240573Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-09-07T11:41:23.271683641Z Wrote inspect data to must-gather. 2026-09-07T11:41:23.311744008Z Wrote inspect data to must-gather. 2026-09-07T11:41:23.367501187Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection. 2026-09-07T11:41:23.384681663Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-09-07T11:41:23.484476217Z Gathering data for ns/openshift-monitoring... 2026-09-07T11:41:23.504073269Z Wrote inspect data to must-gather. 2026-09-07T11:41:23.504346601Z tar: Removing leading `/' from member names 2026-09-07T11:41:23.513084647Z INFO: HAProxy config collection complete. 2026-09-07T11:41:23.549655320Z Wrote inspect data to must-gather. 2026-09-07T11:41:23.558010068Z INFO: 'previous-logs' folder not found on ip-10-0-132-32.ec2.internal, skipping... 2026-09-07T11:41:23.569728906Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-07T11:41:23.571484591Z Wrote inspect data to must-gather. 2026-09-07T11:41:23.667345773Z INFO: Getting rules from prometheus-k8s-0 2026-09-07T11:41:23.724276113Z error: the server doesn't have a resource type "machineconfigs" 2026-09-07T11:41:23.812559915Z INFO: 'previous-logs' folder not found on ip-10-0-132-96.ec2.internal, skipping... 2026-09-07T11:41:23.824342697Z Wrote inspect data to must-gather. 2026-09-07T11:41:23.880309023Z error: the server doesn't have a resource type "machineconfigpools" 2026-09-07T11:41:24.080053846Z INFO: 'previous-logs' folder not found on ip-10-0-138-34.ec2.internal, skipping... 2026-09-07T11:41:24.080083316Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-09-07T11:41:24.080090656Z INFO: Machine Config Daemon termination log collection complete. 2026-09-07T11:41:24.093127151Z Wrote inspect data to must-gather. 2026-09-07T11:41:24.102708007Z INFO: Getting status/config from prometheus-k8s-0 2026-09-07T11:41:24.126582706Z Wrote inspect data to must-gather. 2026-09-07T11:41:24.272009321Z error: the server doesn't have a resource type "kubeletconfigs" 2026-09-07T11:41:24.355639181Z INFO: INTERCONNECT MODE 2026-09-07T11:41:24.355663945Z INFO: Gathering ovn-kubernetes DBs 2026-09-07T11:41:24.473428650Z Wrote inspect data to must-gather. 2026-09-07T11:41:24.480904504Z INFO: Getting status/flags from prometheus-k8s-0 2026-09-07T11:41:24.499852479Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io 2026-09-07T11:41:24.599589130Z INFO: Gathering OVN_Northbound from ovnkube-node-6ccbz... 2026-09-07T11:41:24.599807546Z INFO: Gathering OVN_Northbound from ovnkube-node-7rgwg... 2026-09-07T11:41:24.600008770Z INFO: Gathering OVN_Northbound from ovnkube-node-rlg9h... 2026-09-07T11:41:24.600289700Z INFO: Gathering OVN_Southbound from ovnkube-node-6ccbz... 2026-09-07T11:41:24.600539208Z INFO: Gathering OVN_Southbound from ovnkube-node-7rgwg... 2026-09-07T11:41:24.600782330Z INFO: Gathering OVN_Southbound from ovnkube-node-rlg9h... 2026-09-07T11:41:24.726295747Z Wrote inspect data to must-gather. 2026-09-07T11:41:24.729017557Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-09-07T11:41:24.734257839Z Wrote inspect data to /must-gather/istio. 2026-09-07T11:41:24.887606810Z tar: Removing leading `/' from member names 2026-09-07T11:41:24.899571816Z tar: Removing leading `/' from member names 2026-09-07T11:41:24.939978788Z tar: Removing leading `/' from member names 2026-09-07T11:41:24.950384576Z tar: Removing leading `/' from member names 2026-09-07T11:41:24.950937452Z tar: Removing leading `/' from member names 2026-09-07T11:41:24.982484795Z tar: Removing leading `/' from member names 2026-09-07T11:41:25.059051702Z Wrote inspect data to /must-gather/istio. 2026-09-07T11:41:25.062992883Z Inspecting resource crd/gateways.gateway.networking.k8s.io 2026-09-07T11:41:25.066152228Z Wrote inspect data to must-gather. 2026-09-07T11:41:25.081008015Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-09-07T11:41:25.097064650Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-09-07T11:41:25.288608138Z Wrote inspect data to /must-gather/istio. 2026-09-07T11:41:25.308120020Z Wrote inspect data to must-gather. 2026-09-07T11:41:25.343154143Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-09-07T11:41:25.418255444Z INFO: Waiting for network log collection to complete ... 2026-09-07T11:41:25.418299310Z INFO: Waiting for ovnk database copies to complete ... 2026-09-07T11:41:25.418809406Z INFO: Copying ovnk databases complete. 2026-09-07T11:41:25.420771911Z 3.6M must-gather/network_logs/ovnk_database_store 2026-09-07T11:41:25.423611093Z ovnk_database_store/ 2026-09-07T11:41:25.423611093Z ovnk_database_store/ovnkube-node-6ccbz_sbdb 2026-09-07T11:41:25.452963887Z ovnk_database_store/ovnkube-node-7rgwg_nbdb 2026-09-07T11:41:25.460067683Z ovnk_database_store/ovnkube-node-6ccbz_nbdb 2026-09-07T11:41:25.467788454Z ovnk_database_store/ovnkube-node-rlg9h_sbdb 2026-09-07T11:41:25.490449564Z ovnk_database_store/ovnkube-node-7rgwg_sbdb 2026-09-07T11:41:25.503808450Z Wrote inspect data to /must-gather/istio. 2026-09-07T11:41:25.506040783Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io 2026-09-07T11:41:25.507754982Z ovnk_database_store/ovnkube-node-rlg9h_nbdb 2026-09-07T11:41:25.517376799Z INFO: Network log collection complete. 2026-09-07T11:41:25.537253026Z Wrote inspect data to must-gather. 2026-09-07T11:41:25.709378126Z Wrote inspect data to /must-gather/istio. 2026-09-07T11:41:25.732133042Z INFO: Getting status from alertmanager-main-0 2026-09-07T11:41:25.735604299Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-09-07T11:41:25.826109150Z Wrote inspect data to must-gather. 2026-09-07T11:41:25.916652304Z Wrote inspect data to /must-gather/istio. 2026-09-07T11:41:25.919951059Z Inspecting resource crd/httproutes.gateway.networking.k8s.io 2026-09-07T11:41:25.934089928Z Gathering data for ns/openshift-network-console... 2026-09-07T11:41:26.089785985Z Wrote inspect data to must-gather. 2026-09-07T11:41:26.142707070Z Wrote inspect data to /must-gather/istio. 2026-09-07T11:41:26.337800172Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found 2026-09-07T11:41:26.341448202Z INFO: Fallback to identify the container image from release info 2026-09-07T11:41:26.354074173Z Wrote inspect data to /must-gather/istio. 2026-09-07T11:41:26.356025908Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io 2026-09-07T11:41:26.431462897Z Gathering data for ns/openshift-console-operator... 2026-09-07T11:41:26.525908449Z Wrote inspect data to /must-gather/istio. 2026-09-07T11:41:26.696000938Z Wrote inspect data to /must-gather/istio. 2026-09-07T11:41:26.793365494Z Gathering data for ns/openshift-console... 2026-09-07T11:41:27.123632890Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f39c1daa89e19c5e987a3b759e646ffab6c1b2ab94a97ded81ddf13e73d0399 2026-09-07T11:41:27.247874756Z daemonset.apps/perf-node-gather-daemonset created 2026-09-07T11:41:27.287209970Z Gathering data for ns/openshift-cluster-storage-operator... 2026-09-07T11:41:27.352047763Z Done executing Istio gather script 2026-09-07T11:41:27.373797422Z Waiting for performance profile collector pods to become ready: 1 2026-09-07T11:41:27.766743461Z Gathering data for ns/openshift-dns-operator... 2026-09-07T11:41:28.037981802Z Gathering data for ns/openshift-dns... 2026-09-07T11:41:28.492543594Z Waiting for performance profile collector pods to become ready: 2 2026-09-07T11:41:28.571066191Z Gathering data for ns/openshift-image-registry... 2026-09-07T11:41:28.574684281Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-07T11:41:28.977039108Z Gathering data for ns/openshift-ingress-operator... 2026-09-07T11:41:29.259068610Z Gathering data for ns/openshift-ingress... 2026-09-07T11:41:29.542100067Z Gathering data for ns/openshift-ingress-canary... 2026-09-07T11:41:29.596167873Z Waiting for performance profile collector pods to become ready: 3 2026-09-07T11:41:29.883798410Z Gathering data for ns/openshift-insights... 2026-09-07T11:41:30.714037733Z Waiting for performance profile collector pods to become ready: 4 2026-09-07T11:41:31.786236364Z Gathering data for ns/openshift-config... 2026-09-07T11:41:31.818996000Z Waiting for performance profile collector pods to become ready: 5 2026-09-07T11:41:32.074336405Z Gathering data for ns/openshift-config-managed... 2026-09-07T11:41:32.520226703Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-09-07T11:41:32.754431085Z Gathering data for ns/openshift-kube-apiserver... 2026-09-07T11:41:32.926674423Z Waiting for performance profile collector pods to become ready: 6 2026-09-07T11:41:32.995050828Z Gathering data for ns/openshift-kube-controller-manager... 2026-09-07T11:41:33.329400415Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-09-07T11:41:33.579381075Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-07T11:41:33.581604081Z Gathering data for ns/openshift-kube-scheduler... 2026-09-07T11:41:33.813089223Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-09-07T11:41:34.045017643Z Waiting for performance profile collector pods to become ready: 7 2026-09-07T11:41:34.082018696Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-09-07T11:41:34.366582485Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-09-07T11:41:34.637744016Z Gathering data for ns/openshift-user-workload-monitoring... 2026-09-07T11:41:35.167988497Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-09-07T11:41:35.244182881Z Gathering data for ns/openshift-multus... 2026-09-07T11:41:35.374017258Z Collecting performance related data for node ip-10-0-132-96.ec2.internal 2026-09-07T11:41:35.380646839Z Collecting performance related data for node ip-10-0-132-32.ec2.internal 2026-09-07T11:41:35.386851217Z Collecting performance related data for node ip-10-0-138-34.ec2.internal 2026-09-07T11:41:36.734528544Z Gathering data for ns/openshift-ovn-kubernetes... 2026-09-07T11:41:37.918961601Z Gathering data for ns/openshift-host-network... 2026-09-07T11:41:38.212924192Z Gathering data for ns/openshift-network-diagnostics... 2026-09-07T11:41:38.584492029Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-07T11:41:38.685384502Z Gathering data for ns/openshift-network-node-identity... 2026-09-07T11:41:39.078690343Z Gathering data for ns/openshift-network-operator... 2026-09-07T11:41:39.424518530Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-09-07T11:41:39.671516702Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-09-07T11:41:40.127407264Z Gathering data for ns/openshift-apiserver-operator... 2026-09-07T11:41:40.444626701Z Gathering data for ns/openshift-apiserver... 2026-09-07T11:41:40.848884581Z Gathering data for ns/openshift-controller-manager-operator... 2026-09-07T11:41:41.085539793Z Gathering data for ns/openshift-controller-manager... 2026-09-07T11:41:41.340185710Z Gathering data for ns/openshift-cluster-samples-operator... 2026-09-07T11:41:41.949438181Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-09-07T11:41:42.233311822Z Gathering data for ns/openshift-service-ca-operator... 2026-09-07T11:41:42.508296413Z Gathering data for ns/openshift-service-ca... 2026-09-07T11:41:42.872658470Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-09-07T11:41:42.926931471Z Collecting kubelet logs for node ip-10-0-132-96.ec2.internal 2026-09-07T11:41:42.928578130Z Collecting kubelet logs for node ip-10-0-132-32.ec2.internal 2026-09-07T11:41:42.930566698Z Collecting kubelet logs for node ip-10-0-138-34.ec2.internal 2026-09-07T11:41:43.275082489Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-zzq24 namespace 2026-09-07T11:41:43.282140466Z INFO: Node performance data collection complete. 2026-09-07T11:41:43.589181879Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-07T11:41:43.739688022Z Wrote inspect data to must-gather. 2026-09-07T11:41:43.739727834Z error: inspection completed with the errors occurred while gathering data: 2026-09-07T11:41:43.739727834Z skipping gathering secrets/support due to error: secrets "support" not found 2026-09-07T11:41:43.852666823Z error: the server doesn't have a resource type "clusters" 2026-09-07T11:41:43.977290900Z Caches written to disk