2026-06-14T06:48:01.097756326Z [disk usage checker] Started 2026-06-14T06:48:01.101064441Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-06-14T06:48:01.294981656Z Gathering data for ns/openshift-cluster-version... 2026-06-14T06:48:01.439830605Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-06-14T06:48:01.521021723Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-06-14T06:48:01.599533376Z Gathering data for ns/default... 2026-06-14T06:48:01.868429860Z Gathering data for ns/openshift... 2026-06-14T06:48:02.227045582Z Gathering data for ns/kube-system... 2026-06-14T06:48:02.872869274Z Gathering data for ns/openshift-etcd... 2026-06-14T06:48:03.155667693Z Wrote inspect data to must-gather. 2026-06-14T06:48:03.155702536Z error: inspection completed with the errors occurred while gathering data: 2026-06-14T06:48:03.155702536Z namespaces "assisted-installer" not found 2026-06-14T06:48:03.589607127Z Waiting on subprocesses to finish execution. 2026-06-14T06:48:03.597022776Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-06-14T06:48:03.598459656Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-06-14T06:48:03.600096383Z INFO: Collecting host service logs for crio 2026-06-14T06:48:03.600409485Z INFO: Collecting host service logs for kubelet 2026-06-14T06:48:03.600771710Z INFO: Collecting host service logs for rpm-ostreed 2026-06-14T06:48:03.600882797Z Executing Istio gather script 2026-06-14T06:48:03.601130588Z INFO: Collecting host service logs for ostree-finalize-staged 2026-06-14T06:48:03.601422946Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-06-14T06:48:03.601744607Z INFO: Collecting host service logs for machine-config-daemon-host 2026-06-14T06:48:03.602096651Z INFO: Collecting host service logs for NetworkManager 2026-06-14T06:48:03.602542885Z INFO: Collecting host service logs for openvswitch 2026-06-14T06:48:03.602863029Z INFO: Collecting host service logs for ovs-configuration 2026-06-14T06:48:03.603174193Z INFO: Collecting host service logs for ovsdb-server 2026-06-14T06:48:03.603574150Z INFO: Collecting host service logs for ovs-vswitchd 2026-06-14T06:48:03.603843354Z INFO: Waiting for worker host service log collection to complete ... 2026-06-14T06:48:03.604084963Z INFO: Gathering machine config daemon's old logs from all nodes 2026-06-14T06:48:03.621760936Z INFO: Gathering HAProxy config files 2026-06-14T06:48:03.636045604Z INFO: Waiting for node performance related collection to complete ... 2026-06-14T06:48:04.168744620Z INFO: Found 1 replicas - prometheus-k8s-0 2026-06-14T06:48:04.247916697Z No resources found in openshift-etcd namespace. 2026-06-14T06:48:04.280114577Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-06-14T06:48:04.323376854Z Wrote inspect data to must-gather. 2026-06-14T06:48:04.435290006Z No resources found 2026-06-14T06:48:04.460342964Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-06-14T06:48:04.460422284Z INFO: on-disk MachineConfig config collection complete. 2026-06-14T06:48:04.531346086Z INFO: "sriov-network-operator" not detected. Skipping. 2026-06-14T06:48:04.833580758Z INFO: Collecting Insights Archives from insights-operator-5bbd86d6bd-6cm85 2026-06-14T06:48:04.833640312Z insights-runtime-extractor-cxlkm 2026-06-14T06:48:04.833661608Z insights-runtime-extractor-l5jcr 2026-06-14T06:48:04.833695057Z insights-runtime-extractor-qllhx 2026-06-14T06:48:04.917935229Z INFO: Worker host service log collection to complete. 2026-06-14T06:48:04.953847431Z error: the server doesn't have a resource type "performanceprofile" 2026-06-14T06:48:05.158972589Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-06-14T06:48:05.195126283Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-06-14T06:48:05.263105193Z Wrote inspect data to must-gather. 2026-06-14T06:48:05.330311759Z INFO: "metallb-operator" not detected. Skipping. 2026-06-14T06:48:05.633917885Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-06-14T06:48:05.708937412Z Wrote inspect data to must-gather. 2026-06-14T06:48:05.731835695Z No resources found 2026-06-14T06:48:05.750792533Z INFO: Waiting for HAProxy config collection to complete ... 2026-06-14T06:48:05.794327322Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-06-14T06:48:05.794327322Z See 'oc rsync -h' for help and examples 2026-06-14T06:48:05.870308608Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-06-14T06:48:05.926511714Z Wrote inspect data to must-gather. 2026-06-14T06:48:05.934495374Z Wrote inspect data to must-gather. 2026-06-14T06:48:05.948645248Z ERROR: No running kube-apiserver pods found 2026-06-14T06:48:05.966192929Z Gathering data for ns/openshift-monitoring... 2026-06-14T06:48:06.036223363Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection. 2026-06-14T06:48:06.043241798Z Wrote inspect data to must-gather. 2026-06-14T06:48:06.111347823Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-06-14T06:48:06.115827334Z Wrote inspect data to must-gather. 2026-06-14T06:48:06.143494868Z INFO: 'previous-logs' folder not found on ip-10-0-129-149.ec2.internal, skipping... 2026-06-14T06:48:06.178497472Z INFO: Getting rules from prometheus-k8s-0 2026-06-14T06:48:06.194610004Z tar: Removing leading `/' from member names 2026-06-14T06:48:06.201968217Z INFO: HAProxy config collection complete. 2026-06-14T06:48:06.235959632Z error: the server doesn't have a resource type "machineconfigs" 2026-06-14T06:48:06.382451125Z Wrote inspect data to must-gather. 2026-06-14T06:48:06.416663004Z error: the server doesn't have a resource type "machineconfigpools" 2026-06-14T06:48:06.422532379Z INFO: 'previous-logs' folder not found on ip-10-0-131-123.ec2.internal, skipping... 2026-06-14T06:48:06.611184279Z INFO: Getting status/config from prometheus-k8s-0 2026-06-14T06:48:06.671272163Z Wrote inspect data to must-gather. 2026-06-14T06:48:06.673821665Z Wrote inspect data to must-gather. 2026-06-14T06:48:06.685906703Z INFO: 'previous-logs' folder not found on ip-10-0-140-113.ec2.internal, skipping... 2026-06-14T06:48:06.685936343Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-06-14T06:48:06.685947189Z INFO: Machine Config Daemon termination log collection complete. 2026-06-14T06:48:06.832244403Z error: the server doesn't have a resource type "kubeletconfigs" 2026-06-14T06:48:06.925144543Z Wrote inspect data to must-gather. 2026-06-14T06:48:06.988348633Z INFO: Getting status/flags from prometheus-k8s-0 2026-06-14T06:48:07.049194517Z Wrote inspect data to must-gather. 2026-06-14T06:48:07.116930210Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io 2026-06-14T06:48:07.204877715Z INFO: INTERCONNECT MODE 2026-06-14T06:48:07.204923006Z INFO: Gathering ovn-kubernetes DBs 2026-06-14T06:48:07.221979467Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-06-14T06:48:07.253484669Z Wrote inspect data to must-gather. 2026-06-14T06:48:07.300210354Z Wrote inspect data to /must-gather/istio. 2026-06-14T06:48:07.399242216Z INFO: Gathering OVN_Northbound from ovnkube-node-7fqst... 2026-06-14T06:48:07.399473665Z INFO: Gathering OVN_Northbound from ovnkube-node-g47ds... 2026-06-14T06:48:07.399730447Z INFO: Gathering OVN_Northbound from ovnkube-node-vbmxk... 2026-06-14T06:48:07.400174273Z INFO: Gathering OVN_Southbound from ovnkube-node-7fqst... 2026-06-14T06:48:07.400442871Z INFO: Gathering OVN_Southbound from ovnkube-node-g47ds... 2026-06-14T06:48:07.400751116Z INFO: Gathering OVN_Southbound from ovnkube-node-vbmxk... 2026-06-14T06:48:07.491913019Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-06-14T06:48:07.495827399Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-06-14T06:48:07.528622038Z Wrote inspect data to must-gather. 2026-06-14T06:48:07.622550880Z Wrote inspect data to /must-gather/istio. 2026-06-14T06:48:07.626556909Z Inspecting resource crd/gateways.gateway.networking.k8s.io 2026-06-14T06:48:07.695217606Z tar: Removing leading `/' from member names 2026-06-14T06:48:07.718235644Z tar: Removing leading `/' from member names 2026-06-14T06:48:07.741448741Z tar: Removing leading `/' from member names 2026-06-14T06:48:07.751473736Z tar: Removing leading `/' from member names 2026-06-14T06:48:07.751630625Z tar: Removing leading `/' from member names 2026-06-14T06:48:07.753307199Z tar: Removing leading `/' from member names 2026-06-14T06:48:07.876683815Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-06-14T06:48:07.885497423Z Wrote inspect data to /must-gather/istio. 2026-06-14T06:48:07.892953113Z Wrote inspect data to must-gather. 2026-06-14T06:48:08.117099692Z Wrote inspect data to /must-gather/istio. 2026-06-14T06:48:08.120581320Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io 2026-06-14T06:48:08.125052197Z W0614 06:48:08.125015 1490 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' 2026-06-14T06:48:08.129882927Z Wrote inspect data to must-gather. 2026-06-14T06:48:08.268185331Z INFO: Waiting for network log collection to complete ... 2026-06-14T06:48:08.268255453Z INFO: Waiting for ovnk database copies to complete ... 2026-06-14T06:48:08.268598667Z INFO: Copying ovnk databases complete. 2026-06-14T06:48:08.270205293Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-06-14T06:48:08.271508614Z 2.6M must-gather/network_logs/ovnk_database_store 2026-06-14T06:48:08.274734136Z ovnk_database_store/ 2026-06-14T06:48:08.274734136Z ovnk_database_store/ovnkube-node-7fqst_nbdb 2026-06-14T06:48:08.284482871Z ovnk_database_store/ovnkube-node-7fqst_sbdb 2026-06-14T06:48:08.294991017Z INFO: Getting status from alertmanager-main-0 2026-06-14T06:48:08.301949634Z ovnk_database_store/ovnkube-node-vbmxk_nbdb 2026-06-14T06:48:08.310312280Z ovnk_database_store/ovnkube-node-g47ds_sbdb 2026-06-14T06:48:08.330466146Z ovnk_database_store/ovnkube-node-vbmxk_sbdb 2026-06-14T06:48:08.348009078Z ovnk_database_store/ovnkube-node-g47ds_nbdb 2026-06-14T06:48:08.351051300Z Wrote inspect data to /must-gather/istio. 2026-06-14T06:48:08.359272986Z INFO: Network log collection complete. 2026-06-14T06:48:08.469573877Z Wrote inspect data to must-gather. 2026-06-14T06:48:08.471007343Z Gathering data for ns/openshift-network-console... 2026-06-14T06:48:08.570967683Z Wrote inspect data to /must-gather/istio. 2026-06-14T06:48:08.574281215Z Inspecting resource crd/httproutes.gateway.networking.k8s.io 2026-06-14T06:48:08.759739103Z Wrote inspect data to must-gather. 2026-06-14T06:48:08.788093984Z Wrote inspect data to /must-gather/istio. 2026-06-14T06:48:08.899988613Z Gathering data for ns/openshift-console-operator... 2026-06-14T06:48:08.987517094Z Wrote inspect data to /must-gather/istio. 2026-06-14T06:48:08.990511559Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io 2026-06-14T06:48:09.025233843Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found 2026-06-14T06:48:09.027274525Z INFO: Fallback to identify the container image from release info 2026-06-14T06:48:09.154497075Z Wrote inspect data to /must-gather/istio. 2026-06-14T06:48:09.288667851Z Gathering data for ns/openshift-console... 2026-06-14T06:48:09.328777529Z Wrote inspect data to /must-gather/istio. 2026-06-14T06:48:09.516022830Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d66a6b2ec52dede5d83ce04f6abfc519df1fd7dc36248741e03ecb9bf8d1762 2026-06-14T06:48:09.643323107Z daemonset.apps/perf-node-gather-daemonset created 2026-06-14T06:48:09.774167338Z Waiting for performance profile collector pods to become ready: 1 2026-06-14T06:48:09.831332970Z Gathering data for ns/openshift-cluster-storage-operator... 2026-06-14T06:48:09.988406565Z Done executing Istio gather script 2026-06-14T06:48:10.312454406Z Gathering data for ns/openshift-dns-operator... 2026-06-14T06:48:10.563044098Z Gathering data for ns/openshift-dns... 2026-06-14T06:48:10.890938967Z Waiting for performance profile collector pods to become ready: 2 2026-06-14T06:48:11.117075284Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-06-14T06:48:11.122989237Z Gathering data for ns/openshift-image-registry... 2026-06-14T06:48:11.545101900Z Gathering data for ns/openshift-ingress-operator... 2026-06-14T06:48:11.841816697Z Gathering data for ns/openshift-ingress... 2026-06-14T06:48:12.001540989Z Waiting for performance profile collector pods to become ready: 3 2026-06-14T06:48:12.152021737Z Gathering data for ns/openshift-ingress-canary... 2026-06-14T06:48:12.508916288Z Gathering data for ns/openshift-insights... 2026-06-14T06:48:13.117881891Z Waiting for performance profile collector pods to become ready: 4 2026-06-14T06:48:14.226058774Z Waiting for performance profile collector pods to become ready: 5 2026-06-14T06:48:14.279290231Z Gathering data for ns/openshift-config... 2026-06-14T06:48:14.520913741Z Gathering data for ns/openshift-config-managed... 2026-06-14T06:48:14.889865519Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-06-14T06:48:15.127897277Z Gathering data for ns/openshift-kube-apiserver... 2026-06-14T06:48:15.346294195Z Waiting for performance profile collector pods to become ready: 6 2026-06-14T06:48:15.387360907Z Gathering data for ns/openshift-kube-controller-manager... 2026-06-14T06:48:15.646422021Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-06-14T06:48:15.935931369Z Gathering data for ns/openshift-kube-scheduler... 2026-06-14T06:48:16.122230606Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-06-14T06:48:16.177399122Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-06-14T06:48:16.447148246Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-06-14T06:48:16.468031489Z Waiting for performance profile collector pods to become ready: 7 2026-06-14T06:48:16.754918235Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-06-14T06:48:17.039497526Z Gathering data for ns/openshift-user-workload-monitoring... 2026-06-14T06:48:17.477214884Z Gathering data for ns/openshift-multus... 2026-06-14T06:48:17.569789716Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-06-14T06:48:17.777625880Z Collecting performance related data for node ip-10-0-140-113.ec2.internal 2026-06-14T06:48:17.784766724Z Collecting performance related data for node ip-10-0-131-123.ec2.internal 2026-06-14T06:48:17.792173380Z Collecting performance related data for node ip-10-0-129-149.ec2.internal 2026-06-14T06:48:18.990809593Z Gathering data for ns/openshift-ovn-kubernetes... 2026-06-14T06:48:20.227077316Z Gathering data for ns/openshift-host-network... 2026-06-14T06:48:20.556956044Z Gathering data for ns/openshift-network-diagnostics... 2026-06-14T06:48:21.059921207Z Gathering data for ns/openshift-network-node-identity... 2026-06-14T06:48:21.127222886Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-06-14T06:48:21.492176832Z Gathering data for ns/openshift-network-operator... 2026-06-14T06:48:21.858539588Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-06-14T06:48:22.112080350Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-06-14T06:48:22.590111498Z Gathering data for ns/openshift-apiserver-operator... 2026-06-14T06:48:22.889313975Z Gathering data for ns/openshift-apiserver... 2026-06-14T06:48:23.303091793Z Gathering data for ns/openshift-controller-manager-operator... 2026-06-14T06:48:23.556531278Z Gathering data for ns/openshift-controller-manager... 2026-06-14T06:48:23.809545488Z Gathering data for ns/openshift-cluster-samples-operator... 2026-06-14T06:48:24.415689227Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-06-14T06:48:24.691766708Z Gathering data for ns/openshift-service-ca-operator... 2026-06-14T06:48:25.004309217Z Gathering data for ns/openshift-service-ca... 2026-06-14T06:48:25.354304740Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-06-14T06:48:25.853369337Z Collecting kubelet logs for node ip-10-0-140-113.ec2.internal 2026-06-14T06:48:25.855601542Z Collecting kubelet logs for node ip-10-0-131-123.ec2.internal 2026-06-14T06:48:25.858242587Z Collecting kubelet logs for node ip-10-0-129-149.ec2.internal 2026-06-14T06:48:26.132132228Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-06-14T06:48:26.189602470Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-lwgc5 namespace 2026-06-14T06:48:26.194205891Z INFO: Node performance data collection complete. 2026-06-14T06:48:26.358367876Z Wrote inspect data to must-gather. 2026-06-14T06:48:26.358411613Z error: inspection completed with the errors occurred while gathering data: 2026-06-14T06:48:26.358411613Z skipping gathering secrets/support due to error: secrets "support" not found 2026-06-14T06:48:26.488682239Z error: the server doesn't have a resource type "clusters" 2026-06-14T06:48:26.625262273Z Caches written to disk