2026-09-17T19:19:35.839386728Z [disk usage checker] Started 2026-09-17T19:19:35.842593101Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-17T19:19:36.030538292Z Gathering data for ns/openshift-cluster-version... 2026-09-17T19:19:36.174043720Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-09-17T19:19:36.265328481Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-09-17T19:19:36.346966073Z Gathering data for ns/default... 2026-09-17T19:19:36.670440873Z Gathering data for ns/openshift... 2026-09-17T19:19:37.085926090Z Gathering data for ns/kube-system... 2026-09-17T19:19:37.971349915Z Gathering data for ns/openshift-etcd... 2026-09-17T19:19:38.303732418Z Wrote inspect data to must-gather. 2026-09-17T19:19:38.303765076Z error: inspection completed with the errors occurred while gathering data: 2026-09-17T19:19:38.303765076Z namespaces "assisted-installer" not found 2026-09-17T19:19:38.619202426Z Waiting on subprocesses to finish execution. 2026-09-17T19:19:38.623722559Z INFO: Gathering machine config daemon's old logs from all nodes 2026-09-17T19:19:38.627884645Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-09-17T19:19:38.633612091Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-09-17T19:19:38.643722321Z INFO: Collecting host service logs for crio 2026-09-17T19:19:38.644258945Z INFO: Collecting host service logs for kubelet 2026-09-17T19:19:38.644619851Z INFO: Collecting host service logs for rpm-ostreed 2026-09-17T19:19:38.644949448Z INFO: Collecting host service logs for ostree-finalize-staged 2026-09-17T19:19:38.645316503Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-09-17T19:19:38.645664784Z INFO: Collecting host service logs for machine-config-daemon-host 2026-09-17T19:19:38.645916683Z INFO: Gathering HAProxy config files 2026-09-17T19:19:38.646018586Z INFO: Collecting host service logs for NetworkManager 2026-09-17T19:19:38.646355218Z INFO: Collecting host service logs for openvswitch 2026-09-17T19:19:38.646682903Z INFO: Collecting host service logs for ovs-configuration 2026-09-17T19:19:38.647006540Z INFO: Collecting host service logs for ovsdb-server 2026-09-17T19:19:38.647406453Z INFO: Collecting host service logs for ovs-vswitchd 2026-09-17T19:19:38.647806068Z INFO: Waiting for worker host service log collection to complete ... 2026-09-17T19:19:38.656977732Z INFO: Waiting for node performance related collection to complete ... 2026-09-17T19:19:38.668551931Z Executing Istio gather script 2026-09-17T19:19:39.431805207Z No resources found 2026-09-17T19:19:39.458263232Z No resources found in openshift-etcd namespace. 2026-09-17T19:19:39.499142868Z INFO: Collecting Insights Archives from insights-operator-6f9c644dd9-gmcpd 2026-09-17T19:19:39.499189346Z insights-runtime-extractor-4tjv2 2026-09-17T19:19:39.499209581Z insights-runtime-extractor-gwwfq 2026-09-17T19:19:39.499229070Z insights-runtime-extractor-klpqp 2026-09-17T19:19:39.561029846Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-09-17T19:19:39.716526351Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-09-17T19:19:39.716558151Z INFO: on-disk MachineConfig config collection complete. 2026-09-17T19:19:39.817772361Z error: the server doesn't have a resource type "performanceprofile" 2026-09-17T19:19:39.841820903Z INFO: "sriov-network-operator" not detected. Skipping. 2026-09-17T19:19:39.853790872Z INFO: "metallb-operator" not detected. Skipping. 2026-09-17T19:19:40.059725211Z Wrote inspect data to must-gather. 2026-09-17T19:19:40.248377996Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-09-17T19:19:40.318325225Z INFO: Worker host service log collection to complete. 2026-09-17T19:19:40.485838281Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-09-17T19:19:40.519973993Z No resources found 2026-09-17T19:19:40.600851268Z INFO: Found 1 replicas - prometheus-k8s-0 2026-09-17T19:19:40.731836189Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-09-17T19:19:40.731836189Z See 'oc rsync -h' for help and examples 2026-09-17T19:19:40.800916066Z Wrote inspect data to must-gather. 2026-09-17T19:19:40.822722754Z Wrote inspect data to must-gather. 2026-09-17T19:19:40.837893298Z Wrote inspect data to must-gather. 2026-09-17T19:19:40.919268247Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-17T19:19:40.967027786Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-09-17T19:19:40.986916779Z Wrote inspect data to must-gather. 2026-09-17T19:19:41.023691653Z Wrote inspect data to must-gather. 2026-09-17T19:19:41.054115214Z Wrote inspect data to must-gather. 2026-09-17T19:19:41.129425399Z INFO: Waiting for HAProxy config collection to complete ... 2026-09-17T19:19:41.214385368Z INFO: 'previous-logs' folder not found on ip-10-0-134-167.ec2.internal, skipping... 2026-09-17T19:19:41.217709011Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-09-17T19:19:41.281562533Z ERROR: No running kube-apiserver pods found 2026-09-17T19:19:41.380333968Z error: the server doesn't have a resource type "machineconfigs" 2026-09-17T19:19:41.421143402Z Wrote inspect data to must-gather. 2026-09-17T19:19:41.462771902Z Gathering data for ns/openshift-monitoring... 2026-09-17T19:19:41.502464042Z tar: Removing leading `/' from member names 2026-09-17T19:19:41.509350129Z INFO: HAProxy config collection complete. 2026-09-17T19:19:41.570414247Z INFO: 'previous-logs' folder not found on ip-10-0-136-130.ec2.internal, skipping... 2026-09-17T19:19:41.623267873Z error: the server doesn't have a resource type "machineconfigpools" 2026-09-17T19:19:41.714750823Z Wrote inspect data to must-gather. 2026-09-17T19:19:41.833083652Z INFO: Getting rules from prometheus-k8s-0 2026-09-17T19:19:41.875042912Z INFO: 'previous-logs' folder not found on ip-10-0-143-176.ec2.internal, skipping... 2026-09-17T19:19:41.875078089Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-09-17T19:19:41.875122111Z INFO: Machine Config Daemon termination log collection complete. 2026-09-17T19:19:41.891542078Z Wrote inspect data to must-gather. 2026-09-17T19:19:42.004777234Z Wrote inspect data to must-gather. 2026-09-17T19:19:42.062634431Z error: the server doesn't have a resource type "kubeletconfigs" 2026-09-17T19:19:42.289157969Z Wrote inspect data to must-gather. 2026-09-17T19:19:42.293968202Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection. 2026-09-17T19:19:42.347992048Z INFO: INTERCONNECT MODE 2026-09-17T19:19:42.348080619Z INFO: Gathering ovn-kubernetes DBs 2026-09-17T19:19:42.411016815Z INFO: Getting status/config from prometheus-k8s-0 2026-09-17T19:19:42.520549751Z Wrote inspect data to must-gather. 2026-09-17T19:19:42.551169475Z INFO: Gathering OVN_Northbound from ovnkube-node-grs64... 2026-09-17T19:19:42.551481680Z INFO: Gathering OVN_Northbound from ovnkube-node-tg7sn... 2026-09-17T19:19:42.551702258Z INFO: Gathering OVN_Northbound from ovnkube-node-v52kc... 2026-09-17T19:19:42.551973947Z INFO: Gathering OVN_Southbound from ovnkube-node-grs64... 2026-09-17T19:19:42.552196713Z INFO: Gathering OVN_Southbound from ovnkube-node-tg7sn... 2026-09-17T19:19:42.552443521Z INFO: Gathering OVN_Southbound from ovnkube-node-v52kc... 2026-09-17T19:19:42.849733341Z tar: Removing leading `/' from member names 2026-09-17T19:19:42.872696941Z Wrote inspect data to must-gather. 2026-09-17T19:19:42.890733545Z tar: Removing leading `/' from member names 2026-09-17T19:19:42.904669716Z tar: Removing leading `/' from member names 2026-09-17T19:19:42.921914177Z tar: Removing leading `/' from member names 2026-09-17T19:19:42.922802569Z tar: Removing leading `/' from member names 2026-09-17T19:19:42.945606498Z tar: Removing leading `/' from member names 2026-09-17T19:19:42.947467021Z INFO: Getting status/flags from prometheus-k8s-0 2026-09-17T19:19:43.120117533Z Wrote inspect data to must-gather. 2026-09-17T19:19:43.231895522Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-09-17T19:19:43.365677436Z Wrote inspect data to must-gather. 2026-09-17T19:19:43.406872895Z INFO: Waiting for network log collection to complete ... 2026-09-17T19:19:43.406902733Z INFO: Waiting for ovnk database copies to complete ... 2026-09-17T19:19:43.407269559Z INFO: Copying ovnk databases complete. 2026-09-17T19:19:43.409763338Z 3.9M must-gather/network_logs/ovnk_database_store 2026-09-17T19:19:43.411921109Z ovnk_database_store/ 2026-09-17T19:19:43.411921109Z ovnk_database_store/ovnkube-node-v52kc_nbdb 2026-09-17T19:19:43.421057449Z ovnk_database_store/ovnkube-node-tg7sn_sbdb 2026-09-17T19:19:43.444493356Z ovnk_database_store/ovnkube-node-grs64_nbdb 2026-09-17T19:19:43.452629396Z ovnk_database_store/ovnkube-node-tg7sn_nbdb 2026-09-17T19:19:43.460219056Z ovnk_database_store/ovnkube-node-v52kc_sbdb 2026-09-17T19:19:43.481954724Z ovnk_database_store/ovnkube-node-grs64_sbdb 2026-09-17T19:19:43.510209079Z INFO: Network log collection complete. 2026-09-17T19:19:43.562820407Z Wrote inspect data to must-gather. 2026-09-17T19:19:43.588926399Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-09-17T19:19:43.615935700Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io 2026-09-17T19:19:43.776801478Z Wrote inspect data to must-gather. 2026-09-17T19:19:43.792528850Z Wrote inspect data to /must-gather/istio. 2026-09-17T19:19:43.858037915Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-09-17T19:19:44.001778194Z Wrote inspect data to /must-gather/istio. 2026-09-17T19:19:44.004221318Z Inspecting resource crd/gateways.gateway.networking.k8s.io 2026-09-17T19:19:44.057780016Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found 2026-09-17T19:19:44.060460745Z INFO: Fallback to identify the container image from release info 2026-09-17T19:19:44.173462825Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-09-17T19:19:44.208025156Z Wrote inspect data to /must-gather/istio. 2026-09-17T19:19:44.252691051Z INFO: Getting status from alertmanager-main-0 2026-09-17T19:19:44.414640577Z Wrote inspect data to /must-gather/istio. 2026-09-17T19:19:44.417667765Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io 2026-09-17T19:19:44.612561923Z Wrote inspect data to /must-gather/istio. 2026-09-17T19:19:44.619548585Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea 2026-09-17T19:19:44.736959626Z daemonset.apps/perf-node-gather-daemonset created 2026-09-17T19:19:44.813925255Z Wrote inspect data to /must-gather/istio. 2026-09-17T19:19:44.816552497Z Inspecting resource crd/httproutes.gateway.networking.k8s.io 2026-09-17T19:19:44.853843217Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-09-17T19:19:44.889512762Z Waiting for performance profile collector pods to become ready: 1 2026-09-17T19:19:45.035136151Z Gathering data for ns/openshift-network-console... 2026-09-17T19:19:45.043413468Z Wrote inspect data to /must-gather/istio. 2026-09-17T19:19:45.256097044Z Wrote inspect data to /must-gather/istio. 2026-09-17T19:19:45.259056785Z Inspecting resource crd/inferencepools.inference.networking.k8s.io 2026-09-17T19:19:45.445558179Z Wrote inspect data to /must-gather/istio. 2026-09-17T19:19:45.530925948Z Gathering data for ns/openshift-console-operator... 2026-09-17T19:19:45.649936516Z Wrote inspect data to /must-gather/istio. 2026-09-17T19:19:45.652188405Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io 2026-09-17T19:19:45.818278795Z Wrote inspect data to /must-gather/istio. 2026-09-17T19:19:45.948488115Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-17T19:19:45.950734015Z Gathering data for ns/openshift-console... 2026-09-17T19:19:46.029956163Z Wrote inspect data to /must-gather/istio. 2026-09-17T19:19:46.034270517Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io 2026-09-17T19:19:46.034376332Z Waiting for performance profile collector pods to become ready: 2 2026-09-17T19:19:46.210011789Z Wrote inspect data to /must-gather/istio. 2026-09-17T19:19:46.408825291Z Wrote inspect data to /must-gather/istio. 2026-09-17T19:19:46.517522639Z Gathering data for ns/openshift-cluster-storage-operator... 2026-09-17T19:19:47.131706712Z Done executing Istio gather script 2026-09-17T19:19:47.157545274Z Gathering data for ns/openshift-dns-operator... 2026-09-17T19:19:47.175820717Z Waiting for performance profile collector pods to become ready: 3 2026-09-17T19:19:47.540132732Z Gathering data for ns/openshift-dns... 2026-09-17T19:19:48.298916903Z Waiting for performance profile collector pods to become ready: 4 2026-09-17T19:19:48.516892755Z Gathering data for ns/openshift-image-registry... 2026-09-17T19:19:49.114107803Z Gathering data for ns/openshift-ingress-operator... 2026-09-17T19:19:49.420534312Z Waiting for performance profile collector pods to become ready: 5 2026-09-17T19:19:49.513596751Z Gathering data for ns/openshift-ingress... 2026-09-17T19:19:49.921573154Z Gathering data for ns/openshift-ingress-canary... 2026-09-17T19:19:50.365283239Z Gathering data for ns/openshift-insights... 2026-09-17T19:19:50.534159026Z Waiting for performance profile collector pods to become ready: 6 2026-09-17T19:19:50.954126078Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-17T19:19:51.644185779Z Waiting for performance profile collector pods to become ready: 7 2026-09-17T19:19:52.759775683Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-09-17T19:19:52.918860027Z Gathering data for ns/kserve... 2026-09-17T19:19:52.999149698Z Collecting performance related data for node ip-10-0-134-167.ec2.internal 2026-09-17T19:19:53.009763664Z Collecting performance related data for node ip-10-0-136-130.ec2.internal 2026-09-17T19:19:53.017079553Z Collecting performance related data for node ip-10-0-143-176.ec2.internal 2026-09-17T19:19:54.910892771Z Gathering data for ns/openshift-config... 2026-09-17T19:19:55.265690639Z Gathering data for ns/openshift-config-managed... 2026-09-17T19:19:55.887131954Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-09-17T19:19:55.960277415Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-17T19:19:56.332551465Z Gathering data for ns/openshift-kube-apiserver... 2026-09-17T19:19:56.755200487Z Gathering data for ns/openshift-kube-controller-manager... 2026-09-17T19:19:57.318706418Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-09-17T19:19:57.884424415Z Gathering data for ns/openshift-kube-scheduler... 2026-09-17T19:19:58.356185742Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-09-17T19:19:58.816965280Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-09-17T19:19:59.428824565Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-09-17T19:19:59.875562290Z Gathering data for ns/openshift-user-workload-monitoring... 2026-09-17T19:20:00.568862222Z Gathering data for ns/openshift-multus... 2026-09-17T19:20:00.965976270Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-17T19:20:01.268705953Z Collecting kubelet logs for node ip-10-0-134-167.ec2.internal 2026-09-17T19:20:01.270463713Z Collecting kubelet logs for node ip-10-0-136-130.ec2.internal 2026-09-17T19:20:01.272087030Z Collecting kubelet logs for node ip-10-0-143-176.ec2.internal 2026-09-17T19:20:01.630450656Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-2jrbn namespace 2026-09-17T19:20:01.635198368Z INFO: Node performance data collection complete. 2026-09-17T19:20:02.321000273Z Gathering data for ns/openshift-ovn-kubernetes... 2026-09-17T19:20:03.686216861Z Gathering data for ns/openshift-host-network... 2026-09-17T19:20:04.128851797Z Gathering data for ns/openshift-network-diagnostics... 2026-09-17T19:20:04.854083482Z Gathering data for ns/openshift-network-node-identity... 2026-09-17T19:20:05.387604922Z Gathering data for ns/openshift-network-operator... 2026-09-17T19:20:05.919182041Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-09-17T19:20:05.972341753Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-17T19:20:06.309720160Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-09-17T19:20:06.846494886Z Gathering data for ns/openshift-apiserver-operator... 2026-09-17T19:20:07.265047728Z Gathering data for ns/openshift-apiserver... 2026-09-17T19:20:07.718711626Z Gathering data for ns/openshift-controller-manager-operator... 2026-09-17T19:20:08.161317235Z Gathering data for ns/openshift-controller-manager... 2026-09-17T19:20:08.552361464Z Gathering data for ns/openshift-cluster-samples-operator... 2026-09-17T19:20:09.346456146Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-09-17T19:20:09.635826475Z Gathering data for ns/openshift-service-ca-operator... 2026-09-17T19:20:09.968037238Z Gathering data for ns/openshift-service-ca... 2026-09-17T19:20:10.382545880Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-09-17T19:20:10.977208620Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-17T19:20:11.485494620Z Wrote inspect data to must-gather. 2026-09-17T19:20:11.485542668Z error: inspection completed with the errors occurred while gathering data: 2026-09-17T19:20:11.485542668Z skipping gathering secrets/support due to error: secrets "support" not found 2026-09-17T19:20:11.615934597Z error: the server doesn't have a resource type "clusters" 2026-09-17T19:20:11.787146856Z Caches written to disk