2026-06-08T18:46:13.656744826Z [disk usage checker] Started 2026-06-08T18:46:13.660485966Z [disk usage checker] Volume usage percentage: current = 27 ; allowed = 70 2026-06-08T18:46:16.191188567Z Gathering data for ns/openshift-cluster-version... 2026-06-08T18:46:16.324367689Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-06-08T18:46:16.418415206Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-06-08T18:46:16.498315726Z Gathering data for ns/default... 2026-06-08T18:46:16.816159123Z Gathering data for ns/openshift... 2026-06-08T18:46:17.247331965Z Gathering data for ns/kube-system... 2026-06-08T18:46:17.963848965Z Gathering data for ns/openshift-etcd... 2026-06-08T18:46:18.403671348Z Wrote inspect data to must-gather. 2026-06-08T18:46:18.403705476Z error: inspection completed with the errors occurred while gathering data: 2026-06-08T18:46:18.403705476Z namespaces "assisted-installer" not found 2026-06-08T18:46:18.626225175Z Waiting on subprocesses to finish execution. 2026-06-08T18:46:18.631965471Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-06-08T18:46:18.634955332Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-06-08T18:46:18.640084940Z Executing Istio gather script 2026-06-08T18:46:18.644278017Z INFO: Gathering machine config daemon's old logs from all nodes 2026-06-08T18:46:18.649262024Z INFO: Collecting host service logs for crio 2026-06-08T18:46:18.649621330Z INFO: Collecting host service logs for kubelet 2026-06-08T18:46:18.649932331Z INFO: Collecting host service logs for rpm-ostreed 2026-06-08T18:46:18.650341143Z INFO: Collecting host service logs for ostree-finalize-staged 2026-06-08T18:46:18.650674766Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-06-08T18:46:18.651015066Z INFO: Collecting host service logs for machine-config-daemon-host 2026-06-08T18:46:18.651338886Z INFO: Collecting host service logs for NetworkManager 2026-06-08T18:46:18.651925908Z INFO: Collecting host service logs for openvswitch 2026-06-08T18:46:18.652274877Z INFO: Collecting host service logs for ovs-configuration 2026-06-08T18:46:18.652661977Z INFO: Collecting host service logs for ovsdb-server 2026-06-08T18:46:18.653007363Z INFO: Collecting host service logs for ovs-vswitchd 2026-06-08T18:46:18.653466849Z INFO: Waiting for worker host service log collection to complete ... 2026-06-08T18:46:18.662708604Z INFO: Gathering HAProxy config files 2026-06-08T18:46:18.737475003Z INFO: Waiting for node performance related collection to complete ... 2026-06-08T18:46:18.924403821Z [disk usage checker] Volume usage percentage: current = 27 ; allowed = 70 2026-06-08T18:46:19.107241714Z INFO: Collecting Insights Archives from insights-operator-896549976-trwgx 2026-06-08T18:46:19.107241714Z insights-runtime-extractor-7g47b 2026-06-08T18:46:19.107241714Z insights-runtime-extractor-cdxf6 2026-06-08T18:46:19.107241714Z insights-runtime-extractor-hlgcc 2026-06-08T18:46:19.381086222Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-06-08T18:46:19.537587109Z No resources found 2026-06-08T18:46:19.620117126Z No resources found in openshift-etcd namespace. 2026-06-08T18:46:19.750485431Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-06-08T18:46:19.750589512Z INFO: on-disk MachineConfig config collection complete. 2026-06-08T18:46:19.783188463Z Wrote inspect data to must-gather. 2026-06-08T18:46:19.787308449Z INFO: Found 1 replicas - prometheus-k8s-0 2026-06-08T18:46:19.866767699Z INFO: "sriov-network-operator" not detected. Skipping. 2026-06-08T18:46:19.943657457Z INFO: "metallb-operator" not detected. Skipping. 2026-06-08T18:46:20.003314100Z INFO: Worker host service log collection to complete. 2026-06-08T18:46:20.030575162Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-06-08T18:46:20.030575162Z See 'oc rsync -h' for help and examples 2026-06-08T18:46:20.163310963Z INFO: Waiting for HAProxy config collection to complete ... 2026-06-08T18:46:20.212979451Z error: the server doesn't have a resource type "performanceprofile" 2026-06-08T18:46:20.236925068Z ERROR: No running kube-apiserver pods found 2026-06-08T18:46:20.245794095Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-06-08T18:46:20.550217428Z No resources found 2026-06-08T18:46:20.589460516Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-06-08T18:46:20.864253347Z tar: Removing leading `/' from member names 2026-06-08T18:46:20.877420221Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-06-08T18:46:20.878524850Z INFO: HAProxy config collection complete. 2026-06-08T18:46:20.974904787Z INFO: 'previous-logs' folder not found on ip-10-0-134-73.ec2.internal, skipping... 2026-06-08T18:46:21.032128320Z Wrote inspect data to must-gather. 2026-06-08T18:46:21.036086309Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-06-08T18:46:21.052912609Z Wrote inspect data to must-gather. 2026-06-08T18:46:21.070325452Z Wrote inspect data to must-gather. 2026-06-08T18:46:21.118481854Z Wrote inspect data to must-gather. 2026-06-08T18:46:21.208232694Z Wrote inspect data to must-gather. 2026-06-08T18:46:21.238966343Z Wrote inspect data to must-gather. 2026-06-08T18:46:21.373710662Z INFO: 'previous-logs' folder not found on ip-10-0-138-235.ec2.internal, skipping... 2026-06-08T18:46:21.392603446Z Gathering data for ns/openshift-monitoring... 2026-06-08T18:46:21.414069435Z INFO: Getting rules from prometheus-k8s-0 2026-06-08T18:46:21.433206675Z error: the server doesn't have a resource type "machineconfigs" 2026-06-08T18:46:21.526227311Z Wrote inspect data to must-gather. 2026-06-08T18:46:21.626077969Z error: the server doesn't have a resource type "machineconfigpools" 2026-06-08T18:46:21.686189733Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection. 2026-06-08T18:46:21.692625999Z INFO: 'previous-logs' folder not found on ip-10-0-141-113.ec2.internal, skipping... 2026-06-08T18:46:21.692652441Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-06-08T18:46:21.692669607Z INFO: Machine Config Daemon termination log collection complete. 2026-06-08T18:46:21.804283476Z Wrote inspect data to must-gather. 2026-06-08T18:46:21.871391726Z Wrote inspect data to must-gather. 2026-06-08T18:46:21.879456519Z INFO: Getting status/config from prometheus-k8s-0 2026-06-08T18:46:22.040643250Z error: the server doesn't have a resource type "kubeletconfigs" 2026-06-08T18:46:22.059389878Z Wrote inspect data to must-gather. 2026-06-08T18:46:22.244046424Z Wrote inspect data to must-gather. 2026-06-08T18:46:22.290005564Z INFO: Getting status/flags from prometheus-k8s-0 2026-06-08T18:46:22.345739838Z INFO: INTERCONNECT MODE 2026-06-08T18:46:22.345791783Z INFO: Gathering ovn-kubernetes DBs 2026-06-08T18:46:22.423811700Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io 2026-06-08T18:46:22.457351705Z Wrote inspect data to must-gather. 2026-06-08T18:46:22.515581169Z INFO: Gathering OVN_Northbound from ovnkube-node-8wbmh... 2026-06-08T18:46:22.515842922Z INFO: Gathering OVN_Northbound from ovnkube-node-fxnt5... 2026-06-08T18:46:22.516121653Z INFO: Gathering OVN_Northbound from ovnkube-node-h695t... 2026-06-08T18:46:22.516525103Z INFO: Gathering OVN_Southbound from ovnkube-node-8wbmh... 2026-06-08T18:46:22.516846755Z INFO: Gathering OVN_Southbound from ovnkube-node-fxnt5... 2026-06-08T18:46:22.517134321Z INFO: Gathering OVN_Southbound from ovnkube-node-h695t... 2026-06-08T18:46:22.541222068Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-06-08T18:46:22.681237043Z Wrote inspect data to /must-gather/istio. 2026-06-08T18:46:22.804545894Z Wrote inspect data to must-gather. 2026-06-08T18:46:22.828759600Z tar: Removing leading `/' from member names 2026-06-08T18:46:22.833809649Z tar: Removing leading `/' from member names 2026-06-08T18:46:22.876515551Z tar: Removing leading `/' from member names 2026-06-08T18:46:22.890789300Z tar: Removing leading `/' from member names 2026-06-08T18:46:22.911165513Z tar: Removing leading `/' from member names 2026-06-08T18:46:22.923388476Z tar: Removing leading `/' from member names 2026-06-08T18:46:22.956355093Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-06-08T18:46:22.977530188Z Wrote inspect data to /must-gather/istio. 2026-06-08T18:46:22.981146284Z Inspecting resource crd/gateways.gateway.networking.k8s.io 2026-06-08T18:46:23.090125846Z Wrote inspect data to must-gather. 2026-06-08T18:46:23.153916810Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-06-08T18:46:23.213192159Z Wrote inspect data to /must-gather/istio. 2026-06-08T18:46:23.236638887Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-06-08T18:46:23.325106393Z Wrote inspect data to must-gather. 2026-06-08T18:46:23.371879613Z INFO: Waiting for network log collection to complete ... 2026-06-08T18:46:23.372430219Z INFO: Waiting for ovnk database copies to complete ... 2026-06-08T18:46:23.372862776Z INFO: Copying ovnk databases complete. 2026-06-08T18:46:23.375573373Z 2.8M must-gather/network_logs/ovnk_database_store 2026-06-08T18:46:23.380137775Z ovnk_database_store/ 2026-06-08T18:46:23.380684157Z ovnk_database_store/ovnkube-node-8wbmh_nbdb 2026-06-08T18:46:23.394596574Z ovnk_database_store/ovnkube-node-fxnt5_nbdb 2026-06-08T18:46:23.400993058Z ovnk_database_store/ovnkube-node-h695t_sbdb 2026-06-08T18:46:23.420041518Z ovnk_database_store/ovnkube-node-8wbmh_sbdb 2026-06-08T18:46:23.438615032Z ovnk_database_store/ovnkube-node-fxnt5_sbdb 2026-06-08T18:46:23.452941191Z Wrote inspect data to /must-gather/istio. 2026-06-08T18:46:23.454524962Z ovnk_database_store/ovnkube-node-h695t_nbdb 2026-06-08T18:46:23.457230347Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io 2026-06-08T18:46:23.466660851Z INFO: Network log collection complete. 2026-06-08T18:46:23.560213696Z Wrote inspect data to must-gather. 2026-06-08T18:46:23.649045479Z Wrote inspect data to /must-gather/istio. 2026-06-08T18:46:23.651180910Z INFO: Getting status from alertmanager-main-0 2026-06-08T18:46:23.791979987Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-06-08T18:46:23.866224521Z Wrote inspect data to must-gather. 2026-06-08T18:46:23.880891712Z Wrote inspect data to /must-gather/istio. 2026-06-08T18:46:23.884124486Z Inspecting resource crd/httproutes.gateway.networking.k8s.io 2026-06-08T18:46:23.965658104Z [disk usage checker] Volume usage percentage: current = 27 ; allowed = 70 2026-06-08T18:46:23.987093893Z Gathering data for ns/openshift-network-console... 2026-06-08T18:46:24.122142085Z Wrote inspect data to /must-gather/istio. 2026-06-08T18:46:24.127319284Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found 2026-06-08T18:46:24.129453888Z INFO: Fallback to identify the container image from release info 2026-06-08T18:46:24.319731931Z Wrote inspect data to /must-gather/istio. 2026-06-08T18:46:24.322945413Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io 2026-06-08T18:46:24.439751750Z Gathering data for ns/openshift-console-operator... 2026-06-08T18:46:24.484521050Z Wrote inspect data to /must-gather/istio. 2026-06-08T18:46:24.686368515Z Wrote inspect data to /must-gather/istio. 2026-06-08T18:46:24.844518195Z Gathering data for ns/openshift-console... 2026-06-08T18:46:24.911267314Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:75a8fe9618bb81a42d565c535f20bf55d78662baa7f32548859596b4c5aa793e 2026-06-08T18:46:25.044357581Z daemonset.apps/perf-node-gather-daemonset created 2026-06-08T18:46:25.176153581Z Waiting for performance profile collector pods to become ready: 1 2026-06-08T18:46:25.370475308Z Done executing Istio gather script 2026-06-08T18:46:25.423730268Z Gathering data for ns/openshift-cluster-storage-operator... 2026-06-08T18:46:25.930873034Z Gathering data for ns/openshift-dns-operator... 2026-06-08T18:46:26.216430392Z Gathering data for ns/openshift-dns... 2026-06-08T18:46:26.284413048Z Waiting for performance profile collector pods to become ready: 2 2026-06-08T18:46:26.796428043Z Gathering data for ns/openshift-image-registry... 2026-06-08T18:46:27.248533189Z Gathering data for ns/openshift-ingress-operator... 2026-06-08T18:46:27.393103525Z Waiting for performance profile collector pods to become ready: 3 2026-06-08T18:46:27.582705574Z Gathering data for ns/openshift-ingress... 2026-06-08T18:46:27.907582081Z Gathering data for ns/openshift-ingress-canary... 2026-06-08T18:46:28.285716251Z Gathering data for ns/openshift-insights... 2026-06-08T18:46:28.496712983Z Waiting for performance profile collector pods to become ready: 4 2026-06-08T18:46:28.971187813Z [disk usage checker] Volume usage percentage: current = 27 ; allowed = 70 2026-06-08T18:46:29.620408380Z Waiting for performance profile collector pods to become ready: 5 2026-06-08T18:46:30.133569513Z Gathering data for ns/openshift-jobset-operator... 2026-06-08T18:46:30.730180137Z Waiting for performance profile collector pods to become ready: 6 2026-06-08T18:46:30.942511020Z Gathering data for ns/openshift-config... 2026-06-08T18:46:31.248183606Z Gathering data for ns/openshift-config-managed... 2026-06-08T18:46:31.666987515Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-06-08T18:46:31.833949921Z Waiting for performance profile collector pods to become ready: 7 2026-06-08T18:46:31.943570062Z Gathering data for ns/openshift-kube-apiserver... 2026-06-08T18:46:32.347418530Z Gathering data for ns/openshift-kube-controller-manager... 2026-06-08T18:46:32.736963730Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-06-08T18:46:32.948949071Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-06-08T18:46:33.081730006Z Gathering data for ns/openshift-kube-scheduler... 2026-06-08T18:46:33.207061320Z Collecting performance related data for node ip-10-0-134-73.ec2.internal 2026-06-08T18:46:33.214339808Z Collecting performance related data for node ip-10-0-138-235.ec2.internal 2026-06-08T18:46:33.221730126Z Collecting performance related data for node ip-10-0-141-113.ec2.internal 2026-06-08T18:46:33.417289812Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-06-08T18:46:33.778399478Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-06-08T18:46:33.976595614Z [disk usage checker] Volume usage percentage: current = 27 ; allowed = 70 2026-06-08T18:46:34.208483433Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-06-08T18:46:34.589475566Z Gathering data for ns/openshift-user-workload-monitoring... 2026-06-08T18:46:35.204106035Z Gathering data for ns/openshift-multus... 2026-06-08T18:46:36.957817006Z Gathering data for ns/openshift-ovn-kubernetes... 2026-06-08T18:46:38.685455823Z Gathering data for ns/openshift-host-network... 2026-06-08T18:46:38.986869684Z [disk usage checker] Volume usage percentage: current = 27 ; allowed = 70 2026-06-08T18:46:39.182550897Z Gathering data for ns/openshift-network-diagnostics... 2026-06-08T18:46:39.830703236Z Gathering data for ns/openshift-network-node-identity... 2026-06-08T18:46:40.297720879Z Gathering data for ns/openshift-network-operator... 2026-06-08T18:46:40.706687737Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-06-08T18:46:41.072468171Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-06-08T18:46:41.631149357Z Gathering data for ns/openshift-apiserver-operator... 2026-06-08T18:46:41.634863489Z Collecting kubelet logs for node ip-10-0-134-73.ec2.internal 2026-06-08T18:46:41.636863173Z Collecting kubelet logs for node ip-10-0-138-235.ec2.internal 2026-06-08T18:46:41.639208324Z Collecting kubelet logs for node ip-10-0-141-113.ec2.internal 2026-06-08T18:46:42.018246077Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-wlvcx namespace 2026-06-08T18:46:42.021400871Z Gathering data for ns/openshift-apiserver... 2026-06-08T18:46:42.024911403Z INFO: Node performance data collection complete. 2026-06-08T18:46:42.487816404Z Gathering data for ns/openshift-controller-manager-operator... 2026-06-08T18:46:42.751766968Z Gathering data for ns/openshift-controller-manager... 2026-06-08T18:46:43.026019101Z Gathering data for ns/openshift-cluster-samples-operator... 2026-06-08T18:46:43.661462287Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-06-08T18:46:43.951199039Z Gathering data for ns/openshift-service-ca-operator... 2026-06-08T18:46:43.992590635Z [disk usage checker] Volume usage percentage: current = 27 ; allowed = 70 2026-06-08T18:46:44.308537781Z Gathering data for ns/openshift-service-ca... 2026-06-08T18:46:44.693400465Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-06-08T18:46:45.582936606Z Wrote inspect data to must-gather. 2026-06-08T18:46:45.582984933Z error: inspection completed with the errors occurred while gathering data: 2026-06-08T18:46:45.582984933Z skipping gathering secrets/support due to error: secrets "support" not found 2026-06-08T18:46:45.702421866Z error: the server doesn't have a resource type "clusters" 2026-06-08T18:46:45.814197186Z Caches written to disk