2026-05-21T19:57:10.835432582Z [disk usage checker] Started 2026-05-21T19:57:10.838923746Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-05-21T19:57:11.055524002Z Gathering data for ns/openshift-cluster-version... 2026-05-21T19:57:11.217985671Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-05-21T19:57:11.324998382Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-05-21T19:57:11.428208203Z Gathering data for ns/default... 2026-05-21T19:57:11.841832402Z Gathering data for ns/openshift... 2026-05-21T19:57:12.346904294Z Gathering data for ns/kube-system... 2026-05-21T19:57:13.126317097Z Gathering data for ns/openshift-etcd... 2026-05-21T19:57:13.273962133Z Waiting on subprocesses to finish execution. 2026-05-21T19:57:13.279057842Z INFO: Collecting host service logs for crio 2026-05-21T19:57:13.279331922Z INFO: Collecting host service logs for kubelet 2026-05-21T19:57:13.279658755Z INFO: Collecting host service logs for rpm-ostreed 2026-05-21T19:57:13.279950509Z INFO: Collecting host service logs for ostree-finalize-staged 2026-05-21T19:57:13.280297714Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-05-21T19:57:13.280614317Z INFO: Collecting host service logs for machine-config-daemon-host 2026-05-21T19:57:13.280941311Z INFO: Collecting host service logs for NetworkManager 2026-05-21T19:57:13.281273832Z INFO: Collecting host service logs for openvswitch 2026-05-21T19:57:13.281574056Z INFO: Collecting host service logs for ovs-configuration 2026-05-21T19:57:13.281898547Z INFO: Collecting host service logs for ovsdb-server 2026-05-21T19:57:13.282342498Z INFO: Collecting host service logs for ovs-vswitchd 2026-05-21T19:57:13.282708962Z INFO: Waiting for worker host service log collection to complete ... 2026-05-21T19:57:13.282959755Z INFO: Gathering machine config daemon's old logs from all nodes 2026-05-21T19:57:13.285978062Z INFO: Gathering HAProxy config files 2026-05-21T19:57:13.290341283Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-05-21T19:57:13.295249865Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-05-21T19:57:13.456613984Z INFO: Waiting for node performance related collection to complete ... 2026-05-21T19:57:13.762638267Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-05-21T19:57:13.926509308Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-05-21T19:57:14.034636618Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-05-21T19:57:14.034722395Z INFO: on-disk MachineConfig config collection complete. 2026-05-21T19:57:14.143609473Z Wrote inspect data to must-gather. 2026-05-21T19:57:14.143719153Z error: inspection completed with the errors occurred while gathering data: 2026-05-21T19:57:14.143719153Z namespaces "assisted-installer" not found 2026-05-21T19:57:14.248293882Z No resources found 2026-05-21T19:57:14.326615343Z error: the server doesn't have a resource type "performanceprofile" 2026-05-21T19:57:14.427121564Z INFO: "sriov-network-operator" not detected. Skipping. 2026-05-21T19:57:14.430716573Z INFO: "metallb-operator" not detected. Skipping. 2026-05-21T19:57:14.444634956Z INFO: Collecting Insights Archives from insights-operator-78bdfb888c-hx8xr 2026-05-21T19:57:14.444634956Z insights-runtime-extractor-89v58 2026-05-21T19:57:14.444634956Z insights-runtime-extractor-jl84v 2026-05-21T19:57:14.444634956Z insights-runtime-extractor-shwzm 2026-05-21T19:57:14.533908228Z Wrote inspect data to must-gather. 2026-05-21T19:57:14.534106490Z No resources found in openshift-etcd namespace. 2026-05-21T19:57:14.705264810Z INFO: Found 1 replicas - prometheus-k8s-0 2026-05-21T19:57:14.794304881Z INFO: Worker host service log collection to complete. 2026-05-21T19:57:14.870920163Z INFO: Waiting for HAProxy config collection to complete ... 2026-05-21T19:57:15.048654433Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-05-21T19:57:15.048654433Z See 'oc rsync -h' for help and examples 2026-05-21T19:57:15.599399481Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-05-21T19:57:15.653477473Z ERROR: No running kube-apiserver pods found 2026-05-21T19:57:15.655169199Z Wrote inspect data to must-gather. 2026-05-21T19:57:15.683201098Z No resources found 2026-05-21T19:57:15.837117512Z Wrote inspect data to must-gather. 2026-05-21T19:57:15.885576509Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-05-21T19:57:15.893694652Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-05-21T19:57:15.913575318Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-05-21T19:57:15.925293607Z tar: Removing leading `/' from member names 2026-05-21T19:57:15.936261358Z INFO: HAProxy config collection complete. 2026-05-21T19:57:15.939736207Z Wrote inspect data to must-gather. 2026-05-21T19:57:16.098306362Z Wrote inspect data to must-gather. 2026-05-21T19:57:16.135813551Z INFO: 'previous-logs' folder not found on ip-10-0-133-228.ec2.internal, skipping... 2026-05-21T19:57:16.153317539Z Gathering data for ns/kuadrant-system... 2026-05-21T19:57:16.172189453Z Wrote inspect data to must-gather. 2026-05-21T19:57:16.215378457Z error: the server doesn't have a resource type "machineconfigs" 2026-05-21T19:57:16.487820854Z INFO: Getting rules from prometheus-k8s-0 2026-05-21T19:57:16.510561102Z INFO: 'previous-logs' folder not found on ip-10-0-137-59.ec2.internal, skipping... 2026-05-21T19:57:16.518392183Z Wrote inspect data to must-gather. 2026-05-21T19:57:16.519909432Z Wrote inspect data to must-gather. 2026-05-21T19:57:16.947590984Z Wrote inspect data to must-gather. 2026-05-21T19:57:16.957161892Z INFO: 'previous-logs' folder not found on ip-10-0-143-158.ec2.internal, skipping... 2026-05-21T19:57:16.957260584Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-05-21T19:57:16.957307369Z INFO: Machine Config Daemon termination log collection complete. 2026-05-21T19:57:16.969921644Z Wrote inspect data to must-gather. 2026-05-21T19:57:17.089465810Z INFO: Getting status/config from prometheus-k8s-0 2026-05-21T19:57:17.180058080Z error: the server doesn't have a resource type "kubeletconfigs" 2026-05-21T19:57:17.305492401Z Wrote inspect data to must-gather. 2026-05-21T19:57:17.474618084Z Wrote inspect data to must-gather. 2026-05-21T19:57:17.523422798Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-05-21T19:57:17.602725606Z INFO: Getting status/flags from prometheus-k8s-0 2026-05-21T19:57:17.726482128Z INFO: INTERCONNECT MODE 2026-05-21T19:57:17.726582741Z INFO: Gathering ovn-kubernetes DBs 2026-05-21T19:57:17.807805805Z Wrote inspect data to must-gather. 2026-05-21T19:57:17.921501662Z INFO: Gathering OVN_Northbound from ovnkube-node-hnsn4... 2026-05-21T19:57:17.921751069Z INFO: Gathering OVN_Northbound from ovnkube-node-kwrjl... 2026-05-21T19:57:17.922034619Z INFO: Gathering OVN_Northbound from ovnkube-node-rvztd... 2026-05-21T19:57:17.922384596Z INFO: Gathering OVN_Southbound from ovnkube-node-hnsn4... 2026-05-21T19:57:17.922677783Z INFO: Gathering OVN_Southbound from ovnkube-node-kwrjl... 2026-05-21T19:57:17.922950860Z INFO: Gathering OVN_Southbound from ovnkube-node-rvztd... 2026-05-21T19:57:18.009256479Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-05-21T19:57:18.176483673Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-05-21T19:57:18.188185544Z tar: Removing leading `/' from member names 2026-05-21T19:57:18.199031125Z tar: Removing leading `/' from member names 2026-05-21T19:57:18.253420130Z tar: Removing leading `/' from member names 2026-05-21T19:57:18.301494816Z tar: Removing leading `/' from member names 2026-05-21T19:57:18.376025416Z tar: Removing leading `/' from member names 2026-05-21T19:57:18.393696900Z tar: Removing leading `/' from member names 2026-05-21T19:57:18.402808044Z Wrote inspect data to must-gather. 2026-05-21T19:57:18.519244970Z Gathering data for ns/openshift-monitoring... 2026-05-21T19:57:18.573336484Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-05-21T19:57:18.789509786Z Wrote inspect data to must-gather. 2026-05-21T19:57:18.826366736Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-05-21T19:57:19.146646283Z INFO: Waiting for network log collection to complete ... 2026-05-21T19:57:19.146694532Z INFO: Waiting for ovnk database copies to complete ... 2026-05-21T19:57:19.147202908Z INFO: Copying ovnk databases complete. 2026-05-21T19:57:19.148845283Z 4.1M must-gather/network_logs/ovnk_database_store 2026-05-21T19:57:19.152995578Z ovnk_database_store/ 2026-05-21T19:57:19.152995578Z ovnk_database_store/ovnkube-node-rvztd_nbdb 2026-05-21T19:57:19.171887405Z Wrote inspect data to must-gather. 2026-05-21T19:57:19.212342345Z ovnk_database_store/ovnkube-node-hnsn4_sbdb 2026-05-21T19:57:19.240349298Z ovnk_database_store/ovnkube-node-rvztd_sbdb 2026-05-21T19:57:19.247752524Z INFO: Getting status from alertmanager-main-0 2026-05-21T19:57:19.271942272Z ovnk_database_store/ovnkube-node-hnsn4_nbdb 2026-05-21T19:57:19.283598324Z ovnk_database_store/ovnkube-node-kwrjl_nbdb 2026-05-21T19:57:19.297290384Z ovnk_database_store/ovnkube-node-kwrjl_sbdb 2026-05-21T19:57:19.328248356Z INFO: Network log collection complete. 2026-05-21T19:57:19.522189777Z Wrote inspect data to must-gather. 2026-05-21T19:57:19.814719107Z Wrote inspect data to must-gather. 2026-05-21T19:57:20.122505416Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found 2026-05-21T19:57:20.124941872Z INFO: Fallback to identify the container image from release info 2026-05-21T19:57:20.756583098Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:934b226bb305ecfe687cdb9684d7d4cf04b130e6254c2817dd1a6112d4829bda 2026-05-21T19:57:20.786082463Z Gathering data for ns/openshift-network-console... 2026-05-21T19:57:20.892817883Z daemonset.apps/perf-node-gather-daemonset created 2026-05-21T19:57:20.928903683Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-05-21T19:57:21.038819977Z Waiting for performance profile collector pods to become ready: 1 2026-05-21T19:57:21.418450437Z Gathering data for ns/openshift-console-operator... 2026-05-21T19:57:21.936372608Z Gathering data for ns/openshift-console... 2026-05-21T19:57:22.171061232Z Waiting for performance profile collector pods to become ready: 2 2026-05-21T19:57:22.489711582Z Gathering data for ns/openshift-cluster-storage-operator... 2026-05-21T19:57:22.619106647Z Wrote inspect data to must-gather. 2026-05-21T19:57:22.887736357Z Gathering data for ns/openshift-dns-operator... 2026-05-21T19:57:23.245413830Z Gathering data for ns/openshift-dns... 2026-05-21T19:57:23.295170826Z Waiting for performance profile collector pods to become ready: 3 2026-05-21T19:57:23.951006039Z Gathering data for ns/openshift-image-registry... 2026-05-21T19:57:24.426252092Z Waiting for performance profile collector pods to become ready: 4 2026-05-21T19:57:24.572569217Z Gathering data for ns/openshift-ingress-operator... 2026-05-21T19:57:24.973858518Z Gathering data for ns/openshift-ingress... 2026-05-21T19:57:25.555031944Z Waiting for performance profile collector pods to become ready: 5 2026-05-21T19:57:25.874375203Z Gathering data for ns/openshift-ingress-canary... 2026-05-21T19:57:25.933829782Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-05-21T19:57:26.358088111Z Gathering data for ns/openshift-insights... 2026-05-21T19:57:26.675313792Z Waiting for performance profile collector pods to become ready: 6 2026-05-21T19:57:27.782833705Z Waiting for performance profile collector pods to become ready: 7 2026-05-21T19:57:28.417125450Z Gathering data for ns/opendatahub... 2026-05-21T19:57:28.907233056Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-05-21T19:57:29.150079368Z Collecting performance related data for node ip-10-0-143-158.ec2.internal 2026-05-21T19:57:29.156905908Z Collecting performance related data for node ip-10-0-137-59.ec2.internal 2026-05-21T19:57:29.164987625Z Collecting performance related data for node ip-10-0-133-228.ec2.internal 2026-05-21T19:57:30.120158728Z Gathering data for ns/openshift-lws-operator... 2026-05-21T19:57:30.947481949Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-05-21T19:57:31.539268505Z Gathering data for ns/openshift-config... 2026-05-21T19:57:31.992844574Z Gathering data for ns/openshift-config-managed... 2026-05-21T19:57:32.534338941Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-05-21T19:57:32.889215587Z Gathering data for ns/openshift-kube-apiserver... 2026-05-21T19:57:33.272110071Z Gathering data for ns/openshift-kube-controller-manager... 2026-05-21T19:57:33.661841377Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-05-21T19:57:34.038122009Z Gathering data for ns/openshift-kube-scheduler... 2026-05-21T19:57:34.386338648Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-05-21T19:57:34.771645385Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-05-21T19:57:35.167096994Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-05-21T19:57:35.550795827Z Gathering data for ns/openshift-user-workload-monitoring... 2026-05-21T19:57:35.952107625Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-05-21T19:57:36.215602438Z Gathering data for ns/openshift-multus... 2026-05-21T19:57:37.354978042Z Collecting kubelet logs for node ip-10-0-143-158.ec2.internal 2026-05-21T19:57:37.356725142Z Collecting kubelet logs for node ip-10-0-137-59.ec2.internal 2026-05-21T19:57:37.358430239Z Collecting kubelet logs for node ip-10-0-133-228.ec2.internal 2026-05-21T19:57:37.732417638Z daemonset.apps "perf-node-gather-daemonset" deleted 2026-05-21T19:57:37.738324034Z INFO: Node performance data collection complete. 2026-05-21T19:57:37.935076164Z Gathering data for ns/openshift-ovn-kubernetes... 2026-05-21T19:57:39.614355676Z Gathering data for ns/openshift-host-network... 2026-05-21T19:57:39.974561635Z Gathering data for ns/openshift-network-diagnostics... 2026-05-21T19:57:40.565234189Z Gathering data for ns/openshift-network-node-identity... 2026-05-21T19:57:40.958539571Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-05-21T19:57:41.027611761Z Gathering data for ns/openshift-network-operator... 2026-05-21T19:57:41.446235283Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-05-21T19:57:41.753764045Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-05-21T19:57:42.250301479Z Gathering data for ns/openshift-apiserver-operator... 2026-05-21T19:57:42.593412316Z Gathering data for ns/openshift-apiserver... 2026-05-21T19:57:43.132815927Z Gathering data for ns/openshift-controller-manager-operator... 2026-05-21T19:57:43.472883608Z Gathering data for ns/openshift-controller-manager... 2026-05-21T19:57:43.822070032Z Gathering data for ns/openshift-cluster-samples-operator... 2026-05-21T19:57:44.707241120Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-05-21T19:57:45.188925439Z Gathering data for ns/openshift-service-ca-operator... 2026-05-21T19:57:45.571728701Z Gathering data for ns/openshift-service-ca... 2026-05-21T19:57:45.963315578Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-05-21T19:57:46.044415791Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-05-21T19:57:47.209793464Z Wrote inspect data to must-gather. 2026-05-21T19:57:47.209842066Z error: inspection completed with the errors occurred while gathering data: 2026-05-21T19:57:47.209842066Z skipping gathering secrets/support due to error: secrets "support" not found 2026-05-21T19:57:47.348076116Z error: the server doesn't have a resource type "clusters" 2026-05-21T19:57:47.536416836Z Caches written to disk