2026-05-20T15:53:41.980539058Z [disk usage checker] Started 2026-05-20T15:53:41.984258603Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-05-20T15:53:42.210393935Z Gathering data for ns/openshift-cluster-version... 2026-05-20T15:53:42.350040304Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-05-20T15:53:42.441858807Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-05-20T15:53:42.526489664Z Gathering data for ns/default... 2026-05-20T15:53:42.859007626Z Gathering data for ns/openshift... 2026-05-20T15:53:43.298840802Z Gathering data for ns/kube-system... 2026-05-20T15:53:44.016694729Z Gathering data for ns/openshift-etcd... 2026-05-20T15:53:44.328025632Z Wrote inspect data to must-gather. 2026-05-20T15:53:44.328054571Z error: inspection completed with the errors occurred while gathering data: 2026-05-20T15:53:44.328054571Z namespaces "assisted-installer" not found 2026-05-20T15:53:44.482092013Z Waiting on subprocesses to finish execution. 2026-05-20T15:53:44.488851081Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-05-20T15:53:44.490020606Z INFO: Gathering HAProxy config files 2026-05-20T15:53:44.491701666Z INFO: Gathering machine config daemon's old logs from all nodes 2026-05-20T15:53:44.502847988Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-05-20T15:53:44.505655133Z INFO: Collecting host service logs for crio 2026-05-20T15:53:44.506028986Z INFO: Collecting host service logs for kubelet 2026-05-20T15:53:44.506410432Z INFO: Collecting host service logs for rpm-ostreed 2026-05-20T15:53:44.506752802Z INFO: Collecting host service logs for ostree-finalize-staged 2026-05-20T15:53:44.507090903Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-05-20T15:53:44.507446053Z INFO: Collecting host service logs for machine-config-daemon-host 2026-05-20T15:53:44.507773726Z INFO: Collecting host service logs for NetworkManager 2026-05-20T15:53:44.508182030Z INFO: Collecting host service logs for openvswitch 2026-05-20T15:53:44.508565630Z INFO: Collecting host service logs for ovs-configuration 2026-05-20T15:53:44.508875696Z INFO: Collecting host service logs for ovsdb-server 2026-05-20T15:53:44.509175981Z INFO: Collecting host service logs for ovs-vswitchd 2026-05-20T15:53:44.509547091Z INFO: Waiting for worker host service log collection to complete ... 2026-05-20T15:53:44.545979636Z INFO: Waiting for node performance related collection to complete ... 2026-05-20T15:53:45.248287981Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-05-20T15:53:45.373462783Z Wrote inspect data to must-gather. 2026-05-20T15:53:45.402023748Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-05-20T15:53:45.402102997Z INFO: on-disk MachineConfig config collection complete. 2026-05-20T15:53:45.413061673Z error: the server doesn't have a resource type "performanceprofile" 2026-05-20T15:53:45.650386240Z INFO: "metallb-operator" not detected. Skipping. 2026-05-20T15:53:45.683306205Z INFO: "sriov-network-operator" not detected. Skipping. 2026-05-20T15:53:45.685805060Z No resources found 2026-05-20T15:53:45.687579235Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-05-20T15:53:45.790776342Z INFO: Found 1 replicas - prometheus-k8s-0 2026-05-20T15:53:45.855647117Z ERROR: No running kube-apiserver pods found 2026-05-20T15:53:45.888537544Z INFO: Collecting Insights Archives from insights-operator-78bdfb888c-6qjn4 2026-05-20T15:53:45.888537544Z insights-runtime-extractor-67sdj 2026-05-20T15:53:45.888537544Z insights-runtime-extractor-kx27r 2026-05-20T15:53:45.888537544Z insights-runtime-extractor-xls2d 2026-05-20T15:53:45.926036599Z INFO: Worker host service log collection to complete. 2026-05-20T15:53:46.057944857Z No resources found in openshift-etcd namespace. 2026-05-20T15:53:46.239556278Z INFO: Waiting for HAProxy config collection to complete ... 2026-05-20T15:53:46.294893949Z Wrote inspect data to must-gather. 2026-05-20T15:53:46.524741811Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-05-20T15:53:46.554358651Z INFO: 'previous-logs' folder not found on ip-10-0-137-255.ec2.internal, skipping... 2026-05-20T15:53:46.560354561Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-05-20T15:53:46.587763356Z Wrote inspect data to must-gather. 2026-05-20T15:53:46.720193810Z Wrote inspect data to must-gather. 2026-05-20T15:53:46.759941829Z No resources found 2026-05-20T15:53:46.777823305Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-05-20T15:53:46.777823305Z See 'oc rsync -h' for help and examples 2026-05-20T15:53:46.866754608Z error: the server doesn't have a resource type "machineconfigs" 2026-05-20T15:53:46.939536874Z Wrote inspect data to must-gather. 2026-05-20T15:53:46.985279422Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-05-20T15:53:46.986005895Z Wrote inspect data to must-gather. 2026-05-20T15:53:46.996619750Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-05-20T15:53:47.062825407Z tar: Removing leading `/' from member names 2026-05-20T15:53:47.069482231Z INFO: HAProxy config collection complete. 2026-05-20T15:53:47.082400909Z Wrote inspect data to must-gather. 2026-05-20T15:53:47.150952904Z INFO: 'previous-logs' folder not found on ip-10-0-137-63.ec2.internal, skipping... 2026-05-20T15:53:47.202755621Z Wrote inspect data to must-gather. 2026-05-20T15:53:47.226802478Z Wrote inspect data to must-gather. 2026-05-20T15:53:47.266557159Z INFO: Getting rules from prometheus-k8s-0 2026-05-20T15:53:47.282174810Z Gathering data for ns/openshift-monitoring... 2026-05-20T15:53:47.479979629Z Wrote inspect data to must-gather. 2026-05-20T15:53:47.491484608Z INFO: 'previous-logs' folder not found on ip-10-0-140-154.ec2.internal, skipping... 2026-05-20T15:53:47.491618048Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-05-20T15:53:47.491697103Z INFO: Machine Config Daemon termination log collection complete. 2026-05-20T15:53:47.537813789Z Wrote inspect data to must-gather. 2026-05-20T15:53:47.653385492Z error: the server doesn't have a resource type "kubeletconfigs" 2026-05-20T15:53:47.741670732Z INFO: Getting status/config from prometheus-k8s-0 2026-05-20T15:53:47.819662209Z Wrote inspect data to must-gather. 2026-05-20T15:53:47.904099280Z Wrote inspect data to must-gather. 2026-05-20T15:53:48.124837857Z INFO: INTERCONNECT MODE 2026-05-20T15:53:48.124880450Z INFO: Gathering ovn-kubernetes DBs 2026-05-20T15:53:48.128495351Z Wrote inspect data to must-gather. 2026-05-20T15:53:48.180284247Z INFO: Getting status/flags from prometheus-k8s-0 2026-05-20T15:53:48.307625372Z INFO: Gathering OVN_Northbound from ovnkube-node-cw6k2... 2026-05-20T15:53:48.307895569Z INFO: Gathering OVN_Northbound from ovnkube-node-dr82c... 2026-05-20T15:53:48.308117106Z INFO: Gathering OVN_Northbound from ovnkube-node-nb5vs... 2026-05-20T15:53:48.308430885Z INFO: Gathering OVN_Southbound from ovnkube-node-cw6k2... 2026-05-20T15:53:48.308699104Z INFO: Gathering OVN_Southbound from ovnkube-node-dr82c... 2026-05-20T15:53:48.308923826Z INFO: Gathering OVN_Southbound from ovnkube-node-nb5vs... 2026-05-20T15:53:48.404551771Z Wrote inspect data to must-gather. 2026-05-20T15:53:48.507894207Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-05-20T15:53:48.611742853Z tar: Removing leading `/' from member names 2026-05-20T15:53:48.640911923Z tar: Removing leading `/' from member names 2026-05-20T15:53:48.655524584Z tar: Removing leading `/' from member names 2026-05-20T15:53:48.657200372Z tar: Removing leading `/' from member names 2026-05-20T15:53:48.692185130Z tar: Removing leading `/' from member names 2026-05-20T15:53:48.692289802Z tar: Removing leading `/' from member names 2026-05-20T15:53:48.732219064Z Wrote inspect data to must-gather. 2026-05-20T15:53:48.817647572Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-05-20T15:53:48.964766399Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-05-20T15:53:48.995604952Z Wrote inspect data to must-gather. 2026-05-20T15:53:49.113409777Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-05-20T15:53:49.207138711Z INFO: Waiting for network log collection to complete ... 2026-05-20T15:53:49.207256491Z INFO: Waiting for ovnk database copies to complete ... 2026-05-20T15:53:49.207796319Z INFO: Copying ovnk databases complete. 2026-05-20T15:53:49.210024598Z 3.3M must-gather/network_logs/ovnk_database_store 2026-05-20T15:53:49.212957242Z ovnk_database_store/ 2026-05-20T15:53:49.212957242Z ovnk_database_store/ovnkube-node-dr82c_sbdb 2026-05-20T15:53:49.233874811Z ovnk_database_store/ovnkube-node-dr82c_nbdb 2026-05-20T15:53:49.237054425Z Wrote inspect data to must-gather. 2026-05-20T15:53:49.243303255Z ovnk_database_store/ovnkube-node-cw6k2_sbdb 2026-05-20T15:53:49.267196911Z ovnk_database_store/ovnkube-node-cw6k2_nbdb 2026-05-20T15:53:49.277453123Z ovnk_database_store/ovnkube-node-nb5vs_nbdb 2026-05-20T15:53:49.285092695Z ovnk_database_store/ovnkube-node-nb5vs_sbdb 2026-05-20T15:53:49.303932027Z INFO: Network log collection complete. 2026-05-20T15:53:49.470705611Z Wrote inspect data to must-gather. 2026-05-20T15:53:49.536019748Z INFO: Getting status from alertmanager-main-0 2026-05-20T15:53:49.596071816Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-05-20T15:53:49.775530421Z Gathering data for ns/openshift-network-console... 2026-05-20T15:53:49.778912512Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found 2026-05-20T15:53:49.781143754Z INFO: Fallback to identify the container image from release info 2026-05-20T15:53:50.196782588Z Gathering data for ns/openshift-console-operator... 2026-05-20T15:53:50.366396158Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:934b226bb305ecfe687cdb9684d7d4cf04b130e6254c2817dd1a6112d4829bda 2026-05-20T15:53:50.509907466Z daemonset.apps/perf-node-gather-daemonset created 2026-05-20T15:53:50.592958958Z Gathering data for ns/openshift-console... 2026-05-20T15:53:50.650879357Z Waiting for performance profile collector pods to become ready: 1 2026-05-20T15:53:51.058277133Z Gathering data for ns/openshift-cluster-storage-operator... 2026-05-20T15:53:51.424936383Z Gathering data for ns/openshift-dns-operator... 2026-05-20T15:53:51.779327260Z Gathering data for ns/openshift-dns... 2026-05-20T15:53:51.786003391Z Waiting for performance profile collector pods to become ready: 2 2026-05-20T15:53:52.001958145Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-05-20T15:53:52.382428999Z Gathering data for ns/openshift-image-registry... 2026-05-20T15:53:52.846610169Z Gathering data for ns/openshift-ingress-operator... 2026-05-20T15:53:52.927540808Z Waiting for performance profile collector pods to become ready: 3 2026-05-20T15:53:53.197286199Z Gathering data for ns/openshift-ingress... 2026-05-20T15:53:53.535972880Z Gathering data for ns/openshift-ingress-canary... 2026-05-20T15:53:53.928672923Z Gathering data for ns/openshift-insights... 2026-05-20T15:53:54.043248659Z Waiting for performance profile collector pods to become ready: 4 2026-05-20T15:53:55.173670443Z Waiting for performance profile collector pods to become ready: 5 2026-05-20T15:53:56.113308800Z Gathering data for ns/kserve... 2026-05-20T15:53:56.308431936Z Waiting for performance profile collector pods to become ready: 6 2026-05-20T15:53:57.006256302Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-05-20T15:53:57.438453771Z Waiting for performance profile collector pods to become ready: 7 2026-05-20T15:53:57.620755576Z Gathering data for ns/openshift-config... 2026-05-20T15:53:57.960441107Z Gathering data for ns/openshift-config-managed... 2026-05-20T15:53:58.433507460Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-05-20T15:53:58.577883157Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-05-20T15:53:58.746133604Z Gathering data for ns/openshift-kube-apiserver... 2026-05-20T15:53:58.879920262Z Collecting performance related data for node ip-10-0-137-255.ec2.internal 2026-05-20T15:53:58.887491246Z Collecting performance related data for node ip-10-0-137-63.ec2.internal 2026-05-20T15:53:58.894853456Z Collecting performance related data for node ip-10-0-140-154.ec2.internal 2026-05-20T15:53:59.094296862Z Gathering data for ns/openshift-kube-controller-manager... 2026-05-20T15:53:59.445070082Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-05-20T15:53:59.854333815Z Gathering data for ns/openshift-kube-scheduler... 2026-05-20T15:54:00.207539143Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-05-20T15:54:00.632706546Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-05-20T15:54:00.994300509Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-05-20T15:54:01.358663336Z Gathering data for ns/openshift-user-workload-monitoring... 2026-05-20T15:54:02.001859222Z Gathering data for ns/openshift-multus... 2026-05-20T15:54:02.011025091Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-05-20T15:54:03.556412880Z Gathering data for ns/openshift-ovn-kubernetes... 2026-05-20T15:54:05.243512987Z Gathering data for ns/openshift-host-network... 2026-05-20T15:54:05.576617156Z Gathering data for ns/openshift-network-diagnostics... 2026-05-20T15:54:06.179511124Z Gathering data for ns/openshift-network-node-identity... 2026-05-20T15:54:06.667935864Z Gathering data for ns/openshift-network-operator... 2026-05-20T15:54:07.016794650Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-05-20T15:54:07.335895445Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-05-20T15:54:07.647971938Z Collecting kubelet logs for node ip-10-0-137-255.ec2.internal 2026-05-20T15:54:07.650196047Z Collecting kubelet logs for node ip-10-0-137-63.ec2.internal 2026-05-20T15:54:07.652258276Z Collecting kubelet logs for node ip-10-0-140-154.ec2.internal 2026-05-20T15:54:07.685831224Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-05-20T15:54:08.064184391Z daemonset.apps "perf-node-gather-daemonset" deleted 2026-05-20T15:54:08.069466654Z INFO: Node performance data collection complete. 2026-05-20T15:54:08.252689217Z Gathering data for ns/openshift-apiserver-operator... 2026-05-20T15:54:08.582171238Z Gathering data for ns/openshift-apiserver... 2026-05-20T15:54:09.033136664Z Gathering data for ns/openshift-controller-manager-operator... 2026-05-20T15:54:09.366009035Z Gathering data for ns/openshift-controller-manager... 2026-05-20T15:54:09.678619910Z Gathering data for ns/openshift-cluster-samples-operator... 2026-05-20T15:54:10.374645119Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-05-20T15:54:10.694606593Z Gathering data for ns/openshift-service-ca-operator... 2026-05-20T15:54:11.051623414Z Gathering data for ns/openshift-service-ca... 2026-05-20T15:54:11.451458628Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-05-20T15:54:12.021715798Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-05-20T15:54:12.458039711Z Wrote inspect data to must-gather. 2026-05-20T15:54:12.458085042Z error: inspection completed with the errors occurred while gathering data: 2026-05-20T15:54:12.458085042Z skipping gathering secrets/support due to error: secrets "support" not found 2026-05-20T15:54:12.590484642Z error: the server doesn't have a resource type "clusters" 2026-05-20T15:54:12.731942083Z Caches written to disk