2026-06-02T19:20:50.697117493Z [disk usage checker] Started 2026-06-02T19:20:50.700671624Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70 2026-06-02T19:20:50.898435868Z Gathering data for ns/openshift-cluster-version... 2026-06-02T19:20:51.029697254Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-06-02T19:20:51.121160473Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-06-02T19:20:51.218640966Z Gathering data for ns/default... 2026-06-02T19:20:51.676061985Z Gathering data for ns/openshift... 2026-06-02T19:20:52.144917847Z Gathering data for ns/kube-system... 2026-06-02T19:20:52.898734987Z Gathering data for ns/openshift-etcd... 2026-06-02T19:20:53.175141364Z Waiting on subprocesses to finish execution. 2026-06-02T19:20:53.182244477Z INFO: Collecting host service logs for crio 2026-06-02T19:20:53.182767458Z INFO: Collecting host service logs for kubelet 2026-06-02T19:20:53.184600665Z INFO: Collecting host service logs for rpm-ostreed 2026-06-02T19:20:53.184948009Z INFO: Collecting host service logs for ostree-finalize-staged 2026-06-02T19:20:53.185282083Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-06-02T19:20:53.185639681Z INFO: Collecting host service logs for machine-config-daemon-host 2026-06-02T19:20:53.185995554Z INFO: Collecting host service logs for NetworkManager 2026-06-02T19:20:53.186417829Z INFO: Collecting host service logs for openvswitch 2026-06-02T19:20:53.186755448Z INFO: Collecting host service logs for ovs-configuration 2026-06-02T19:20:53.187080948Z INFO: Collecting host service logs for ovsdb-server 2026-06-02T19:20:53.187438693Z INFO: Collecting host service logs for ovs-vswitchd 2026-06-02T19:20:53.187783992Z INFO: Waiting for worker host service log collection to complete ... 2026-06-02T19:20:53.197388662Z INFO: Gathering HAProxy config files 2026-06-02T19:20:53.201349409Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-06-02T19:20:53.202551727Z INFO: Waiting for node performance related collection to complete ... 2026-06-02T19:20:53.217440237Z INFO: Gathering machine config daemon's old logs from all nodes 2026-06-02T19:20:53.219007562Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-06-02T19:20:53.654120264Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-06-02T19:20:53.883543783Z Wrote inspect data to must-gather. 2026-06-02T19:20:53.883636361Z error: inspection completed with the errors occurred while gathering data: 2026-06-02T19:20:53.883636361Z namespaces "assisted-installer" not found 2026-06-02T19:20:53.908225556Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-06-02T19:20:53.908299593Z INFO: on-disk MachineConfig config collection complete. 2026-06-02T19:20:54.291903187Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-06-02T19:20:54.400678108Z No resources found 2026-06-02T19:20:54.416080503Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-5hlnl 2026-06-02T19:20:54.416120879Z insights-runtime-extractor-2c74n 2026-06-02T19:20:54.416141335Z insights-runtime-extractor-2lskv 2026-06-02T19:20:54.416161011Z insights-runtime-extractor-zmnsn 2026-06-02T19:20:54.438377919Z INFO: "metallb-operator" not detected. Skipping. 2026-06-02T19:20:54.460301556Z INFO: "sriov-network-operator" not detected. Skipping. 2026-06-02T19:20:54.624346190Z No resources found in openshift-etcd namespace. 2026-06-02T19:20:54.636532704Z error: the server doesn't have a resource type "performanceprofile" 2026-06-02T19:20:54.752467786Z ERROR: No running kube-apiserver pods found 2026-06-02T19:20:54.827161077Z INFO: Worker host service log collection to complete. 2026-06-02T19:20:54.835807782Z INFO: Found 1 replicas - prometheus-k8s-0 2026-06-02T19:20:54.949094839Z Wrote inspect data to must-gather. 2026-06-02T19:20:55.110026832Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-06-02T19:20:55.110026832Z See 'oc rsync -h' for help and examples 2026-06-02T19:20:55.345208122Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-06-02T19:20:55.423292984Z Wrote inspect data to must-gather. 2026-06-02T19:20:55.738865286Z Wrote inspect data to must-gather. 2026-06-02T19:20:55.777453609Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70 2026-06-02T19:20:55.785799032Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-06-02T19:20:55.786469032Z No resources found 2026-06-02T19:20:55.878443915Z INFO: Waiting for HAProxy config collection to complete ... 2026-06-02T19:20:55.949724540Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-06-02T19:20:56.017331247Z Wrote inspect data to must-gather. 2026-06-02T19:20:56.069733376Z Wrote inspect data to must-gather. 2026-06-02T19:20:56.154556796Z INFO: 'previous-logs' folder not found on ip-10-0-137-24.ec2.internal, skipping... 2026-06-02T19:20:56.235853022Z Wrote inspect data to must-gather. 2026-06-02T19:20:56.256909725Z INFO: HAProxy config collection complete. 2026-06-02T19:20:56.332568834Z error: the server doesn't have a resource type "machineconfigs" 2026-06-02T19:20:56.476446211Z Gathering data for ns/kuadrant-system... 2026-06-02T19:20:56.548089706Z INFO: 'previous-logs' folder not found on ip-10-0-138-102.ec2.internal, skipping... 2026-06-02T19:20:56.604770466Z INFO: Getting rules from prometheus-k8s-0 2026-06-02T19:20:56.617760230Z Wrote inspect data to must-gather. 2026-06-02T19:20:56.775255448Z Wrote inspect data to must-gather. 2026-06-02T19:20:56.869120945Z INFO: 'previous-logs' folder not found on ip-10-0-141-177.ec2.internal, skipping... 2026-06-02T19:20:56.869158105Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-06-02T19:20:56.869184608Z INFO: Machine Config Daemon termination log collection complete. 2026-06-02T19:20:57.022495678Z Wrote inspect data to must-gather. 2026-06-02T19:20:57.066409461Z INFO: Getting status/config from prometheus-k8s-0 2026-06-02T19:20:57.128840145Z Wrote inspect data to must-gather. 2026-06-02T19:20:57.368197707Z error: the server doesn't have a resource type "kubeletconfigs" 2026-06-02T19:20:57.413415359Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-06-02T19:20:57.510185853Z Wrote inspect data to must-gather. 2026-06-02T19:20:57.573449521Z INFO: Getting status/flags from prometheus-k8s-0 2026-06-02T19:20:57.760761769Z Wrote inspect data to must-gather. 2026-06-02T19:20:57.851057487Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-06-02T19:20:57.879909205Z INFO: INTERCONNECT MODE 2026-06-02T19:20:57.879993126Z INFO: Gathering ovn-kubernetes DBs 2026-06-02T19:20:57.993399416Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-06-02T19:20:58.113006444Z INFO: Gathering OVN_Northbound from ovnkube-node-4mqnl... 2026-06-02T19:20:58.113254029Z INFO: Gathering OVN_Northbound from ovnkube-node-7ffxc... 2026-06-02T19:20:58.113524840Z INFO: Gathering OVN_Northbound from ovnkube-node-hstll... 2026-06-02T19:20:58.113854679Z INFO: Gathering OVN_Southbound from ovnkube-node-4mqnl... 2026-06-02T19:20:58.114340536Z INFO: Gathering OVN_Southbound from ovnkube-node-7ffxc... 2026-06-02T19:20:58.114638259Z INFO: Gathering OVN_Southbound from ovnkube-node-hstll... 2026-06-02T19:20:58.145329004Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-06-02T19:20:58.249927852Z Wrote inspect data to must-gather. 2026-06-02T19:20:58.311537426Z Gathering data for ns/openshift-monitoring... 2026-06-02T19:20:58.435719242Z tar: Removing leading `/' from member names 2026-06-02T19:20:58.472287784Z tar: Removing leading `/' from member names 2026-06-02T19:20:58.492058578Z tar: Removing leading `/' from member names 2026-06-02T19:20:58.547636197Z tar: Removing leading `/' from member names 2026-06-02T19:20:58.574005108Z tar: Removing leading `/' from member names 2026-06-02T19:20:58.581442957Z tar: Removing leading `/' from member names 2026-06-02T19:20:58.647805455Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-06-02T19:20:58.818969054Z Wrote inspect data to must-gather. 2026-06-02T19:20:59.118619358Z INFO: Getting status from alertmanager-main-0 2026-06-02T19:20:59.196591281Z INFO: Waiting for network log collection to complete ... 2026-06-02T19:20:59.196695421Z INFO: Waiting for ovnk database copies to complete ... 2026-06-02T19:20:59.197200105Z INFO: Copying ovnk databases complete. 2026-06-02T19:20:59.199410392Z 4.1M must-gather/network_logs/ovnk_database_store 2026-06-02T19:20:59.202935795Z ovnk_database_store/ 2026-06-02T19:20:59.202935795Z ovnk_database_store/ovnkube-node-7ffxc_nbdb 2026-06-02T19:20:59.214213813Z ovnk_database_store/ovnkube-node-hstll_sbdb 2026-06-02T19:20:59.242613583Z ovnk_database_store/ovnkube-node-4mqnl_nbdb 2026-06-02T19:20:59.253932125Z ovnk_database_store/ovnkube-node-4mqnl_sbdb 2026-06-02T19:20:59.280564524Z ovnk_database_store/ovnkube-node-hstll_nbdb 2026-06-02T19:20:59.294982656Z ovnk_database_store/ovnkube-node-7ffxc_sbdb 2026-06-02T19:20:59.325802325Z INFO: Network log collection complete. 2026-06-02T19:20:59.359652320Z Wrote inspect data to must-gather. 2026-06-02T19:20:59.720866684Z Wrote inspect data to must-gather. 2026-06-02T19:21:00.052133515Z Wrote inspect data to must-gather. 2026-06-02T19:21:00.487468755Z Wrote inspect data to must-gather. 2026-06-02T19:21:00.597157680Z Gathering data for ns/openshift-network-console... 2026-06-02T19:21:00.768360418Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found 2026-06-02T19:21:00.785025870Z INFO: Fallback to identify the container image from release info 2026-06-02T19:21:00.786865351Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70 2026-06-02T19:21:01.116134277Z Gathering data for ns/openshift-console-operator... 2026-06-02T19:21:01.371177881Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5 2026-06-02T19:21:01.525343665Z daemonset.apps/perf-node-gather-daemonset created 2026-06-02T19:21:01.620467560Z Gathering data for ns/openshift-console... 2026-06-02T19:21:01.679755403Z Waiting for performance profile collector pods to become ready: 1 2026-06-02T19:21:02.275191170Z Gathering data for ns/openshift-cluster-storage-operator... 2026-06-02T19:21:02.712124916Z Gathering data for ns/openshift-dns-operator... 2026-06-02T19:21:02.814505180Z Waiting for performance profile collector pods to become ready: 2 2026-06-02T19:21:02.935261403Z Wrote inspect data to must-gather. 2026-06-02T19:21:03.073133098Z Gathering data for ns/openshift-dns... 2026-06-02T19:21:03.681505833Z Gathering data for ns/openshift-image-registry... 2026-06-02T19:21:03.932471837Z Waiting for performance profile collector pods to become ready: 3 2026-06-02T19:21:04.182643951Z Gathering data for ns/openshift-ingress-operator... 2026-06-02T19:21:04.540386200Z Gathering data for ns/openshift-ingress... 2026-06-02T19:21:05.053586828Z Waiting for performance profile collector pods to become ready: 4 2026-06-02T19:21:05.227387768Z Gathering data for ns/openshift-ingress-canary... 2026-06-02T19:21:05.651819958Z Gathering data for ns/openshift-insights... 2026-06-02T19:21:05.791283531Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70 2026-06-02T19:21:06.170391408Z Waiting for performance profile collector pods to become ready: 5 2026-06-02T19:21:07.291473459Z Waiting for performance profile collector pods to become ready: 6 2026-06-02T19:21:07.834886215Z Gathering data for ns/opendatahub... 2026-06-02T19:21:08.416881539Z Waiting for performance profile collector pods to become ready: 7 2026-06-02T19:21:09.545029730Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-06-02T19:21:09.677996926Z Gathering data for ns/openshift-lws-operator... 2026-06-02T19:21:09.775920759Z Collecting performance related data for node ip-10-0-137-24.ec2.internal 2026-06-02T19:21:09.782913308Z Collecting performance related data for node ip-10-0-141-177.ec2.internal 2026-06-02T19:21:09.790666833Z Collecting performance related data for node ip-10-0-138-102.ec2.internal 2026-06-02T19:21:10.796966982Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70 2026-06-02T19:21:11.592770727Z Gathering data for ns/openshift-config... 2026-06-02T19:21:11.904665570Z Gathering data for ns/openshift-config-managed... 2026-06-02T19:21:12.420415569Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-06-02T19:21:12.771238318Z Gathering data for ns/openshift-kube-apiserver... 2026-06-02T19:21:13.103812779Z Gathering data for ns/openshift-kube-controller-manager... 2026-06-02T19:21:13.453820847Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-06-02T19:21:13.792881238Z Gathering data for ns/openshift-kube-scheduler... 2026-06-02T19:21:14.116224700Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-06-02T19:21:14.522506632Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-06-02T19:21:14.992726690Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-06-02T19:21:15.374621327Z Gathering data for ns/openshift-user-workload-monitoring... 2026-06-02T19:21:15.801492352Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70 2026-06-02T19:21:16.054431610Z Gathering data for ns/openshift-multus... 2026-06-02T19:21:17.499589045Z Gathering data for ns/openshift-ovn-kubernetes... 2026-06-02T19:21:17.833292684Z Collecting kubelet logs for node ip-10-0-137-24.ec2.internal 2026-06-02T19:21:17.834987269Z Collecting kubelet logs for node ip-10-0-141-177.ec2.internal 2026-06-02T19:21:17.836714174Z Collecting kubelet logs for node ip-10-0-138-102.ec2.internal 2026-06-02T19:21:18.189514397Z daemonset.apps "perf-node-gather-daemonset" deleted 2026-06-02T19:21:18.195213040Z INFO: Node performance data collection complete. 2026-06-02T19:21:19.039417992Z Gathering data for ns/openshift-host-network... 2026-06-02T19:21:19.381708345Z Gathering data for ns/openshift-network-diagnostics... 2026-06-02T19:21:19.940928733Z Gathering data for ns/openshift-network-node-identity... 2026-06-02T19:21:20.377725278Z Gathering data for ns/openshift-network-operator... 2026-06-02T19:21:20.774177681Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-06-02T19:21:20.808605748Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70 2026-06-02T19:21:21.066606917Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-06-02T19:21:21.575770107Z Gathering data for ns/openshift-apiserver-operator... 2026-06-02T19:21:21.926043524Z Gathering data for ns/openshift-apiserver... 2026-06-02T19:21:22.373578839Z Gathering data for ns/openshift-controller-manager-operator... 2026-06-02T19:21:22.702128445Z Gathering data for ns/openshift-controller-manager... 2026-06-02T19:21:22.997421937Z Gathering data for ns/openshift-cluster-samples-operator... 2026-06-02T19:21:23.707533002Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-06-02T19:21:24.022294593Z Gathering data for ns/openshift-service-ca-operator... 2026-06-02T19:21:24.350961076Z Gathering data for ns/openshift-service-ca... 2026-06-02T19:21:24.782184876Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-06-02T19:21:25.813260412Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70 2026-06-02T19:21:25.826405386Z Wrote inspect data to must-gather. 2026-06-02T19:21:25.826436925Z error: inspection completed with the errors occurred while gathering data: 2026-06-02T19:21:25.826436925Z skipping gathering secrets/support due to error: secrets "support" not found 2026-06-02T19:21:25.957980571Z error: the server doesn't have a resource type "clusters" 2026-06-02T19:21:26.593217777Z Caches written to disk