2026-04-24T16:54:30.065406419Z [disk usage checker] Started 2026-04-24T16:54:30.068787312Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-04-24T16:54:30.276633969Z Gathering data for ns/openshift-cluster-version... 2026-04-24T16:54:30.416251336Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-04-24T16:54:30.504931485Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-04-24T16:54:30.583286700Z Gathering data for ns/default... 2026-04-24T16:54:30.902976384Z Gathering data for ns/openshift... 2026-04-24T16:54:31.357442736Z Gathering data for ns/kube-system... 2026-04-24T16:54:32.070423792Z Gathering data for ns/openshift-etcd... 2026-04-24T16:54:32.400249738Z Wrote inspect data to must-gather. 2026-04-24T16:54:32.400283459Z error: inspection completed with the errors occurred while gathering data: 2026-04-24T16:54:32.400283459Z namespaces "assisted-installer" not found 2026-04-24T16:54:32.478889629Z Waiting on subprocesses to finish execution. 2026-04-24T16:54:32.486149474Z INFO: Gathering machine config daemon's old logs from all nodes 2026-04-24T16:54:32.499057622Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-04-24T16:54:32.507087195Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-04-24T16:54:32.514189705Z INFO: Waiting for node performance related collection to complete ... 2026-04-24T16:54:32.519533859Z INFO: Gathering HAProxy config files 2026-04-24T16:54:32.569275466Z INFO: Collecting host service logs for crio 2026-04-24T16:54:32.569685534Z INFO: Collecting host service logs for kubelet 2026-04-24T16:54:32.570048377Z INFO: Collecting host service logs for rpm-ostreed 2026-04-24T16:54:32.570410789Z INFO: Collecting host service logs for ostree-finalize-staged 2026-04-24T16:54:32.570947371Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-04-24T16:54:32.571342475Z INFO: Collecting host service logs for machine-config-daemon-host 2026-04-24T16:54:32.571692143Z INFO: Collecting host service logs for NetworkManager 2026-04-24T16:54:32.572046758Z INFO: Collecting host service logs for openvswitch 2026-04-24T16:54:32.572406625Z INFO: Collecting host service logs for ovs-configuration 2026-04-24T16:54:32.572755261Z INFO: Collecting host service logs for ovsdb-server 2026-04-24T16:54:32.573208820Z INFO: Collecting host service logs for ovs-vswitchd 2026-04-24T16:54:32.573656751Z INFO: Waiting for worker host service log collection to complete ... 2026-04-24T16:54:32.784743179Z INFO: "metallb-operator" not detected. Skipping. 2026-04-24T16:54:33.353510605Z Wrote inspect data to must-gather. 2026-04-24T16:54:33.392557702Z INFO: "sriov-network-operator" not detected. Skipping. 2026-04-24T16:54:33.637841557Z No resources found in openshift-etcd namespace. 2026-04-24T16:54:33.663211203Z INFO: Collecting Insights Archives from insights-operator-585dfdc468-jltdt 2026-04-24T16:54:33.663272197Z insights-runtime-extractor-9rqvf 2026-04-24T16:54:33.663302840Z insights-runtime-extractor-9sq68 2026-04-24T16:54:33.663334233Z insights-runtime-extractor-hbhwf 2026-04-24T16:54:33.717031075Z INFO: Found 1 replicas - prometheus-k8s-0 2026-04-24T16:54:33.793908140Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-04-24T16:54:33.797301088Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-04-24T16:54:33.797328433Z INFO: on-disk MachineConfig config collection complete. 2026-04-24T16:54:34.002422150Z error: the server doesn't have a resource type "performanceprofile" 2026-04-24T16:54:34.010259065Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-04-24T16:54:34.158709154Z No resources found 2026-04-24T16:54:34.180605000Z INFO: Worker host service log collection to complete. 2026-04-24T16:54:34.250533188Z Wrote inspect data to must-gather. 2026-04-24T16:54:34.283913277Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-04-24T16:54:34.419156390Z INFO: 'previous-logs' folder not found on ip-10-0-129-204.ec2.internal, skipping... 2026-04-24T16:54:34.509155769Z INFO: Waiting for HAProxy config collection to complete ... 2026-04-24T16:54:34.554706370Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-04-24T16:54:34.585353135Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-04-24T16:54:34.585353135Z See 'oc rsync -h' for help and examples 2026-04-24T16:54:34.605697844Z No resources found 2026-04-24T16:54:34.661412021Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-04-24T16:54:34.755419345Z Wrote inspect data to must-gather. 2026-04-24T16:54:34.764751992Z ERROR: No running kube-apiserver pods found 2026-04-24T16:54:34.841968447Z Wrote inspect data to must-gather. 2026-04-24T16:54:34.844849032Z Gathering data for ns/openshift-monitoring... 2026-04-24T16:54:34.845380689Z Wrote inspect data to must-gather. 2026-04-24T16:54:34.852737383Z Wrote inspect data to must-gather. 2026-04-24T16:54:34.905439764Z Wrote inspect data to must-gather. 2026-04-24T16:54:34.988556815Z INFO: 'previous-logs' folder not found on ip-10-0-137-83.ec2.internal, skipping... 2026-04-24T16:54:34.991573497Z tar: Removing leading `/' from member names 2026-04-24T16:54:34.996370477Z INFO: HAProxy config collection complete. 2026-04-24T16:54:35.042859545Z error: the server doesn't have a resource type "machineconfigs" 2026-04-24T16:54:35.077358199Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-04-24T16:54:35.119472588Z Wrote inspect data to must-gather. 2026-04-24T16:54:35.170737180Z INFO: Getting rules from prometheus-k8s-0 2026-04-24T16:54:35.279181305Z INFO: 'previous-logs' folder not found on ip-10-0-143-144.ec2.internal, skipping... 2026-04-24T16:54:35.279213095Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-04-24T16:54:35.279251562Z INFO: Machine Config Daemon termination log collection complete. 2026-04-24T16:54:35.296071364Z Wrote inspect data to must-gather. 2026-04-24T16:54:35.383614947Z Wrote inspect data to must-gather. 2026-04-24T16:54:35.509402583Z Wrote inspect data to must-gather. 2026-04-24T16:54:35.577737897Z INFO: Getting status/config from prometheus-k8s-0 2026-04-24T16:54:35.639397263Z Wrote inspect data to must-gather. 2026-04-24T16:54:35.672942018Z error: the server doesn't have a resource type "kubeletconfigs" 2026-04-24T16:54:35.880008858Z Wrote inspect data to must-gather. 2026-04-24T16:54:35.926543493Z INFO: INTERCONNECT MODE 2026-04-24T16:54:35.926632536Z INFO: Gathering ovn-kubernetes DBs 2026-04-24T16:54:35.989934815Z INFO: Getting status/flags from prometheus-k8s-0 2026-04-24T16:54:36.102937670Z Wrote inspect data to must-gather. 2026-04-24T16:54:36.118736180Z INFO: Gathering OVN_Northbound from ovnkube-node-9d4p6... 2026-04-24T16:54:36.119062757Z INFO: Gathering OVN_Northbound from ovnkube-node-gtxl5... 2026-04-24T16:54:36.119397009Z INFO: Gathering OVN_Northbound from ovnkube-node-m22zz... 2026-04-24T16:54:36.119716299Z INFO: Gathering OVN_Southbound from ovnkube-node-9d4p6... 2026-04-24T16:54:36.120150262Z INFO: Gathering OVN_Southbound from ovnkube-node-gtxl5... 2026-04-24T16:54:36.120469648Z INFO: Gathering OVN_Southbound from ovnkube-node-m22zz... 2026-04-24T16:54:36.259845872Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-04-24T16:54:36.377941950Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-04-24T16:54:36.414721108Z tar: Removing leading `/' from member names 2026-04-24T16:54:36.428818859Z tar: Removing leading `/' from member names 2026-04-24T16:54:36.430890306Z Wrote inspect data to must-gather. 2026-04-24T16:54:36.434747088Z tar: Removing leading `/' from member names 2026-04-24T16:54:36.460706771Z tar: Removing leading `/' from member names 2026-04-24T16:54:36.483601192Z tar: Removing leading `/' from member names 2026-04-24T16:54:36.485216602Z tar: Removing leading `/' from member names 2026-04-24T16:54:36.584691399Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-04-24T16:54:36.675050018Z Wrote inspect data to must-gather. 2026-04-24T16:54:36.854671804Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-04-24T16:54:36.913435205Z W0424 16:54:36.913382 1361 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' 2026-04-24T16:54:36.921953443Z Wrote inspect data to must-gather. 2026-04-24T16:54:36.926366787Z INFO: Waiting for network log collection to complete ... 2026-04-24T16:54:36.926421324Z INFO: Waiting for ovnk database copies to complete ... 2026-04-24T16:54:36.926908644Z INFO: Copying ovnk databases complete. 2026-04-24T16:54:36.928624168Z 2.8M must-gather/network_logs/ovnk_database_store 2026-04-24T16:54:36.931256309Z ovnk_database_store/ 2026-04-24T16:54:36.931256309Z ovnk_database_store/ovnkube-node-m22zz_nbdb 2026-04-24T16:54:36.942876201Z ovnk_database_store/ovnkube-node-gtxl5_sbdb 2026-04-24T16:54:36.964215786Z ovnk_database_store/ovnkube-node-gtxl5_nbdb 2026-04-24T16:54:36.971347851Z ovnk_database_store/ovnkube-node-m22zz_sbdb 2026-04-24T16:54:36.985869279Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-04-24T16:54:36.989537462Z ovnk_database_store/ovnkube-node-9d4p6_sbdb 2026-04-24T16:54:37.005225692Z ovnk_database_store/ovnkube-node-9d4p6_nbdb 2026-04-24T16:54:37.013015465Z INFO: Network log collection complete. 2026-04-24T16:54:37.149521506Z Gathering data for ns/openshift-network-console... 2026-04-24T16:54:37.216609080Z Wrote inspect data to must-gather. 2026-04-24T16:54:37.252049136Z INFO: Getting status from alertmanager-main-0 2026-04-24T16:54:37.516007522Z Wrote inspect data to must-gather. 2026-04-24T16:54:37.571355069Z Gathering data for ns/openshift-console-operator... 2026-04-24T16:54:37.780824082Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found 2026-04-24T16:54:37.783004156Z INFO: Fallback to identify the container image from release info 2026-04-24T16:54:37.954550902Z Gathering data for ns/openshift-console... 2026-04-24T16:54:38.403357697Z Gathering data for ns/openshift-cluster-storage-operator... 2026-04-24T16:54:38.426810388Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f2123db9953f98da0e43c266e6a8a070bf221533b995f87b7e358cc7498ca6d 2026-04-24T16:54:38.557218682Z daemonset.apps/perf-node-gather-daemonset created 2026-04-24T16:54:38.697125038Z Waiting for performance profile collector pods to become ready: 1 2026-04-24T16:54:38.769909983Z Gathering data for ns/openshift-dns-operator... 2026-04-24T16:54:39.076970011Z Gathering data for ns/openshift-dns... 2026-04-24T16:54:39.649627420Z Gathering data for ns/openshift-image-registry... 2026-04-24T16:54:39.804859848Z Waiting for performance profile collector pods to become ready: 2 2026-04-24T16:54:40.082452802Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-04-24T16:54:40.913434956Z Waiting for performance profile collector pods to become ready: 3 2026-04-24T16:54:42.020360225Z Waiting for performance profile collector pods to become ready: 4 2026-04-24T16:54:43.129290250Z Waiting for performance profile collector pods to become ready: 5 2026-04-24T16:54:44.237241453Z Waiting for performance profile collector pods to become ready: 6 2026-04-24T16:54:45.087070648Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-04-24T16:54:45.347664703Z Waiting for performance profile collector pods to become ready: 7 2026-04-24T16:54:46.455231870Z Waiting for performance profile collector pods to become ready: 8 2026-04-24T16:54:47.570449016Z Waiting for performance profile collector pods to become ready: 9 2026-04-24T16:54:48.678694228Z Waiting for performance profile collector pods to become ready: 10 2026-04-24T16:54:49.786436618Z Waiting for performance profile collector pods to become ready: 11 2026-04-24T16:54:50.091770316Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-04-24T16:54:50.897417276Z Waiting for performance profile collector pods to become ready: 12 2026-04-24T16:54:52.009569858Z Waiting for performance profile collector pods to become ready: 13 2026-04-24T16:54:53.134755990Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-04-24T16:54:53.425035211Z Collecting performance related data for node ip-10-0-137-83.ec2.internal 2026-04-24T16:54:53.434077365Z Collecting performance related data for node ip-10-0-129-204.ec2.internal 2026-04-24T16:54:53.443748660Z Collecting performance related data for node ip-10-0-143-144.ec2.internal 2026-04-24T16:54:53.510258829Z Gathering data for ns/openshift-ingress-operator... 2026-04-24T16:54:53.929288907Z Gathering data for ns/openshift-ingress... 2026-04-24T16:54:54.334977850Z Gathering data for ns/openshift-ingress-canary... 2026-04-24T16:54:54.820647185Z Gathering data for ns/openshift-insights... 2026-04-24T16:54:55.096392599Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-04-24T16:54:57.023861124Z Gathering data for ns/kserve... 2026-04-24T16:54:58.296707346Z Gathering data for ns/openshift-config... 2026-04-24T16:54:58.555649758Z Gathering data for ns/openshift-config-managed... 2026-04-24T16:54:58.974077081Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-04-24T16:54:59.247673599Z Gathering data for ns/openshift-kube-apiserver... 2026-04-24T16:54:59.507359234Z Gathering data for ns/openshift-kube-controller-manager... 2026-04-24T16:54:59.790730184Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-04-24T16:55:00.067275073Z Gathering data for ns/openshift-kube-scheduler... 2026-04-24T16:55:00.105734656Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-04-24T16:55:00.361128600Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-04-24T16:55:00.627901086Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-04-24T16:55:00.982630602Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-04-24T16:55:01.296063372Z Gathering data for ns/openshift-user-workload-monitoring... 2026-04-24T16:55:01.730893918Z Collecting kubelet logs for node ip-10-0-137-83.ec2.internal 2026-04-24T16:55:01.732759143Z Collecting kubelet logs for node ip-10-0-129-204.ec2.internal 2026-04-24T16:55:01.734986768Z Collecting kubelet logs for node ip-10-0-143-144.ec2.internal 2026-04-24T16:55:01.864316046Z Gathering data for ns/openshift-multus... 2026-04-24T16:55:02.076467253Z daemonset.apps "perf-node-gather-daemonset" deleted 2026-04-24T16:55:02.081082184Z INFO: Node performance data collection complete. 2026-04-24T16:55:03.238457187Z Gathering data for ns/openshift-ovn-kubernetes... 2026-04-24T16:55:04.574762952Z Gathering data for ns/openshift-host-network... 2026-04-24T16:55:04.893140007Z Gathering data for ns/openshift-network-diagnostics... 2026-04-24T16:55:05.110998865Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-04-24T16:55:05.375624418Z Gathering data for ns/openshift-network-node-identity... 2026-04-24T16:55:05.752993443Z Gathering data for ns/openshift-network-operator... 2026-04-24T16:55:06.097156338Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-04-24T16:55:06.344380321Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-04-24T16:55:06.754747830Z Gathering data for ns/openshift-apiserver-operator... 2026-04-24T16:55:07.031213575Z Gathering data for ns/openshift-apiserver... 2026-04-24T16:55:07.434913395Z Gathering data for ns/openshift-controller-manager-operator... 2026-04-24T16:55:07.681205615Z Gathering data for ns/openshift-controller-manager... 2026-04-24T16:55:07.978684533Z Gathering data for ns/openshift-cluster-samples-operator... 2026-04-24T16:55:08.580840048Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-04-24T16:55:08.851893856Z Gathering data for ns/openshift-service-ca-operator... 2026-04-24T16:55:09.183325355Z Gathering data for ns/openshift-service-ca... 2026-04-24T16:55:09.599722340Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-04-24T16:55:10.115740536Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-04-24T16:55:15.120424957Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-04-24T16:55:20.125194705Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-04-24T16:55:23.623439224Z Wrote inspect data to must-gather. 2026-04-24T16:55:23.623482907Z error: inspection completed with the errors occurred while gathering data: 2026-04-24T16:55:23.623482907Z skipping gathering secrets/support due to error: secrets "support" not found 2026-04-24T16:55:23.755031412Z error: the server doesn't have a resource type "clusters" 2026-04-24T16:55:23.900494793Z Caches written to disk