2026-06-02T15:02:54.424608248Z [disk usage checker] Started 2026-06-02T15:02:54.428222056Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-06-02T15:02:54.625700930Z Gathering data for ns/openshift-cluster-version... 2026-06-02T15:02:54.771114931Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-06-02T15:02:54.866979735Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-06-02T15:02:54.950084169Z Gathering data for ns/default... 2026-06-02T15:02:55.278313911Z Gathering data for ns/openshift... 2026-06-02T15:02:55.701826292Z Gathering data for ns/kube-system... 2026-06-02T15:02:56.436765509Z Gathering data for ns/openshift-etcd... 2026-06-02T15:02:56.682787255Z Waiting on subprocesses to finish execution. 2026-06-02T15:02:56.696112435Z INFO: Gathering machine config daemon's old logs from all nodes 2026-06-02T15:02:56.702615957Z INFO: Gathering HAProxy config files 2026-06-02T15:02:56.703467737Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-06-02T15:02:56.705552095Z INFO: Collecting host service logs for crio 2026-06-02T15:02:56.705954952Z INFO: Collecting host service logs for kubelet 2026-06-02T15:02:56.706517147Z INFO: Collecting host service logs for rpm-ostreed 2026-06-02T15:02:56.706902193Z INFO: Collecting host service logs for ostree-finalize-staged 2026-06-02T15:02:56.707273861Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-06-02T15:02:56.707662296Z INFO: Collecting host service logs for machine-config-daemon-host 2026-06-02T15:02:56.708022417Z INFO: Collecting host service logs for NetworkManager 2026-06-02T15:02:56.708403322Z INFO: Collecting host service logs for openvswitch 2026-06-02T15:02:56.710387716Z INFO: Collecting host service logs for ovs-configuration 2026-06-02T15:02:56.710774924Z INFO: Collecting host service logs for ovsdb-server 2026-06-02T15:02:56.711133732Z INFO: Collecting host service logs for ovs-vswitchd 2026-06-02T15:02:56.711591805Z INFO: Waiting for worker host service log collection to complete ... 2026-06-02T15:02:56.727904171Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-06-02T15:02:56.787160720Z INFO: Waiting for node performance related collection to complete ... 2026-06-02T15:02:57.320697519Z Wrote inspect data to must-gather. 2026-06-02T15:02:57.320800342Z error: inspection completed with the errors occurred while gathering data: 2026-06-02T15:02:57.320800342Z namespaces "assisted-installer" not found 2026-06-02T15:02:57.413976478Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-cvtsm 2026-06-02T15:02:57.414043721Z insights-runtime-extractor-bfjp8 2026-06-02T15:02:57.414066041Z insights-runtime-extractor-vm4r6 2026-06-02T15:02:57.414087667Z insights-runtime-extractor-z6k7p 2026-06-02T15:02:57.563369327Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-06-02T15:02:57.563467968Z INFO: on-disk MachineConfig config collection complete. 2026-06-02T15:02:57.572554258Z No resources found in openshift-etcd namespace. 2026-06-02T15:02:57.585031336Z No resources found 2026-06-02T15:02:57.669856234Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-06-02T15:02:57.699158833Z INFO: Found 1 replicas - prometheus-k8s-0 2026-06-02T15:02:57.719380914Z INFO: "sriov-network-operator" not detected. Skipping. 2026-06-02T15:02:57.834392237Z error: the server doesn't have a resource type "performanceprofile" 2026-06-02T15:02:57.925700718Z ERROR: No running kube-apiserver pods found 2026-06-02T15:02:57.978626431Z Wrote inspect data to must-gather. 2026-06-02T15:02:58.101397551Z INFO: Waiting for HAProxy config collection to complete ... 2026-06-02T15:02:58.110565111Z INFO: "metallb-operator" not detected. Skipping. 2026-06-02T15:02:58.154584862Z INFO: Worker host service log collection to complete. 2026-06-02T15:02:58.186874736Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-06-02T15:02:58.192850553Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-06-02T15:02:58.192850553Z See 'oc rsync -h' for help and examples 2026-06-02T15:02:58.218890432Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-06-02T15:02:58.267754439Z Gathering data for ns/openshift-monitoring... 2026-06-02T15:02:58.371658885Z INFO: 'previous-logs' folder not found on ip-10-0-131-139.ec2.internal, skipping... 2026-06-02T15:02:58.468499649Z tar: Removing leading `/' from member names 2026-06-02T15:02:58.482650308Z INFO: HAProxy config collection complete. 2026-06-02T15:02:58.549079733Z Wrote inspect data to must-gather. 2026-06-02T15:02:58.676154291Z Wrote inspect data to must-gather. 2026-06-02T15:02:58.861615989Z Wrote inspect data to must-gather. 2026-06-02T15:02:58.942859827Z No resources found 2026-06-02T15:02:58.986754490Z Wrote inspect data to must-gather. 2026-06-02T15:02:59.021218922Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-06-02T15:02:59.054640263Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-06-02T15:02:59.088998812Z INFO: Getting rules from prometheus-k8s-0 2026-06-02T15:02:59.134848324Z INFO: 'previous-logs' folder not found on ip-10-0-136-45.ec2.internal, skipping... 2026-06-02T15:02:59.137869471Z error: the server doesn't have a resource type "machineconfigs" 2026-06-02T15:02:59.145797297Z Wrote inspect data to must-gather. 2026-06-02T15:02:59.222912046Z Wrote inspect data to must-gather. 2026-06-02T15:02:59.346942069Z Wrote inspect data to must-gather. 2026-06-02T15:02:59.373187433Z Wrote inspect data to must-gather. 2026-06-02T15:02:59.420269217Z INFO: 'previous-logs' folder not found on ip-10-0-139-31.ec2.internal, skipping... 2026-06-02T15:02:59.420410503Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-06-02T15:02:59.420470065Z INFO: Machine Config Daemon termination log collection complete. 2026-06-02T15:02:59.434231600Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-06-02T15:02:59.512320217Z INFO: Getting status/config from prometheus-k8s-0 2026-06-02T15:02:59.574835145Z Wrote inspect data to must-gather. 2026-06-02T15:02:59.589668603Z Wrote inspect data to must-gather. 2026-06-02T15:02:59.729009870Z error: the server doesn't have a resource type "kubeletconfigs" 2026-06-02T15:02:59.820072239Z Wrote inspect data to must-gather. 2026-06-02T15:02:59.915261292Z INFO: Getting status/flags from prometheus-k8s-0 2026-06-02T15:02:59.954532762Z Wrote inspect data to must-gather. 2026-06-02T15:03:00.029671081Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-06-02T15:03:00.128400674Z INFO: INTERCONNECT MODE 2026-06-02T15:03:00.128431342Z INFO: Gathering ovn-kubernetes DBs 2026-06-02T15:03:00.161675832Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-06-02T15:03:00.163948509Z Wrote inspect data to must-gather. 2026-06-02T15:03:00.291018137Z INFO: Gathering OVN_Northbound from ovnkube-node-82649... 2026-06-02T15:03:00.291296731Z INFO: Gathering OVN_Northbound from ovnkube-node-gc97m... 2026-06-02T15:03:00.291573120Z INFO: Gathering OVN_Northbound from ovnkube-node-jqt4m... 2026-06-02T15:03:00.291918908Z INFO: Gathering OVN_Southbound from ovnkube-node-82649... 2026-06-02T15:03:00.292212996Z INFO: Gathering OVN_Southbound from ovnkube-node-gc97m... 2026-06-02T15:03:00.292515043Z INFO: Gathering OVN_Southbound from ovnkube-node-jqt4m... 2026-06-02T15:03:00.448330617Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-06-02T15:03:00.451606469Z Wrote inspect data to must-gather. 2026-06-02T15:03:00.582751544Z tar: Removing leading `/' from member names 2026-06-02T15:03:00.603497764Z tar: Removing leading `/' from member names 2026-06-02T15:03:00.605413349Z tar: Removing leading `/' from member names 2026-06-02T15:03:00.657745674Z tar: Removing leading `/' from member names 2026-06-02T15:03:00.661206210Z tar: Removing leading `/' from member names 2026-06-02T15:03:00.665405456Z tar: Removing leading `/' from member names 2026-06-02T15:03:00.731564948Z W0602 15:03:00.731520 1282 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' 2026-06-02T15:03:00.738366500Z Wrote inspect data to must-gather. 2026-06-02T15:03:00.776432636Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-06-02T15:03:00.810105429Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-06-02T15:03:01.020252646Z Gathering data for ns/openshift-network-console... 2026-06-02T15:03:01.070225858Z Wrote inspect data to must-gather. 2026-06-02T15:03:01.071269891Z INFO: Waiting for network log collection to complete ... 2026-06-02T15:03:01.071327459Z INFO: Waiting for ovnk database copies to complete ... 2026-06-02T15:03:01.072250227Z INFO: Copying ovnk databases complete. 2026-06-02T15:03:01.074500934Z 2.8M must-gather/network_logs/ovnk_database_store 2026-06-02T15:03:01.077632874Z ovnk_database_store/ 2026-06-02T15:03:01.077716452Z ovnk_database_store/ovnkube-node-82649_nbdb 2026-06-02T15:03:01.087555000Z ovnk_database_store/ovnkube-node-82649_sbdb 2026-06-02T15:03:01.108837715Z ovnk_database_store/ovnkube-node-jqt4m_sbdb 2026-06-02T15:03:01.128525121Z ovnk_database_store/ovnkube-node-gc97m_sbdb 2026-06-02T15:03:01.147321709Z ovnk_database_store/ovnkube-node-jqt4m_nbdb 2026-06-02T15:03:01.154032044Z ovnk_database_store/ovnkube-node-gc97m_nbdb 2026-06-02T15:03:01.163003381Z INFO: Network log collection complete. 2026-06-02T15:03:01.269985422Z INFO: Getting status from alertmanager-main-0 2026-06-02T15:03:01.369035580Z Wrote inspect data to must-gather. 2026-06-02T15:03:01.498321299Z Gathering data for ns/openshift-console-operator... 2026-06-02T15:03:01.645587503Z Wrote inspect data to must-gather. 2026-06-02T15:03:01.891325716Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found 2026-06-02T15:03:01.894472589Z INFO: Fallback to identify the container image from release info 2026-06-02T15:03:01.897931935Z Gathering data for ns/openshift-console... 2026-06-02T15:03:02.325126054Z Gathering data for ns/openshift-cluster-storage-operator... 2026-06-02T15:03:02.530128072Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5 2026-06-02T15:03:02.667962604Z daemonset.apps/perf-node-gather-daemonset created 2026-06-02T15:03:02.767790122Z Gathering data for ns/openshift-dns-operator... 2026-06-02T15:03:02.795294865Z Waiting for performance profile collector pods to become ready: 1 2026-06-02T15:03:03.204886174Z Gathering data for ns/openshift-dns... 2026-06-02T15:03:03.916829897Z Waiting for performance profile collector pods to become ready: 2 2026-06-02T15:03:04.087748857Z Gathering data for ns/openshift-image-registry... 2026-06-02T15:03:04.440285449Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-06-02T15:03:04.574800840Z Gathering data for ns/openshift-ingress-operator... 2026-06-02T15:03:04.912188310Z Gathering data for ns/openshift-ingress... 2026-06-02T15:03:05.038476335Z Waiting for performance profile collector pods to become ready: 3 2026-06-02T15:03:05.264038873Z Gathering data for ns/openshift-ingress-canary... 2026-06-02T15:03:05.724510818Z Gathering data for ns/openshift-insights... 2026-06-02T15:03:06.143284166Z Waiting for performance profile collector pods to become ready: 4 2026-06-02T15:03:07.255864821Z Waiting for performance profile collector pods to become ready: 5 2026-06-02T15:03:07.681982983Z Gathering data for ns/openshift-jobset-operator... 2026-06-02T15:03:08.369041389Z Waiting for performance profile collector pods to become ready: 6 2026-06-02T15:03:08.496877765Z Gathering data for ns/openshift-config... 2026-06-02T15:03:08.800213508Z Gathering data for ns/openshift-config-managed... 2026-06-02T15:03:09.341285632Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-06-02T15:03:09.445501952Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-06-02T15:03:09.482648090Z Waiting for performance profile collector pods to become ready: 7 2026-06-02T15:03:09.802702351Z Gathering data for ns/openshift-kube-apiserver... 2026-06-02T15:03:10.169065226Z Gathering data for ns/openshift-kube-controller-manager... 2026-06-02T15:03:10.536708587Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-06-02T15:03:10.606649654Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-06-02T15:03:10.870185274Z Collecting performance related data for node ip-10-0-131-139.ec2.internal 2026-06-02T15:03:10.886050119Z Collecting performance related data for node ip-10-0-136-45.ec2.internal 2026-06-02T15:03:10.895261535Z Collecting performance related data for node ip-10-0-139-31.ec2.internal 2026-06-02T15:03:10.996192017Z Gathering data for ns/openshift-kube-scheduler... 2026-06-02T15:03:11.368947841Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-06-02T15:03:11.796905632Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-06-02T15:03:12.298090845Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-06-02T15:03:12.697486523Z Gathering data for ns/openshift-user-workload-monitoring... 2026-06-02T15:03:13.239306847Z Gathering data for ns/openshift-multus... 2026-06-02T15:03:14.450656001Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-06-02T15:03:14.800977070Z Gathering data for ns/openshift-ovn-kubernetes... 2026-06-02T15:03:16.447733454Z Gathering data for ns/openshift-host-network... 2026-06-02T15:03:16.823952729Z Gathering data for ns/openshift-network-diagnostics... 2026-06-02T15:03:17.533667899Z Gathering data for ns/openshift-network-node-identity... 2026-06-02T15:03:17.995480823Z Gathering data for ns/openshift-network-operator... 2026-06-02T15:03:18.429388834Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-06-02T15:03:18.748513719Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-06-02T15:03:18.839015282Z Collecting kubelet logs for node ip-10-0-131-139.ec2.internal 2026-06-02T15:03:18.840921768Z Collecting kubelet logs for node ip-10-0-136-45.ec2.internal 2026-06-02T15:03:18.842806133Z Collecting kubelet logs for node ip-10-0-139-31.ec2.internal 2026-06-02T15:03:19.172782817Z daemonset.apps "perf-node-gather-daemonset" deleted 2026-06-02T15:03:19.177766069Z INFO: Node performance data collection complete. 2026-06-02T15:03:19.385469457Z Gathering data for ns/openshift-apiserver-operator... 2026-06-02T15:03:19.456522330Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-06-02T15:03:19.695032869Z Gathering data for ns/openshift-apiserver... 2026-06-02T15:03:20.094173415Z Gathering data for ns/openshift-controller-manager-operator... 2026-06-02T15:03:20.362948882Z Gathering data for ns/openshift-controller-manager... 2026-06-02T15:03:20.745542807Z Gathering data for ns/openshift-cluster-samples-operator... 2026-06-02T15:03:21.445794979Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-06-02T15:03:21.795978058Z Gathering data for ns/openshift-service-ca-operator... 2026-06-02T15:03:22.137256436Z Gathering data for ns/openshift-service-ca... 2026-06-02T15:03:22.506370533Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-06-02T15:03:23.513003864Z Wrote inspect data to must-gather. 2026-06-02T15:03:23.513056762Z error: inspection completed with the errors occurred while gathering data: 2026-06-02T15:03:23.513056762Z skipping gathering secrets/support due to error: secrets "support" not found 2026-06-02T15:03:23.639928949Z error: the server doesn't have a resource type "clusters" 2026-06-02T15:03:24.221536543Z Caches written to disk