2026-04-16T19:07:24.514687294Z [disk usage checker] Started 2026-04-16T19:07:24.518707325Z [disk usage checker] Volume usage percentage: current = 36 ; allowed = 70 2026-04-16T19:07:24.945110911Z Gathering data for ns/openshift-cluster-version... 2026-04-16T19:07:25.084547867Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-04-16T19:07:25.176114999Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-04-16T19:07:25.257533292Z Gathering data for ns/default... 2026-04-16T19:07:25.598469847Z Gathering data for ns/openshift... 2026-04-16T19:07:26.021261901Z Gathering data for ns/kube-system... 2026-04-16T19:07:26.830318114Z Gathering data for ns/openshift-etcd... 2026-04-16T19:07:27.201997488Z Wrote inspect data to must-gather. 2026-04-16T19:07:27.202130706Z error: inspection completed with the errors occurred while gathering data: 2026-04-16T19:07:27.202130706Z namespaces "assisted-installer" not found 2026-04-16T19:07:27.272667361Z Waiting on subprocesses to finish execution. 2026-04-16T19:07:27.279496011Z INFO: Gathering HAProxy config files 2026-04-16T19:07:27.283997686Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-04-16T19:07:27.290371280Z INFO: Gathering machine config daemon's old logs from all nodes 2026-04-16T19:07:27.301434517Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-04-16T19:07:27.310907416Z INFO: Collecting host service logs for crio 2026-04-16T19:07:27.311215875Z INFO: Collecting host service logs for kubelet 2026-04-16T19:07:27.311527767Z INFO: Collecting host service logs for rpm-ostreed 2026-04-16T19:07:27.311833280Z INFO: Collecting host service logs for ostree-finalize-staged 2026-04-16T19:07:27.312144213Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-04-16T19:07:27.312485397Z INFO: Collecting host service logs for machine-config-daemon-host 2026-04-16T19:07:27.312780134Z INFO: Collecting host service logs for NetworkManager 2026-04-16T19:07:27.313081091Z INFO: Collecting host service logs for openvswitch 2026-04-16T19:07:27.313396029Z INFO: Collecting host service logs for ovs-configuration 2026-04-16T19:07:27.313694106Z INFO: Collecting host service logs for ovsdb-server 2026-04-16T19:07:27.313985721Z INFO: Collecting host service logs for ovs-vswitchd 2026-04-16T19:07:27.314351251Z INFO: Waiting for worker host service log collection to complete ... 2026-04-16T19:07:27.453875425Z INFO: Waiting for node performance related collection to complete ... 2026-04-16T19:07:27.897096442Z INFO: Collecting Insights Archives from insights-operator-5785d4fcdd-cmsdt 2026-04-16T19:07:27.897145400Z insights-runtime-extractor-7t9nd 2026-04-16T19:07:27.897166656Z insights-runtime-extractor-9mttl 2026-04-16T19:07:27.897186143Z insights-runtime-extractor-wlbw7 2026-04-16T19:07:28.092707394Z Wrote inspect data to must-gather. 2026-04-16T19:07:28.503961796Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-04-16T19:07:28.512356970Z INFO: "sriov-network-operator" not detected. Skipping. 2026-04-16T19:07:28.536616227Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-04-16T19:07:28.612873501Z No resources found 2026-04-16T19:07:28.612873501Z No resources found in openshift-etcd namespace. 2026-04-16T19:07:28.615117185Z INFO: Found 1 replicas - prometheus-k8s-0 2026-04-16T19:07:28.624235096Z INFO: "metallb-operator" not detected. Skipping. 2026-04-16T19:07:28.675782745Z ERROR: No running kube-apiserver pods found 2026-04-16T19:07:28.725526811Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-04-16T19:07:28.725607860Z INFO: on-disk MachineConfig config collection complete. 2026-04-16T19:07:28.744382519Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-04-16T19:07:28.744382519Z See 'oc rsync -h' for help and examples 2026-04-16T19:07:28.819103211Z error: the server doesn't have a resource type "performanceprofile" 2026-04-16T19:07:28.878481879Z INFO: Worker host service log collection to complete. 2026-04-16T19:07:28.927137465Z Wrote inspect data to must-gather. 2026-04-16T19:07:29.161732161Z No resources found 2026-04-16T19:07:29.228962361Z INFO: Waiting for HAProxy config collection to complete ... 2026-04-16T19:07:29.320998360Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-04-16T19:07:29.420382997Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-04-16T19:07:29.490486696Z Wrote inspect data to must-gather. 2026-04-16T19:07:29.544300467Z [disk usage checker] Volume usage percentage: current = 36 ; allowed = 70 2026-04-16T19:07:29.573300858Z Wrote inspect data to must-gather. 2026-04-16T19:07:29.589865399Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-04-16T19:07:29.593281938Z INFO: 'previous-logs' folder not found on ip-10-0-131-193.ec2.internal, skipping... 2026-04-16T19:07:29.599578774Z Gathering data for ns/openshift-monitoring... 2026-04-16T19:07:29.695227078Z Wrote inspect data to must-gather. 2026-04-16T19:07:29.719363379Z Wrote inspect data to must-gather. 2026-04-16T19:07:29.732030845Z tar: Removing leading `/' from member names 2026-04-16T19:07:29.738500066Z INFO: HAProxy config collection complete. 2026-04-16T19:07:29.742086254Z Wrote inspect data to must-gather. 2026-04-16T19:07:29.787396860Z error: the server doesn't have a resource type "machineconfigs" 2026-04-16T19:07:29.910819605Z INFO: 'previous-logs' folder not found on ip-10-0-139-88.ec2.internal, skipping... 2026-04-16T19:07:30.019440160Z Wrote inspect data to must-gather. 2026-04-16T19:07:30.027332602Z INFO: Getting rules from prometheus-k8s-0 2026-04-16T19:07:30.047518805Z Wrote inspect data to must-gather. 2026-04-16T19:07:30.188456631Z INFO: 'previous-logs' folder not found on ip-10-0-142-167.ec2.internal, skipping... 2026-04-16T19:07:30.188563451Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-04-16T19:07:30.188620345Z INFO: Machine Config Daemon termination log collection complete. 2026-04-16T19:07:30.294441875Z Wrote inspect data to must-gather. 2026-04-16T19:07:30.297220178Z Wrote inspect data to must-gather. 2026-04-16T19:07:30.451450584Z INFO: Getting status/config from prometheus-k8s-0 2026-04-16T19:07:30.459777904Z error: the server doesn't have a resource type "kubeletconfigs" 2026-04-16T19:07:30.544342317Z Wrote inspect data to must-gather. 2026-04-16T19:07:30.690909157Z Wrote inspect data to must-gather. 2026-04-16T19:07:30.840248428Z INFO: INTERCONNECT MODE 2026-04-16T19:07:30.840277518Z INFO: Gathering ovn-kubernetes DBs 2026-04-16T19:07:30.876791072Z INFO: Getting status/flags from prometheus-k8s-0 2026-04-16T19:07:30.920817526Z Wrote inspect data to must-gather. 2026-04-16T19:07:31.013434742Z INFO: Gathering OVN_Northbound from ovnkube-node-2pmhr... 2026-04-16T19:07:31.013688342Z INFO: Gathering OVN_Northbound from ovnkube-node-gsvsh... 2026-04-16T19:07:31.013913900Z INFO: Gathering OVN_Northbound from ovnkube-node-gxh6d... 2026-04-16T19:07:31.014230986Z INFO: Gathering OVN_Southbound from ovnkube-node-2pmhr... 2026-04-16T19:07:31.014548661Z INFO: Gathering OVN_Southbound from ovnkube-node-gsvsh... 2026-04-16T19:07:31.014855320Z INFO: Gathering OVN_Southbound from ovnkube-node-gxh6d... 2026-04-16T19:07:31.199731927Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-04-16T19:07:31.252508947Z Wrote inspect data to must-gather. 2026-04-16T19:07:31.297006858Z tar: Removing leading `/' from member names 2026-04-16T19:07:31.315694606Z tar: Removing leading `/' from member names 2026-04-16T19:07:31.335477056Z tar: Removing leading `/' from member names 2026-04-16T19:07:31.344551336Z tar: Removing leading `/' from member names 2026-04-16T19:07:31.353421363Z tar: Removing leading `/' from member names 2026-04-16T19:07:31.359604796Z tar: Removing leading `/' from member names 2026-04-16T19:07:31.510524946Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-04-16T19:07:31.512985142Z Wrote inspect data to must-gather. 2026-04-16T19:07:31.524566001Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-04-16T19:07:31.753631594Z Wrote inspect data to must-gather. 2026-04-16T19:07:31.786797782Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-04-16T19:07:31.839099147Z INFO: Waiting for network log collection to complete ... 2026-04-16T19:07:31.839141034Z INFO: Waiting for ovnk database copies to complete ... 2026-04-16T19:07:31.839658253Z INFO: Copying ovnk databases complete. 2026-04-16T19:07:31.841649671Z 4.4M must-gather/network_logs/ovnk_database_store 2026-04-16T19:07:31.844229573Z ovnk_database_store/ 2026-04-16T19:07:31.844229573Z ovnk_database_store/ovnkube-node-gsvsh_nbdb 2026-04-16T19:07:31.856116904Z ovnk_database_store/ovnkube-node-gxh6d_nbdb 2026-04-16T19:07:31.866856149Z ovnk_database_store/ovnkube-node-gxh6d_sbdb 2026-04-16T19:07:31.891949146Z ovnk_database_store/ovnkube-node-2pmhr_sbdb 2026-04-16T19:07:31.923319184Z ovnk_database_store/ovnkube-node-gsvsh_sbdb 2026-04-16T19:07:31.944355582Z ovnk_database_store/ovnkube-node-2pmhr_nbdb 2026-04-16T19:07:31.959789583Z INFO: Network log collection complete. 2026-04-16T19:07:32.000163872Z Wrote inspect data to must-gather. 2026-04-16T19:07:32.151504054Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-04-16T19:07:32.200514084Z INFO: Getting status from alertmanager-main-0 2026-04-16T19:07:32.300114582Z Wrote inspect data to must-gather. 2026-04-16T19:07:32.338508721Z Gathering data for ns/openshift-network-console... 2026-04-16T19:07:32.565606212Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found 2026-04-16T19:07:32.569308635Z INFO: Fallback to identify the container image from release info 2026-04-16T19:07:32.766251160Z Gathering data for ns/openshift-console-operator... 2026-04-16T19:07:33.131124616Z Gathering data for ns/openshift-console... 2026-04-16T19:07:33.160486719Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc77fc5f1546189d6b57967ccc684e794bd846ea36c3e3c1e61d83a684f0f9b9 2026-04-16T19:07:33.302151996Z daemonset.apps/perf-node-gather-daemonset created 2026-04-16T19:07:33.435477992Z Waiting for performance profile collector pods to become ready: 1 2026-04-16T19:07:33.640176781Z Gathering data for ns/openshift-cluster-storage-operator... 2026-04-16T19:07:34.020209717Z Gathering data for ns/openshift-dns-operator... 2026-04-16T19:07:34.300760020Z Gathering data for ns/openshift-dns... 2026-04-16T19:07:34.555241193Z [disk usage checker] Volume usage percentage: current = 36 ; allowed = 70 2026-04-16T19:07:34.557702125Z Waiting for performance profile collector pods to become ready: 2 2026-04-16T19:07:34.955677834Z Gathering data for ns/openshift-image-registry... 2026-04-16T19:07:35.436505614Z Gathering data for ns/openshift-ingress-operator... 2026-04-16T19:07:35.693147377Z Waiting for performance profile collector pods to become ready: 3 2026-04-16T19:07:35.779559504Z Gathering data for ns/openshift-ingress... 2026-04-16T19:07:36.117780559Z Gathering data for ns/openshift-ingress-canary... 2026-04-16T19:07:36.588769678Z Gathering data for ns/openshift-insights... 2026-04-16T19:07:36.809166552Z Waiting for performance profile collector pods to become ready: 4 2026-04-16T19:07:37.931614236Z Waiting for performance profile collector pods to become ready: 5 2026-04-16T19:07:38.805467782Z Gathering data for ns/kserve... 2026-04-16T19:07:39.060398502Z Waiting for performance profile collector pods to become ready: 6 2026-04-16T19:07:39.560237968Z [disk usage checker] Volume usage percentage: current = 37 ; allowed = 70 2026-04-16T19:07:40.193384386Z Waiting for performance profile collector pods to become ready: 7 2026-04-16T19:07:40.894306878Z Gathering data for ns/openshift-config... 2026-04-16T19:07:41.192531638Z Gathering data for ns/openshift-config-managed... 2026-04-16T19:07:41.328984247Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-04-16T19:07:41.597739246Z Collecting performance related data for node ip-10-0-131-193.ec2.internal 2026-04-16T19:07:41.605651001Z Collecting performance related data for node ip-10-0-139-88.ec2.internal 2026-04-16T19:07:41.614669141Z Collecting performance related data for node ip-10-0-142-167.ec2.internal 2026-04-16T19:07:41.686816933Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-04-16T19:07:42.030168701Z Gathering data for ns/openshift-kube-apiserver... 2026-04-16T19:07:42.423827934Z Gathering data for ns/openshift-kube-controller-manager... 2026-04-16T19:07:42.773494666Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-04-16T19:07:43.175620644Z Gathering data for ns/openshift-kube-scheduler... 2026-04-16T19:07:43.489321760Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-04-16T19:07:43.784431907Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-04-16T19:07:44.142994028Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-04-16T19:07:44.511474980Z Gathering data for ns/openshift-user-workload-monitoring... 2026-04-16T19:07:44.566902506Z [disk usage checker] Volume usage percentage: current = 37 ; allowed = 70 2026-04-16T19:07:45.073081673Z Gathering data for ns/openshift-multus... 2026-04-16T19:07:46.702099196Z Gathering data for ns/openshift-ovn-kubernetes... 2026-04-16T19:07:48.409096700Z Gathering data for ns/openshift-host-network... 2026-04-16T19:07:48.721770594Z Gathering data for ns/openshift-network-diagnostics... 2026-04-16T19:07:49.357029749Z Gathering data for ns/openshift-network-node-identity... 2026-04-16T19:07:49.573092583Z [disk usage checker] Volume usage percentage: current = 37 ; allowed = 70 2026-04-16T19:07:49.774093689Z Gathering data for ns/openshift-network-operator... 2026-04-16T19:07:50.173616385Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-04-16T19:07:50.247506770Z Collecting kubelet logs for node ip-10-0-131-193.ec2.internal 2026-04-16T19:07:50.249226999Z Collecting kubelet logs for node ip-10-0-139-88.ec2.internal 2026-04-16T19:07:50.250831750Z Collecting kubelet logs for node ip-10-0-142-167.ec2.internal 2026-04-16T19:07:50.518633677Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-04-16T19:07:50.664730838Z daemonset.apps "perf-node-gather-daemonset" deleted 2026-04-16T19:07:50.671843482Z INFO: Node performance data collection complete. 2026-04-16T19:07:51.031986611Z Gathering data for ns/openshift-apiserver-operator... 2026-04-16T19:07:51.390723421Z Gathering data for ns/openshift-apiserver... 2026-04-16T19:07:51.792527783Z Gathering data for ns/openshift-controller-manager-operator... 2026-04-16T19:07:52.114215924Z Gathering data for ns/openshift-controller-manager... 2026-04-16T19:07:52.451990639Z Gathering data for ns/openshift-cluster-samples-operator... 2026-04-16T19:07:53.107467248Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-04-16T19:07:53.408713241Z Gathering data for ns/openshift-service-ca-operator... 2026-04-16T19:07:53.720183050Z Gathering data for ns/openshift-service-ca... 2026-04-16T19:07:54.089122748Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-04-16T19:07:54.578694358Z [disk usage checker] Volume usage percentage: current = 37 ; allowed = 70 2026-04-16T19:07:54.999577202Z Wrote inspect data to must-gather. 2026-04-16T19:07:54.999621909Z error: inspection completed with the errors occurred while gathering data: 2026-04-16T19:07:54.999621909Z skipping gathering secrets/support due to error: secrets "support" not found 2026-04-16T19:07:55.133741466Z error: the server doesn't have a resource type "clusters" 2026-04-16T19:07:55.290044637Z Caches written to disk