2026-04-25T00:50:50.249962221Z [disk usage checker] Started
2026-04-25T00:50:50.253092782Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-04-25T00:50:50.480742902Z Gathering data for ns/openshift-cluster-version...
2026-04-25T00:50:50.627127479Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-25T00:50:50.714350845Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-25T00:50:50.811476472Z Gathering data for ns/default...
2026-04-25T00:50:51.136941670Z Gathering data for ns/openshift...
2026-04-25T00:50:51.596960867Z Gathering data for ns/kube-system...
2026-04-25T00:50:52.300166939Z Gathering data for ns/openshift-etcd...
2026-04-25T00:50:52.639677623Z Wrote inspect data to must-gather.
2026-04-25T00:50:52.639710833Z error: inspection completed with the errors occurred while gathering data:
2026-04-25T00:50:52.639710833Z     namespaces "assisted-installer" not found
2026-04-25T00:50:52.887438501Z Waiting on subprocesses to finish execution.
2026-04-25T00:50:52.896514532Z INFO: Gathering HAProxy config files
2026-04-25T00:50:52.897253030Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-04-25T00:50:52.899708578Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-04-25T00:50:52.901199943Z INFO: Collecting host service logs for crio
2026-04-25T00:50:52.901526280Z INFO: Collecting host service logs for kubelet
2026-04-25T00:50:52.901887186Z INFO: Collecting host service logs for rpm-ostreed
2026-04-25T00:50:52.902228210Z INFO: Collecting host service logs for ostree-finalize-staged
2026-04-25T00:50:52.902627280Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-04-25T00:50:52.902984055Z INFO: Collecting host service logs for machine-config-daemon-host
2026-04-25T00:50:52.903307551Z INFO: Collecting host service logs for NetworkManager
2026-04-25T00:50:52.903671418Z INFO: Collecting host service logs for openvswitch
2026-04-25T00:50:52.904055687Z INFO: Collecting host service logs for ovs-configuration
2026-04-25T00:50:52.904400322Z INFO: Collecting host service logs for ovsdb-server
2026-04-25T00:50:52.904759293Z INFO: Collecting host service logs for ovs-vswitchd
2026-04-25T00:50:52.905239651Z INFO: Waiting for worker host service log collection to complete ...
2026-04-25T00:50:52.917230424Z INFO: Gathering machine config daemon's old logs from all nodes
2026-04-25T00:50:53.128218390Z INFO: Waiting for node performance related collection to complete ...
2026-04-25T00:50:53.699315889Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-04-25T00:50:53.699413099Z INFO: on-disk MachineConfig config collection complete.
2026-04-25T00:50:53.802980433Z INFO: "sriov-network-operator" not detected. Skipping.
2026-04-25T00:50:53.880322079Z No resources found
2026-04-25T00:50:53.985175036Z No resources found in openshift-etcd namespace.
2026-04-25T00:50:54.155406050Z Wrote inspect data to must-gather.
2026-04-25T00:50:54.212441034Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-04-25T00:50:54.271235974Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-04-25T00:50:54.276938615Z INFO: Found 1 replicas - prometheus-k8s-0
2026-04-25T00:50:54.317481940Z INFO: "metallb-operator" not detected. Skipping.
2026-04-25T00:50:54.320400997Z INFO: Worker host service log collection to complete.
2026-04-25T00:50:54.337251981Z error: the server doesn't have a resource type "performanceprofile"
2026-04-25T00:50:54.372036299Z INFO: Collecting Insights Archives from insights-operator-585dfdc468-4x6ss
2026-04-25T00:50:54.372195479Z insights-runtime-extractor-7xqlq
2026-04-25T00:50:54.372220520Z insights-runtime-extractor-86bbr
2026-04-25T00:50:54.372242577Z insights-runtime-extractor-kmmfk
2026-04-25T00:50:54.507673794Z INFO: Waiting for HAProxy config collection to complete ...
2026-04-25T00:50:55.066494781Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-04-25T00:50:55.066494781Z See 'oc rsync -h' for help and examples
2026-04-25T00:50:55.282007490Z Wrote inspect data to must-gather.
2026-04-25T00:50:55.295268390Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-04-25T00:50:55.410762020Z ERROR: No running kube-apiserver pods found
2026-04-25T00:50:55.577580218Z No resources found
2026-04-25T00:50:55.596221043Z Wrote inspect data to must-gather.
2026-04-25T00:50:55.626081802Z INFO: 'previous-logs' folder not found on ip-10-0-129-4.ec2.internal, skipping...
2026-04-25T00:50:55.645129949Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-04-25T00:50:55.710578787Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-04-25T00:50:55.723032538Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-25T00:50:55.726928635Z Wrote inspect data to must-gather.
2026-04-25T00:50:55.733615319Z Gathering data for ns/kuadrant-system...
2026-04-25T00:50:55.749188668Z tar: Removing leading `/' from member names
2026-04-25T00:50:55.759696932Z INFO: HAProxy config collection complete.
2026-04-25T00:50:55.770405744Z Wrote inspect data to must-gather.
2026-04-25T00:50:55.882968237Z error: the server doesn't have a resource type "machineconfigs"
2026-04-25T00:50:56.011087662Z Wrote inspect data to must-gather.
2026-04-25T00:50:56.118509610Z INFO: 'previous-logs' folder not found on ip-10-0-133-214.ec2.internal, skipping...
2026-04-25T00:50:56.161182298Z Wrote inspect data to must-gather.
2026-04-25T00:50:56.239785122Z Wrote inspect data to must-gather.
2026-04-25T00:50:56.344925187Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-25T00:50:56.371710303Z INFO: Getting rules from prometheus-k8s-0
2026-04-25T00:50:56.515580162Z INFO: 'previous-logs' folder not found on ip-10-0-134-82.ec2.internal, skipping...
2026-04-25T00:50:56.515693045Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-04-25T00:50:56.515743059Z INFO: Machine Config Daemon termination log collection complete.
2026-04-25T00:50:56.601317743Z Wrote inspect data to must-gather.
2026-04-25T00:50:56.635725892Z Wrote inspect data to must-gather.
2026-04-25T00:50:56.695989936Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-25T00:50:56.896060749Z error: the server doesn't have a resource type "kubeletconfigs"
2026-04-25T00:50:56.931845257Z INFO: Getting status/config from prometheus-k8s-0
2026-04-25T00:50:56.933124813Z Gathering data for ns/openshift-monitoring...
2026-04-25T00:50:57.036400032Z Wrote inspect data to must-gather.
2026-04-25T00:50:57.250413411Z Wrote inspect data to must-gather.
2026-04-25T00:50:57.402610839Z INFO: Getting status/flags from prometheus-k8s-0
2026-04-25T00:50:57.413850862Z INFO: INTERCONNECT MODE
2026-04-25T00:50:57.413889480Z INFO: Gathering ovn-kubernetes DBs
2026-04-25T00:50:57.575933844Z Wrote inspect data to must-gather.
2026-04-25T00:50:57.626077122Z INFO: Gathering OVN_Northbound from ovnkube-node-9z2gl...
2026-04-25T00:50:57.626286145Z INFO: Gathering OVN_Northbound from ovnkube-node-bfwmd...
2026-04-25T00:50:57.626503944Z INFO: Gathering OVN_Northbound from ovnkube-node-xnqmd...
2026-04-25T00:50:57.626808320Z INFO: Gathering OVN_Southbound from ovnkube-node-9z2gl...
2026-04-25T00:50:57.627048869Z INFO: Gathering OVN_Southbound from ovnkube-node-bfwmd...
2026-04-25T00:50:57.627479225Z INFO: Gathering OVN_Southbound from ovnkube-node-xnqmd...
2026-04-25T00:50:57.741054099Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-04-25T00:50:57.925739469Z tar: Removing leading `/' from member names
2026-04-25T00:50:57.936625343Z tar: Removing leading `/' from member names
2026-04-25T00:50:57.969345117Z tar: Removing leading `/' from member names
2026-04-25T00:50:58.029888610Z Wrote inspect data to must-gather.
2026-04-25T00:50:58.071779860Z tar: Removing leading `/' from member names
2026-04-25T00:50:58.072972106Z tar: Removing leading `/' from member names
2026-04-25T00:50:58.103613477Z tar: Removing leading `/' from member names
2026-04-25T00:50:58.140426185Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-04-25T00:50:58.397803849Z Wrote inspect data to must-gather.
2026-04-25T00:50:58.452556167Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-04-25T00:50:58.739234006Z Wrote inspect data to must-gather.
2026-04-25T00:50:58.753426336Z INFO: Waiting for network log collection to complete ...
2026-04-25T00:50:58.753485848Z INFO: Waiting for ovnk database copies to complete ...
2026-04-25T00:50:58.754004789Z INFO: Copying ovnk databases complete.
2026-04-25T00:50:58.756089141Z 5.0M	must-gather/network_logs/ovnk_database_store
2026-04-25T00:50:58.759233968Z ovnk_database_store/
2026-04-25T00:50:58.759233968Z ovnk_database_store/ovnkube-node-xnqmd_sbdb
2026-04-25T00:50:58.796354640Z ovnk_database_store/ovnkube-node-bfwmd_nbdb
2026-04-25T00:50:58.807882851Z ovnk_database_store/ovnkube-node-bfwmd_sbdb
2026-04-25T00:50:58.837653146Z ovnk_database_store/ovnkube-node-xnqmd_nbdb
2026-04-25T00:50:58.848908402Z ovnk_database_store/ovnkube-node-9z2gl_nbdb
2026-04-25T00:50:58.858991145Z ovnk_database_store/ovnkube-node-9z2gl_sbdb
2026-04-25T00:50:58.890960536Z INFO: Network log collection complete.
2026-04-25T00:50:58.945023879Z INFO: Getting status from alertmanager-main-0
2026-04-25T00:50:59.064710852Z Wrote inspect data to must-gather.
2026-04-25T00:50:59.409411881Z Gathering data for ns/openshift-network-console...
2026-04-25T00:50:59.411590657Z Wrote inspect data to must-gather.
2026-04-25T00:50:59.737597727Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-04-25T00:50:59.740476400Z INFO: Fallback to identify the container image from release info
2026-04-25T00:50:59.923809257Z Gathering data for ns/openshift-console-operator...
2026-04-25T00:51:00.306158702Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-04-25T00:51:00.324138317Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f2123db9953f98da0e43c266e6a8a070bf221533b995f87b7e358cc7498ca6d
2026-04-25T00:51:00.348731380Z Gathering data for ns/openshift-console...
2026-04-25T00:51:00.464978155Z daemonset.apps/perf-node-gather-daemonset created
2026-04-25T00:51:00.630895102Z Waiting for performance profile collector pods to become ready: 1
2026-04-25T00:51:00.741740736Z Wrote inspect data to must-gather.
2026-04-25T00:51:00.878369223Z Gathering data for ns/openshift-cluster-storage-operator...
2026-04-25T00:51:01.274862078Z Gathering data for ns/openshift-dns-operator...
2026-04-25T00:51:01.602997599Z Gathering data for ns/openshift-dns...
2026-04-25T00:51:01.750656306Z Waiting for performance profile collector pods to become ready: 2
2026-04-25T00:51:02.205510646Z Gathering data for ns/openshift-image-registry...
2026-04-25T00:51:02.727125635Z Gathering data for ns/openshift-ingress-operator...
2026-04-25T00:51:02.883332940Z Waiting for performance profile collector pods to become ready: 3
2026-04-25T00:51:03.110936631Z Gathering data for ns/openshift-ingress...
2026-04-25T00:51:03.670384146Z Gathering data for ns/openshift-ingress-canary...
2026-04-25T00:51:04.037428533Z Waiting for performance profile collector pods to become ready: 4
2026-04-25T00:51:04.119635832Z Gathering data for ns/openshift-insights...
2026-04-25T00:51:05.171028151Z Waiting for performance profile collector pods to become ready: 5
2026-04-25T00:51:05.310690199Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-04-25T00:51:06.308115877Z Waiting for performance profile collector pods to become ready: 6
2026-04-25T00:51:06.834295788Z Gathering data for ns/openshift-lws-operator...
2026-04-25T00:51:07.393857171Z Gathering data for ns/kserve...
2026-04-25T00:51:07.436669981Z Waiting for performance profile collector pods to become ready: 7
2026-04-25T00:51:08.574565514Z Waiting for performance profile collector pods to become ready: 8
2026-04-25T00:51:09.334134774Z Gathering data for ns/openshift-config...
2026-04-25T00:51:09.657200300Z Gathering data for ns/openshift-config-managed...
2026-04-25T00:51:09.716953823Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-04-25T00:51:10.009531876Z Collecting performance related data for node ip-10-0-129-4.ec2.internal
2026-04-25T00:51:10.018041999Z Collecting performance related data for node ip-10-0-133-214.ec2.internal
2026-04-25T00:51:10.028969009Z Collecting performance related data for node ip-10-0-134-82.ec2.internal
2026-04-25T00:51:10.192713902Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-04-25T00:51:10.315198744Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-04-25T00:51:10.573678857Z Gathering data for ns/openshift-kube-apiserver...
2026-04-25T00:51:10.959421911Z Gathering data for ns/openshift-kube-controller-manager...
2026-04-25T00:51:11.380867382Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-04-25T00:51:11.787987744Z Gathering data for ns/openshift-kube-scheduler...
2026-04-25T00:51:12.095453191Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-04-25T00:51:12.416534274Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-04-25T00:51:12.790937584Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-04-25T00:51:13.200961543Z Gathering data for ns/openshift-user-workload-monitoring...
2026-04-25T00:51:13.787395478Z Gathering data for ns/openshift-multus...
2026-04-25T00:51:15.205147967Z Gathering data for ns/openshift-ovn-kubernetes...
2026-04-25T00:51:15.319851364Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-04-25T00:51:17.010978280Z Gathering data for ns/openshift-host-network...
2026-04-25T00:51:17.371541610Z Gathering data for ns/openshift-network-diagnostics...
2026-04-25T00:51:17.978152198Z Gathering data for ns/openshift-network-node-identity...
2026-04-25T00:51:18.429168570Z Gathering data for ns/openshift-network-operator...
2026-04-25T00:51:18.783650998Z Collecting kubelet logs for node ip-10-0-129-4.ec2.internal
2026-04-25T00:51:18.786436256Z Collecting kubelet logs for node ip-10-0-133-214.ec2.internal
2026-04-25T00:51:18.789007956Z Collecting kubelet logs for node ip-10-0-134-82.ec2.internal
2026-04-25T00:51:18.831257612Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-04-25T00:51:19.205786422Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-04-25T00:51:19.220716304Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-04-25T00:51:19.225525055Z INFO: Node performance data collection complete.
2026-04-25T00:51:19.710538170Z Gathering data for ns/openshift-apiserver-operator...
2026-04-25T00:51:20.056290622Z Gathering data for ns/openshift-apiserver...
2026-04-25T00:51:20.324378029Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-04-25T00:51:20.486208526Z Gathering data for ns/openshift-controller-manager-operator...
2026-04-25T00:51:20.786629610Z Gathering data for ns/openshift-controller-manager...
2026-04-25T00:51:21.110329046Z Gathering data for ns/openshift-cluster-samples-operator...
2026-04-25T00:51:21.778089103Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-04-25T00:51:22.084285837Z Gathering data for ns/openshift-service-ca-operator...
2026-04-25T00:51:22.403990496Z Gathering data for ns/openshift-service-ca...
2026-04-25T00:51:22.781558683Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-04-25T00:51:23.712162030Z Wrote inspect data to must-gather.
2026-04-25T00:51:23.712207101Z error: inspection completed with the errors occurred while gathering data:
2026-04-25T00:51:23.712207101Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-04-25T00:51:23.848919609Z error: the server doesn't have a resource type "clusters"
2026-04-25T00:51:24.024121759Z Caches written to disk