2026-06-02T02:15:51.879065597Z [disk usage checker] Started
2026-06-02T02:15:51.882716463Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T02:15:52.104468012Z Gathering data for ns/openshift-cluster-version...
2026-06-02T02:15:52.270009203Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T02:15:52.385072791Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T02:15:52.490854135Z Gathering data for ns/default...
2026-06-02T02:15:52.964683387Z Gathering data for ns/openshift...
2026-06-02T02:15:53.455471867Z Gathering data for ns/kube-system...
2026-06-02T02:15:54.232244698Z Gathering data for ns/openshift-etcd...
2026-06-02T02:15:54.356299044Z Waiting on subprocesses to finish execution.
2026-06-02T02:15:54.363832773Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-02T02:15:54.368705445Z INFO: Gathering HAProxy config files
2026-06-02T02:15:54.378096223Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-02T02:15:54.386095500Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-02T02:15:54.400808954Z INFO: Waiting for node performance related collection to complete ...
2026-06-02T02:15:54.411496579Z INFO: Collecting host service logs for crio
2026-06-02T02:15:54.411855269Z INFO: Collecting host service logs for kubelet
2026-06-02T02:15:54.412171035Z INFO: Collecting host service logs for rpm-ostreed
2026-06-02T02:15:54.412521248Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-02T02:15:54.412867643Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-02T02:15:54.413166783Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-02T02:15:54.413462000Z INFO: Collecting host service logs for NetworkManager
2026-06-02T02:15:54.413762842Z INFO: Collecting host service logs for openvswitch
2026-06-02T02:15:54.414099120Z INFO: Collecting host service logs for ovs-configuration
2026-06-02T02:15:54.414409788Z INFO: Collecting host service logs for ovsdb-server
2026-06-02T02:15:54.414716346Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-02T02:15:54.415100652Z INFO: Waiting for worker host service log collection to complete ...
2026-06-02T02:15:54.842759376Z No resources found
2026-06-02T02:15:55.215892360Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-02T02:15:55.218173453Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-02T02:15:55.296484536Z INFO: "metallb-operator" not detected. Skipping.
2026-06-02T02:15:55.489523619Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-02T02:15:55.489609799Z INFO: on-disk MachineConfig config collection complete.
2026-06-02T02:15:55.582924128Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-dkxp2
2026-06-02T02:15:55.582974738Z insights-runtime-extractor-fprp6
2026-06-02T02:15:55.582995258Z insights-runtime-extractor-szkfk
2026-06-02T02:15:55.583015924Z insights-runtime-extractor-wlzst
2026-06-02T02:15:55.595033592Z error: the server doesn't have a resource type "performanceprofile"
2026-06-02T02:15:55.614044195Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-02T02:15:55.750236473Z No resources found in openshift-etcd namespace.
2026-06-02T02:15:55.795740219Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-02T02:15:55.938726918Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-02T02:15:55.940990322Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-02T02:15:55.940990322Z See 'oc rsync -h' for help and examples
2026-06-02T02:15:56.190929618Z Wrote inspect data to must-gather.
2026-06-02T02:15:56.191030208Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T02:15:56.191030208Z     namespaces "assisted-installer" not found
2026-06-02T02:15:56.514090333Z INFO: Worker host service log collection to complete.
2026-06-02T02:15:56.560018860Z Wrote inspect data to must-gather.
2026-06-02T02:15:56.738448831Z Wrote inspect data to must-gather.
2026-06-02T02:15:56.810973592Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T02:15:56.955283196Z ERROR: No running kube-apiserver pods found
2026-06-02T02:15:56.962318864Z No resources found
2026-06-02T02:15:56.965905797Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T02:15:57.002826222Z INFO: 'previous-logs' folder not found on ip-10-0-131-106.ec2.internal, skipping...
2026-06-02T02:15:57.026165034Z Wrote inspect data to must-gather.
2026-06-02T02:15:57.057734864Z Wrote inspect data to must-gather.
2026-06-02T02:15:57.083588044Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-02T02:15:57.107453748Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-02T02:15:57.226580524Z Wrote inspect data to must-gather.
2026-06-02T02:15:57.317213868Z Wrote inspect data to must-gather.
2026-06-02T02:15:57.434017930Z INFO: Getting rules from prometheus-k8s-0
2026-06-02T02:15:57.444759546Z error: the server doesn't have a resource type "machineconfigs"
2026-06-02T02:15:57.483564898Z INFO: 'previous-logs' folder not found on ip-10-0-134-54.ec2.internal, skipping...
2026-06-02T02:15:57.500220119Z tar: Removing leading `/' from member names
2026-06-02T02:15:57.505142360Z INFO: HAProxy config collection complete.
2026-06-02T02:15:57.569332292Z Gathering data for ns/kuadrant-system...
2026-06-02T02:15:57.820024529Z Wrote inspect data to must-gather.
2026-06-02T02:15:57.828433973Z INFO: 'previous-logs' folder not found on ip-10-0-136-71.ec2.internal, skipping...
2026-06-02T02:15:57.828532545Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-02T02:15:57.828600865Z INFO: Machine Config Daemon termination log collection complete.
2026-06-02T02:15:57.855136728Z Wrote inspect data to must-gather.
2026-06-02T02:15:57.922721735Z INFO: Getting status/config from prometheus-k8s-0
2026-06-02T02:15:58.212062535Z Wrote inspect data to must-gather.
2026-06-02T02:15:58.233002773Z Wrote inspect data to must-gather.
2026-06-02T02:15:58.473354419Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-02T02:15:58.475280961Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-02T02:15:58.630111480Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T02:15:58.679388022Z Wrote inspect data to must-gather.
2026-06-02T02:15:58.759340226Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-02T02:15:58.840678933Z Wrote inspect data to must-gather.
2026-06-02T02:15:59.033631719Z INFO: INTERCONNECT MODE
2026-06-02T02:15:59.033752276Z INFO: Gathering ovn-kubernetes DBs
2026-06-02T02:15:59.060804897Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-02T02:15:59.229567480Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T02:15:59.257810097Z INFO: Gathering OVN_Northbound from ovnkube-node-7js2s...
2026-06-02T02:15:59.258049445Z INFO: Gathering OVN_Northbound from ovnkube-node-mbdtj...
2026-06-02T02:15:59.258243378Z INFO: Gathering OVN_Northbound from ovnkube-node-x955z...
2026-06-02T02:15:59.258512972Z INFO: Gathering OVN_Southbound from ovnkube-node-7js2s...
2026-06-02T02:15:59.258977887Z INFO: Gathering OVN_Southbound from ovnkube-node-mbdtj...
2026-06-02T02:15:59.259343591Z INFO: Gathering OVN_Southbound from ovnkube-node-x955z...
2026-06-02T02:15:59.371019841Z Wrote inspect data to must-gather.
2026-06-02T02:15:59.385610963Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-02T02:15:59.583678211Z tar: Removing leading `/' from member names
2026-06-02T02:15:59.670082238Z Gathering data for ns/openshift-monitoring...
2026-06-02T02:15:59.697005687Z tar: Removing leading `/' from member names
2026-06-02T02:15:59.698636040Z tar: Removing leading `/' from member names
2026-06-02T02:15:59.701358922Z tar: Removing leading `/' from member names
2026-06-02T02:15:59.716474539Z tar: Removing leading `/' from member names
2026-06-02T02:15:59.742880136Z tar: Removing leading `/' from member names
2026-06-02T02:16:00.070801225Z Wrote inspect data to must-gather.
2026-06-02T02:16:00.079392425Z INFO: Getting status from alertmanager-main-0
2026-06-02T02:16:00.331534195Z INFO: Waiting for network log collection to complete ...
2026-06-02T02:16:00.331688085Z INFO: Waiting for ovnk database copies to complete ...
2026-06-02T02:16:00.332161513Z INFO: Copying ovnk databases complete.
2026-06-02T02:16:00.334309040Z 4.4M	must-gather/network_logs/ovnk_database_store
2026-06-02T02:16:00.336977287Z ovnk_database_store/
2026-06-02T02:16:00.336977287Z ovnk_database_store/ovnkube-node-x955z_nbdb
2026-06-02T02:16:00.349158596Z ovnk_database_store/ovnkube-node-x955z_sbdb
2026-06-02T02:16:00.376350787Z ovnk_database_store/ovnkube-node-7js2s_nbdb
2026-06-02T02:16:00.389425890Z ovnk_database_store/ovnkube-node-7js2s_sbdb
2026-06-02T02:16:00.413989905Z ovnk_database_store/ovnkube-node-mbdtj_nbdb
2026-06-02T02:16:00.424449110Z ovnk_database_store/ovnkube-node-mbdtj_sbdb
2026-06-02T02:16:00.449224905Z INFO: Network log collection complete.
2026-06-02T02:16:00.512175483Z Wrote inspect data to must-gather.
2026-06-02T02:16:00.841906190Z Wrote inspect data to must-gather.
2026-06-02T02:16:01.234041304Z Wrote inspect data to must-gather.
2026-06-02T02:16:01.583502049Z Wrote inspect data to must-gather.
2026-06-02T02:16:01.866040385Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-02T02:16:01.868282436Z INFO: Fallback to identify the container image from release info
2026-06-02T02:16:01.986188695Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T02:16:02.064861092Z Gathering data for ns/openshift-network-console...
2026-06-02T02:16:02.544330380Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-02T02:16:02.622704451Z Gathering data for ns/openshift-console-operator...
2026-06-02T02:16:02.670264208Z daemonset.apps/perf-node-gather-daemonset created
2026-06-02T02:16:02.833298874Z Waiting for performance profile collector pods to become ready: 1
2026-06-02T02:16:03.160685701Z Gathering data for ns/openshift-console...
2026-06-02T02:16:03.710705096Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-02T02:16:03.973588310Z Waiting for performance profile collector pods to become ready: 2
2026-06-02T02:16:04.165270982Z Gathering data for ns/openshift-dns-operator...
2026-06-02T02:16:04.346161813Z Wrote inspect data to must-gather.
2026-06-02T02:16:04.521494349Z Gathering data for ns/openshift-dns...
2026-06-02T02:16:05.090284661Z Waiting for performance profile collector pods to become ready: 3
2026-06-02T02:16:05.286912530Z Gathering data for ns/openshift-image-registry...
2026-06-02T02:16:05.836456826Z Gathering data for ns/openshift-ingress-operator...
2026-06-02T02:16:06.224612149Z Waiting for performance profile collector pods to become ready: 4
2026-06-02T02:16:06.249964981Z Gathering data for ns/openshift-ingress...
2026-06-02T02:16:06.992875518Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T02:16:07.066507619Z Gathering data for ns/openshift-ingress-canary...
2026-06-02T02:16:07.336528961Z Waiting for performance profile collector pods to become ready: 5
2026-06-02T02:16:07.552513287Z Gathering data for ns/openshift-insights...
2026-06-02T02:16:08.447790271Z Waiting for performance profile collector pods to become ready: 6
2026-06-02T02:16:09.562575932Z Waiting for performance profile collector pods to become ready: 7
2026-06-02T02:16:09.734403859Z Gathering data for ns/opendatahub...
2026-06-02T02:16:10.680558072Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-02T02:16:10.949065867Z Collecting performance related data for node ip-10-0-136-71.ec2.internal
2026-06-02T02:16:10.957128034Z Collecting performance related data for node ip-10-0-134-54.ec2.internal
2026-06-02T02:16:10.965271275Z Collecting performance related data for node ip-10-0-131-106.ec2.internal
2026-06-02T02:16:11.725877839Z Gathering data for ns/openshift-lws-operator...
2026-06-02T02:16:12.000057421Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T02:16:13.465221749Z Gathering data for ns/openshift-config...
2026-06-02T02:16:13.858583497Z Gathering data for ns/openshift-config-managed...
2026-06-02T02:16:14.385977926Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-02T02:16:14.729830205Z Gathering data for ns/openshift-kube-apiserver...
2026-06-02T02:16:15.095560242Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-02T02:16:15.472489355Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-02T02:16:15.871588912Z Gathering data for ns/openshift-kube-scheduler...
2026-06-02T02:16:16.273239472Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-02T02:16:16.660719419Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-02T02:16:17.006581693Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T02:16:17.072827186Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-02T02:16:17.459904931Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-02T02:16:18.081244211Z Gathering data for ns/openshift-multus...
2026-06-02T02:16:19.604432339Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-02T02:16:19.725927320Z Collecting kubelet logs for node ip-10-0-136-71.ec2.internal
2026-06-02T02:16:19.728287444Z Collecting kubelet logs for node ip-10-0-134-54.ec2.internal
2026-06-02T02:16:19.730255389Z Collecting kubelet logs for node ip-10-0-131-106.ec2.internal
2026-06-02T02:16:20.081999273Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-02T02:16:20.087172705Z INFO: Node performance data collection complete.
2026-06-02T02:16:21.168287564Z Gathering data for ns/openshift-host-network...
2026-06-02T02:16:21.545206269Z Gathering data for ns/openshift-network-diagnostics...
2026-06-02T02:16:22.012332358Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T02:16:22.145020007Z Gathering data for ns/openshift-network-node-identity...
2026-06-02T02:16:22.635721639Z Gathering data for ns/openshift-network-operator...
2026-06-02T02:16:23.056472464Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-02T02:16:23.389678962Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-02T02:16:23.904866138Z Gathering data for ns/openshift-apiserver-operator...
2026-06-02T02:16:24.267398704Z Gathering data for ns/openshift-apiserver...
2026-06-02T02:16:24.733007692Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-02T02:16:25.081345355Z Gathering data for ns/openshift-controller-manager...
2026-06-02T02:16:25.437275962Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-02T02:16:26.180811797Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-02T02:16:26.538088857Z Gathering data for ns/openshift-service-ca-operator...
2026-06-02T02:16:26.898076065Z Gathering data for ns/openshift-service-ca...
2026-06-02T02:16:27.017179476Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T02:16:27.316750149Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-02T02:16:28.403024291Z Wrote inspect data to must-gather.
2026-06-02T02:16:28.403073530Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T02:16:28.403073530Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-02T02:16:28.542995548Z error: the server doesn't have a resource type "clusters"
2026-06-02T02:16:28.890085060Z Caches written to disk