2026-06-02T17:15:48.558466588Z [disk usage checker] Started
2026-06-02T17:15:48.562187633Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T17:15:48.755668565Z Gathering data for ns/openshift-cluster-version...
2026-06-02T17:15:48.886730169Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T17:15:48.976016047Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T17:15:49.060281218Z Gathering data for ns/default...
2026-06-02T17:15:49.389957253Z Gathering data for ns/openshift...
2026-06-02T17:15:49.877501564Z Gathering data for ns/kube-system...
2026-06-02T17:15:50.792537381Z Gathering data for ns/openshift-etcd...
2026-06-02T17:15:50.798753803Z Waiting on subprocesses to finish execution.
2026-06-02T17:15:50.811485653Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-02T17:15:50.811737980Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-02T17:15:50.825620502Z INFO: Collecting host service logs for crio
2026-06-02T17:15:50.825889302Z INFO: Collecting host service logs for kubelet
2026-06-02T17:15:50.826194545Z INFO: Collecting host service logs for rpm-ostreed
2026-06-02T17:15:50.826513389Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-02T17:15:50.826819398Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-02T17:15:50.827153967Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-02T17:15:50.827509971Z INFO: Collecting host service logs for NetworkManager
2026-06-02T17:15:50.827862575Z INFO: Collecting host service logs for openvswitch
2026-06-02T17:15:50.828194427Z INFO: Collecting host service logs for ovs-configuration
2026-06-02T17:15:50.828559746Z INFO: Collecting host service logs for ovsdb-server
2026-06-02T17:15:50.828903009Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-02T17:15:50.829305141Z INFO: Waiting for worker host service log collection to complete ...
2026-06-02T17:15:50.844061983Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-02T17:15:50.847443041Z INFO: Gathering HAProxy config files
2026-06-02T17:15:51.055522587Z INFO: Waiting for node performance related collection to complete ...
2026-06-02T17:15:51.131811495Z No resources found in openshift-etcd namespace.
2026-06-02T17:15:51.589074933Z No resources found
2026-06-02T17:15:51.710688758Z ERROR: No running kube-apiserver pods found
2026-06-02T17:15:51.745013027Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-02T17:15:51.757878324Z Wrote inspect data to must-gather.
2026-06-02T17:15:51.841276418Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-02T17:15:51.841401070Z INFO: on-disk MachineConfig config collection complete.
2026-06-02T17:15:51.844502586Z INFO: "metallb-operator" not detected. Skipping.
2026-06-02T17:15:51.891243898Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-wg6tm
2026-06-02T17:15:51.891293809Z insights-runtime-extractor-78hll
2026-06-02T17:15:51.891313190Z insights-runtime-extractor-jqdv5
2026-06-02T17:15:51.891413390Z insights-runtime-extractor-qpsns
2026-06-02T17:15:52.024386285Z error: the server doesn't have a resource type "performanceprofile"
2026-06-02T17:15:52.027784211Z Wrote inspect data to must-gather.
2026-06-02T17:15:52.027867645Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T17:15:52.027867645Z     namespaces "assisted-installer" not found
2026-06-02T17:15:52.065954206Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-02T17:15:52.129677496Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-02T17:15:52.147274757Z INFO: Worker host service log collection to complete.
2026-06-02T17:15:52.191833061Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-02T17:15:52.212285755Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-02T17:15:52.212285755Z See 'oc rsync -h' for help and examples
2026-06-02T17:15:52.251715144Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-02T17:15:52.514636195Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-02T17:15:52.601379725Z Wrote inspect data to must-gather.
2026-06-02T17:15:52.653177452Z Wrote inspect data to must-gather.
2026-06-02T17:15:52.875308176Z No resources found
2026-06-02T17:15:52.913762920Z INFO: 'previous-logs' folder not found on ip-10-0-133-10.ec2.internal, skipping...
2026-06-02T17:15:52.915202381Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-02T17:15:52.993116467Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T17:15:53.007426109Z Wrote inspect data to must-gather.
2026-06-02T17:15:53.008555548Z tar: Removing leading `/' from member names
2026-06-02T17:15:53.014854968Z INFO: HAProxy config collection complete.
2026-06-02T17:15:53.048899293Z Wrote inspect data to must-gather.
2026-06-02T17:15:53.059034008Z Gathering data for ns/openshift-monitoring...
2026-06-02T17:15:53.139181960Z error: the server doesn't have a resource type "machineconfigs"
2026-06-02T17:15:53.197644372Z Wrote inspect data to must-gather.
2026-06-02T17:15:53.264013199Z Wrote inspect data to must-gather.
2026-06-02T17:15:53.312579337Z INFO: 'previous-logs' folder not found on ip-10-0-138-126.ec2.internal, skipping...
2026-06-02T17:15:53.351349930Z Wrote inspect data to must-gather.
2026-06-02T17:15:53.379603739Z Wrote inspect data to must-gather.
2026-06-02T17:15:53.382548147Z INFO: Getting rules from prometheus-k8s-0
2026-06-02T17:15:53.566803603Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T17:15:53.567944407Z INFO: 'previous-logs' folder not found on ip-10-0-143-118.ec2.internal, skipping...
2026-06-02T17:15:53.567969988Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-02T17:15:53.567993083Z INFO: Machine Config Daemon termination log collection complete.
2026-06-02T17:15:53.602318385Z Wrote inspect data to must-gather.
2026-06-02T17:15:53.609935408Z Wrote inspect data to must-gather.
2026-06-02T17:15:53.753246982Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-02T17:15:53.779756099Z INFO: Getting status/config from prometheus-k8s-0
2026-06-02T17:15:53.843453198Z Wrote inspect data to must-gather.
2026-06-02T17:15:53.956715113Z Wrote inspect data to must-gather.
2026-06-02T17:15:54.097508429Z INFO: INTERCONNECT MODE
2026-06-02T17:15:54.097537377Z INFO: Gathering ovn-kubernetes DBs
2026-06-02T17:15:54.158451357Z Wrote inspect data to must-gather.
2026-06-02T17:15:54.162382117Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-02T17:15:54.241782414Z INFO: Gathering OVN_Northbound from ovnkube-node-jwkbz...
2026-06-02T17:15:54.242070685Z INFO: Gathering OVN_Northbound from ovnkube-node-wzv88...
2026-06-02T17:15:54.242409560Z INFO: Gathering OVN_Northbound from ovnkube-node-zx4vg...
2026-06-02T17:15:54.242744693Z INFO: Gathering OVN_Southbound from ovnkube-node-jwkbz...
2026-06-02T17:15:54.243025862Z INFO: Gathering OVN_Southbound from ovnkube-node-wzv88...
2026-06-02T17:15:54.243299022Z INFO: Gathering OVN_Southbound from ovnkube-node-zx4vg...
2026-06-02T17:15:54.437460765Z Wrote inspect data to must-gather.
2026-06-02T17:15:54.465571395Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-02T17:15:54.548420551Z tar: Removing leading `/' from member names
2026-06-02T17:15:54.582846579Z tar: Removing leading `/' from member names
2026-06-02T17:15:54.585902087Z tar: Removing leading `/' from member names
2026-06-02T17:15:54.587391466Z tar: Removing leading `/' from member names
2026-06-02T17:15:54.591618637Z tar: Removing leading `/' from member names
2026-06-02T17:15:54.618841316Z tar: Removing leading `/' from member names
2026-06-02T17:15:54.657810515Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T17:15:54.691260061Z Wrote inspect data to must-gather.
2026-06-02T17:15:54.737670004Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-02T17:15:54.958997468Z Wrote inspect data to must-gather.
2026-06-02T17:15:54.993416819Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-02T17:15:55.043908838Z INFO: Waiting for network log collection to complete ...
2026-06-02T17:15:55.043941536Z INFO: Waiting for ovnk database copies to complete ...
2026-06-02T17:15:55.044305063Z INFO: Copying ovnk databases complete.
2026-06-02T17:15:55.045893433Z 2.8M	must-gather/network_logs/ovnk_database_store
2026-06-02T17:15:55.047830735Z ovnk_database_store/
2026-06-02T17:15:55.047830735Z ovnk_database_store/ovnkube-node-zx4vg_sbdb
2026-06-02T17:15:55.072508386Z ovnk_database_store/ovnkube-node-zx4vg_nbdb
2026-06-02T17:15:55.081883793Z ovnk_database_store/ovnkube-node-wzv88_sbdb
2026-06-02T17:15:55.100606982Z ovnk_database_store/ovnkube-node-jwkbz_nbdb
2026-06-02T17:15:55.107870534Z ovnk_database_store/ovnkube-node-wzv88_nbdb
2026-06-02T17:15:55.114965462Z ovnk_database_store/ovnkube-node-jwkbz_sbdb
2026-06-02T17:15:55.134590816Z INFO: Network log collection complete.
2026-06-02T17:15:55.185863539Z W0602 17:15:55.185816    1356 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-06-02T17:15:55.190523997Z Wrote inspect data to must-gather.
2026-06-02T17:15:55.273384760Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T17:15:55.374159871Z INFO: Getting status from alertmanager-main-0
2026-06-02T17:15:55.478251857Z Gathering data for ns/openshift-network-console...
2026-06-02T17:15:55.485665180Z Wrote inspect data to must-gather.
2026-06-02T17:15:55.714107812Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-02T17:15:55.716845386Z INFO: Fallback to identify the container image from release info
2026-06-02T17:15:55.920858004Z Gathering data for ns/openshift-console-operator...
2026-06-02T17:15:56.319554308Z Gathering data for ns/openshift-console...
2026-06-02T17:15:56.392546631Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-02T17:15:56.520311654Z daemonset.apps/perf-node-gather-daemonset created
2026-06-02T17:15:56.632745005Z Waiting for performance profile collector pods to become ready: 1
2026-06-02T17:15:56.831944668Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-02T17:15:57.204950406Z Gathering data for ns/openshift-dns-operator...
2026-06-02T17:15:57.471650906Z Gathering data for ns/openshift-dns...
2026-06-02T17:15:57.747761099Z Waiting for performance profile collector pods to become ready: 2
2026-06-02T17:15:58.118074824Z Gathering data for ns/openshift-image-registry...
2026-06-02T17:15:58.571909228Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T17:15:58.589488201Z Gathering data for ns/openshift-ingress-operator...
2026-06-02T17:15:58.859545634Z Waiting for performance profile collector pods to become ready: 3
2026-06-02T17:15:58.973925913Z Gathering data for ns/openshift-ingress...
2026-06-02T17:15:59.333849662Z Gathering data for ns/openshift-ingress-canary...
2026-06-02T17:15:59.746482074Z Gathering data for ns/openshift-insights...
2026-06-02T17:15:59.965944999Z Waiting for performance profile collector pods to become ready: 4
2026-06-02T17:16:01.077244505Z Waiting for performance profile collector pods to become ready: 5
2026-06-02T17:16:01.593436880Z Gathering data for ns/openshift-jobset-operator...
2026-06-02T17:16:02.179255279Z Waiting for performance profile collector pods to become ready: 6
2026-06-02T17:16:02.415828229Z Gathering data for ns/openshift-config...
2026-06-02T17:16:02.672779005Z Gathering data for ns/openshift-config-managed...
2026-06-02T17:16:03.101677399Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-02T17:16:03.294287886Z Waiting for performance profile collector pods to become ready: 7
2026-06-02T17:16:03.365259641Z Gathering data for ns/openshift-kube-apiserver...
2026-06-02T17:16:03.576225946Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T17:16:03.638924878Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-02T17:16:03.962669039Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-02T17:16:04.299723313Z Gathering data for ns/openshift-kube-scheduler...
2026-06-02T17:16:04.416813443Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-02T17:16:04.586275223Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-02T17:16:04.713575726Z Collecting performance related data for node ip-10-0-138-126.ec2.internal
2026-06-02T17:16:04.719929265Z Collecting performance related data for node ip-10-0-133-10.ec2.internal
2026-06-02T17:16:04.727404372Z Collecting performance related data for node ip-10-0-143-118.ec2.internal
2026-06-02T17:16:04.954896000Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-02T17:16:05.315661021Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-02T17:16:05.698648620Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-02T17:16:06.290294711Z Gathering data for ns/openshift-multus...
2026-06-02T17:16:07.770874383Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-02T17:16:08.580839574Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T17:16:09.254439563Z Gathering data for ns/openshift-host-network...
2026-06-02T17:16:09.551343890Z Gathering data for ns/openshift-network-diagnostics...
2026-06-02T17:16:10.084302647Z Gathering data for ns/openshift-network-node-identity...
2026-06-02T17:16:10.482694744Z Gathering data for ns/openshift-network-operator...
2026-06-02T17:16:10.865528468Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-02T17:16:11.119658300Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-02T17:16:11.587194919Z Gathering data for ns/openshift-apiserver-operator...
2026-06-02T17:16:11.968498538Z Gathering data for ns/openshift-apiserver...
2026-06-02T17:16:12.357273691Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-02T17:16:12.635766241Z Gathering data for ns/openshift-controller-manager...
2026-06-02T17:16:12.826673202Z Collecting kubelet logs for node ip-10-0-138-126.ec2.internal
2026-06-02T17:16:12.829512313Z Collecting kubelet logs for node ip-10-0-133-10.ec2.internal
2026-06-02T17:16:12.831614770Z Collecting kubelet logs for node ip-10-0-143-118.ec2.internal
2026-06-02T17:16:12.944099697Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-02T17:16:13.163447829Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-02T17:16:13.168898886Z INFO: Node performance data collection complete.
2026-06-02T17:16:13.585385759Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T17:16:13.662661475Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-02T17:16:13.990811993Z Gathering data for ns/openshift-service-ca-operator...
2026-06-02T17:16:14.297749181Z Gathering data for ns/openshift-service-ca...
2026-06-02T17:16:14.672602597Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-02T17:16:15.560701120Z Wrote inspect data to must-gather.
2026-06-02T17:16:15.560739260Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T17:16:15.560739260Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-02T17:16:15.684292479Z error: the server doesn't have a resource type "clusters"
2026-06-02T17:16:16.057200996Z Caches written to disk