2026-06-02T05:20:57.921062070Z [disk usage checker] Started
2026-06-02T05:20:57.924941999Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T05:20:58.177609780Z Gathering data for ns/openshift-cluster-version...
2026-06-02T05:20:58.334618878Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T05:20:58.445069553Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T05:20:58.548619588Z Gathering data for ns/default...
2026-06-02T05:20:59.218575699Z Gathering data for ns/openshift...
2026-06-02T05:20:59.688513448Z Gathering data for ns/kube-system...
2026-06-02T05:21:00.369933324Z Waiting on subprocesses to finish execution.
2026-06-02T05:21:00.375013910Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-02T05:21:00.384604705Z INFO: Gathering HAProxy config files
2026-06-02T05:21:00.388033089Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-02T05:21:00.390589562Z INFO: Collecting host service logs for crio
2026-06-02T05:21:00.390883664Z INFO: Collecting host service logs for kubelet
2026-06-02T05:21:00.391167611Z INFO: Collecting host service logs for rpm-ostreed
2026-06-02T05:21:00.391484467Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-02T05:21:00.391828300Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-02T05:21:00.392129410Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-02T05:21:00.392511837Z INFO: Collecting host service logs for NetworkManager
2026-06-02T05:21:00.392970272Z INFO: Collecting host service logs for openvswitch
2026-06-02T05:21:00.393174043Z INFO: Collecting host service logs for ovs-configuration
2026-06-02T05:21:00.393546384Z INFO: Collecting host service logs for ovsdb-server
2026-06-02T05:21:00.393870991Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-02T05:21:00.394273406Z INFO: Waiting for worker host service log collection to complete ...
2026-06-02T05:21:00.406249378Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-02T05:21:00.435111849Z INFO: Waiting for node performance related collection to complete ...
2026-06-02T05:21:00.496599795Z Gathering data for ns/openshift-etcd...
2026-06-02T05:21:01.139981851Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-02T05:21:01.217257145Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-02T05:21:01.386669631Z ERROR: No running kube-apiserver pods found
2026-06-02T05:21:01.424371778Z INFO: "metallb-operator" not detected. Skipping.
2026-06-02T05:21:01.595534781Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-8sb54
2026-06-02T05:21:01.595602313Z insights-runtime-extractor-b9cdv
2026-06-02T05:21:01.595624299Z insights-runtime-extractor-rbpq7
2026-06-02T05:21:01.595643692Z insights-runtime-extractor-znbl9
2026-06-02T05:21:01.671830250Z No resources found in openshift-etcd namespace.
2026-06-02T05:21:01.749376090Z error: the server doesn't have a resource type "performanceprofile"
2026-06-02T05:21:01.776178877Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-02T05:21:01.776261445Z INFO: on-disk MachineConfig config collection complete.
2026-06-02T05:21:01.844997753Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-02T05:21:01.885601048Z Wrote inspect data to must-gather.
2026-06-02T05:21:02.203650948Z INFO: Worker host service log collection to complete.
2026-06-02T05:21:02.249455225Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-02T05:21:02.484815009Z No resources found
2026-06-02T05:21:02.588152344Z Wrote inspect data to must-gather.
2026-06-02T05:21:02.765432876Z Wrote inspect data to must-gather.
2026-06-02T05:21:02.765545840Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T05:21:02.765545840Z     namespaces "assisted-installer" not found
2026-06-02T05:21:02.878785923Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-02T05:21:02.878785923Z See 'oc rsync -h' for help and examples
2026-06-02T05:21:02.956042829Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-02T05:21:02.995228069Z No resources found
2026-06-02T05:21:03.029442561Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T05:21:03.081340570Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-02T05:21:03.184433671Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-02T05:21:03.206603813Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T05:21:03.303182824Z Wrote inspect data to must-gather.
2026-06-02T05:21:03.313258061Z error: the server doesn't have a resource type "machineconfigs"
2026-06-02T05:21:03.431561360Z INFO: HAProxy config collection complete.
2026-06-02T05:21:03.440267729Z INFO: 'previous-logs' folder not found on ip-10-0-129-50.ec2.internal, skipping...
2026-06-02T05:21:03.530560316Z Wrote inspect data to must-gather.
2026-06-02T05:21:03.564604821Z Wrote inspect data to must-gather.
2026-06-02T05:21:03.681243660Z Gathering data for ns/kuadrant-system...
2026-06-02T05:21:03.726502375Z Wrote inspect data to must-gather.
2026-06-02T05:21:03.886990686Z INFO: Getting rules from prometheus-k8s-0
2026-06-02T05:21:03.891901431Z INFO: 'previous-logs' folder not found on ip-10-0-132-27.ec2.internal, skipping...
2026-06-02T05:21:04.002980788Z Wrote inspect data to must-gather.
2026-06-02T05:21:04.271523035Z INFO: 'previous-logs' folder not found on ip-10-0-135-23.ec2.internal, skipping...
2026-06-02T05:21:04.271626241Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-02T05:21:04.271690250Z INFO: Machine Config Daemon termination log collection complete.
2026-06-02T05:21:04.358056619Z Wrote inspect data to must-gather.
2026-06-02T05:21:04.418923597Z INFO: Getting status/config from prometheus-k8s-0
2026-06-02T05:21:04.543989283Z Wrote inspect data to must-gather.
2026-06-02T05:21:04.781430610Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T05:21:04.786948273Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-02T05:21:04.921015913Z Wrote inspect data to must-gather.
2026-06-02T05:21:04.931405230Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-02T05:21:05.233254132Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-02T05:21:05.276894708Z Wrote inspect data to must-gather.
2026-06-02T05:21:05.399090672Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T05:21:05.536005682Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-02T05:21:05.577314067Z Wrote inspect data to must-gather.
2026-06-02T05:21:05.668337202Z Gathering data for ns/openshift-monitoring...
2026-06-02T05:21:05.830332661Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-02T05:21:05.841208152Z Wrote inspect data to must-gather.
2026-06-02T05:21:05.910700839Z INFO: INTERCONNECT MODE
2026-06-02T05:21:05.910809855Z INFO: Gathering ovn-kubernetes DBs
2026-06-02T05:21:06.126345615Z INFO: Gathering OVN_Northbound from ovnkube-node-dgf7w...
2026-06-02T05:21:06.126718897Z INFO: Gathering OVN_Northbound from ovnkube-node-hgcxc...
2026-06-02T05:21:06.127017839Z INFO: Gathering OVN_Northbound from ovnkube-node-nmhf8...
2026-06-02T05:21:06.127345309Z INFO: Gathering OVN_Southbound from ovnkube-node-dgf7w...
2026-06-02T05:21:06.127613857Z INFO: Gathering OVN_Southbound from ovnkube-node-hgcxc...
2026-06-02T05:21:06.127940923Z INFO: Gathering OVN_Southbound from ovnkube-node-nmhf8...
2026-06-02T05:21:06.420687368Z INFO: Getting status from alertmanager-main-0
2026-06-02T05:21:06.485027585Z tar: Removing leading `/' from member names
2026-06-02T05:21:06.518477685Z Wrote inspect data to must-gather.
2026-06-02T05:21:06.533132971Z tar: Removing leading `/' from member names
2026-06-02T05:21:06.552959313Z tar: Removing leading `/' from member names
2026-06-02T05:21:06.556091737Z tar: Removing leading `/' from member names
2026-06-02T05:21:06.586683894Z tar: Removing leading `/' from member names
2026-06-02T05:21:06.635830409Z tar: Removing leading `/' from member names
2026-06-02T05:21:07.068256197Z Wrote inspect data to must-gather.
2026-06-02T05:21:07.192570747Z INFO: Waiting for network log collection to complete ...
2026-06-02T05:21:07.192611122Z INFO: Waiting for ovnk database copies to complete ...
2026-06-02T05:21:07.193262536Z INFO: Copying ovnk databases complete.
2026-06-02T05:21:07.195183101Z 4.4M	must-gather/network_logs/ovnk_database_store
2026-06-02T05:21:07.197933701Z ovnk_database_store/
2026-06-02T05:21:07.198275367Z ovnk_database_store/ovnkube-node-dgf7w_nbdb
2026-06-02T05:21:07.213601650Z ovnk_database_store/ovnkube-node-hgcxc_nbdb
2026-06-02T05:21:07.228095170Z ovnk_database_store/ovnkube-node-hgcxc_sbdb
2026-06-02T05:21:07.257578685Z ovnk_database_store/ovnkube-node-nmhf8_nbdb
2026-06-02T05:21:07.269280468Z ovnk_database_store/ovnkube-node-dgf7w_sbdb
2026-06-02T05:21:07.295494392Z ovnk_database_store/ovnkube-node-nmhf8_sbdb
2026-06-02T05:21:07.325297877Z INFO: Network log collection complete.
2026-06-02T05:21:07.576475508Z Wrote inspect data to must-gather.
2026-06-02T05:21:08.082367026Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T05:21:08.083256990Z Gathering data for ns/openshift-network-console...
2026-06-02T05:21:08.109702910Z Wrote inspect data to must-gather.
2026-06-02T05:21:08.642065975Z Gathering data for ns/openshift-console-operator...
2026-06-02T05:21:08.657864236Z Wrote inspect data to must-gather.
2026-06-02T05:21:08.947740934Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-02T05:21:08.949958280Z INFO: Fallback to identify the container image from release info
2026-06-02T05:21:09.172131715Z Gathering data for ns/openshift-console...
2026-06-02T05:21:09.552044940Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-02T05:21:09.698631174Z daemonset.apps/perf-node-gather-daemonset created
2026-06-02T05:21:09.778993201Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-02T05:21:09.847535464Z Waiting for performance profile collector pods to become ready: 1
2026-06-02T05:21:10.270070352Z Gathering data for ns/openshift-dns-operator...
2026-06-02T05:21:10.507747293Z Wrote inspect data to must-gather.
2026-06-02T05:21:10.631433988Z Gathering data for ns/openshift-dns...
2026-06-02T05:21:10.985843545Z Waiting for performance profile collector pods to become ready: 2
2026-06-02T05:21:11.259291744Z Gathering data for ns/openshift-image-registry...
2026-06-02T05:21:11.766895709Z Gathering data for ns/openshift-ingress-operator...
2026-06-02T05:21:12.125689212Z Waiting for performance profile collector pods to become ready: 3
2026-06-02T05:21:12.168694271Z Gathering data for ns/openshift-ingress...
2026-06-02T05:21:12.950326134Z Gathering data for ns/openshift-ingress-canary...
2026-06-02T05:21:13.090739898Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T05:21:13.241898896Z Waiting for performance profile collector pods to become ready: 4
2026-06-02T05:21:13.450002858Z Gathering data for ns/openshift-insights...
2026-06-02T05:21:14.345781345Z Waiting for performance profile collector pods to become ready: 5
2026-06-02T05:21:15.465490585Z Waiting for performance profile collector pods to become ready: 6
2026-06-02T05:21:15.720028255Z Gathering data for ns/opendatahub...
2026-06-02T05:21:16.571256957Z Waiting for performance profile collector pods to become ready: 7
2026-06-02T05:21:17.628057807Z Gathering data for ns/openshift-lws-operator...
2026-06-02T05:21:17.682879784Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-02T05:21:17.942506286Z Collecting performance related data for node ip-10-0-132-27.ec2.internal
2026-06-02T05:21:17.952294097Z Collecting performance related data for node ip-10-0-135-23.ec2.internal
2026-06-02T05:21:17.961803039Z Collecting performance related data for node ip-10-0-129-50.ec2.internal
2026-06-02T05:21:18.096654047Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T05:21:19.467560723Z Gathering data for ns/openshift-config...
2026-06-02T05:21:19.857234344Z Gathering data for ns/openshift-config-managed...
2026-06-02T05:21:20.395426534Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-02T05:21:20.763841630Z Gathering data for ns/openshift-kube-apiserver...
2026-06-02T05:21:21.123671250Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-02T05:21:21.550316454Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-02T05:21:21.881421388Z Gathering data for ns/openshift-kube-scheduler...
2026-06-02T05:21:22.217321429Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-02T05:21:22.613143604Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-02T05:21:23.000923663Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-02T05:21:23.104278825Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T05:21:23.381725204Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-02T05:21:23.987341613Z Gathering data for ns/openshift-multus...
2026-06-02T05:21:25.641071101Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-02T05:21:26.067795695Z Collecting kubelet logs for node ip-10-0-132-27.ec2.internal
2026-06-02T05:21:26.069651778Z Collecting kubelet logs for node ip-10-0-135-23.ec2.internal
2026-06-02T05:21:26.072014479Z Collecting kubelet logs for node ip-10-0-129-50.ec2.internal
2026-06-02T05:21:26.438418951Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-02T05:21:26.444138685Z INFO: Node performance data collection complete.
2026-06-02T05:21:27.189190959Z Gathering data for ns/openshift-host-network...
2026-06-02T05:21:27.595893848Z Gathering data for ns/openshift-network-diagnostics...
2026-06-02T05:21:28.110078452Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T05:21:28.176169523Z Gathering data for ns/openshift-network-node-identity...
2026-06-02T05:21:28.664916645Z Gathering data for ns/openshift-network-operator...
2026-06-02T05:21:29.075368183Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-02T05:21:29.376333231Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-02T05:21:29.861148488Z Gathering data for ns/openshift-apiserver-operator...
2026-06-02T05:21:30.191063956Z Gathering data for ns/openshift-apiserver...
2026-06-02T05:21:30.660859587Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-02T05:21:30.985903737Z Gathering data for ns/openshift-controller-manager...
2026-06-02T05:21:31.306353779Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-02T05:21:31.987751540Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-02T05:21:32.327283753Z Gathering data for ns/openshift-service-ca-operator...
2026-06-02T05:21:32.666866864Z Gathering data for ns/openshift-service-ca...
2026-06-02T05:21:33.095003463Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-02T05:21:33.115007774Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T05:21:34.204104630Z Wrote inspect data to must-gather.
2026-06-02T05:21:34.204151202Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T05:21:34.204151202Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-02T05:21:34.337491514Z error: the server doesn't have a resource type "clusters"
2026-06-02T05:21:34.873739898Z Caches written to disk