2026-06-01T20:55:08.305627805Z [disk usage checker] Started
2026-06-01T20:55:08.312085920Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-01T20:55:08.541585598Z Gathering data for ns/openshift-cluster-version...
2026-06-01T20:55:08.713088768Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-01T20:55:08.822289581Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-01T20:55:08.926735928Z Gathering data for ns/default...
2026-06-01T20:55:09.412090996Z Gathering data for ns/openshift...
2026-06-01T20:55:09.889335927Z Gathering data for ns/kube-system...
2026-06-01T20:55:10.635501255Z Gathering data for ns/openshift-etcd...
2026-06-01T20:55:10.804746293Z Waiting on subprocesses to finish execution.
2026-06-01T20:55:10.811557595Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-01T20:55:10.822782831Z INFO: Gathering HAProxy config files
2026-06-01T20:55:10.870951465Z INFO: Waiting for node performance related collection to complete ...
2026-06-01T20:55:10.883233472Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-01T20:55:10.892566470Z INFO: Collecting host service logs for crio
2026-06-01T20:55:10.892969142Z INFO: Collecting host service logs for kubelet
2026-06-01T20:55:10.893350094Z INFO: Collecting host service logs for rpm-ostreed
2026-06-01T20:55:10.893691846Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-01T20:55:10.894028415Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-01T20:55:10.894927927Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-01T20:55:10.895276990Z INFO: Collecting host service logs for NetworkManager
2026-06-01T20:55:10.895606056Z INFO: Collecting host service logs for openvswitch
2026-06-01T20:55:10.895978844Z INFO: Collecting host service logs for ovs-configuration
2026-06-01T20:55:10.896374184Z INFO: Collecting host service logs for ovsdb-server
2026-06-01T20:55:10.896780533Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-01T20:55:10.897203210Z INFO: Waiting for worker host service log collection to complete ...
2026-06-01T20:55:10.900498262Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-01T20:55:11.129238814Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-01T20:55:11.218046006Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-01T20:55:11.218135869Z INFO: on-disk MachineConfig config collection complete.
2026-06-01T20:55:11.412952464Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-btqmr
2026-06-01T20:55:11.412952464Z insights-runtime-extractor-h457v
2026-06-01T20:55:11.412952464Z insights-runtime-extractor-mnkxd
2026-06-01T20:55:11.412952464Z insights-runtime-extractor-t9ffl
2026-06-01T20:55:11.448860610Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-01T20:55:11.733279482Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-01T20:55:11.763496104Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-01T20:55:11.802526159Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-01T20:55:11.851479440Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-01T20:55:11.851479440Z See 'oc rsync -h' for help and examples
2026-06-01T20:55:12.017266710Z No resources found in openshift-etcd namespace.
2026-06-01T20:55:12.134283460Z No resources found
2026-06-01T20:55:12.186947246Z Wrote inspect data to must-gather.
2026-06-01T20:55:12.187043018Z error: inspection completed with the errors occurred while gathering data:
2026-06-01T20:55:12.187043018Z     namespaces "assisted-installer" not found
2026-06-01T20:55:12.266878641Z ERROR: No running kube-apiserver pods found
2026-06-01T20:55:12.561945204Z INFO: "metallb-operator" not detected. Skipping.
2026-06-01T20:55:12.994598297Z No resources found
2026-06-01T20:55:13.230682174Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-01T20:55:13.377613229Z INFO: Worker host service log collection to complete.
2026-06-01T20:55:13.384404025Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-01T20:55:13.391730712Z error: the server doesn't have a resource type "performanceprofile"
2026-06-01T20:55:13.473480765Z Wrote inspect data to must-gather.
2026-06-01T20:55:13.501696202Z Wrote inspect data to must-gather.
2026-06-01T20:55:13.528468002Z Wrote inspect data to must-gather.
2026-06-01T20:55:13.558819965Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-01T20:55:13.589414495Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-01T20:55:13.678140724Z INFO: 'previous-logs' folder not found on ip-10-0-134-139.ec2.internal, skipping...
2026-06-01T20:55:13.929490865Z Wrote inspect data to must-gather.
2026-06-01T20:55:13.934869029Z INFO: Getting rules from prometheus-k8s-0
2026-06-01T20:55:13.935895417Z tar: Removing leading `/' from member names
2026-06-01T20:55:13.944113748Z INFO: HAProxy config collection complete.
2026-06-01T20:55:14.038668800Z Wrote inspect data to must-gather.
2026-06-01T20:55:14.145330980Z Wrote inspect data to must-gather.
2026-06-01T20:55:14.184698831Z INFO: 'previous-logs' folder not found on ip-10-0-141-183.ec2.internal, skipping...
2026-06-01T20:55:14.389986640Z Gathering data for ns/kuadrant-system...
2026-06-01T20:55:14.395888976Z error: the server doesn't have a resource type "machineconfigs"
2026-06-01T20:55:14.452054967Z Wrote inspect data to must-gather.
2026-06-01T20:55:14.522565719Z INFO: Getting status/config from prometheus-k8s-0
2026-06-01T20:55:14.529707550Z INFO: 'previous-logs' folder not found on ip-10-0-142-171.ec2.internal, skipping...
2026-06-01T20:55:14.529746308Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-01T20:55:14.529746308Z INFO: Machine Config Daemon termination log collection complete.
2026-06-01T20:55:14.787952623Z Wrote inspect data to must-gather.
2026-06-01T20:55:14.866417376Z Wrote inspect data to must-gather.
2026-06-01T20:55:15.065089252Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-01T20:55:15.219142016Z Wrote inspect data to must-gather.
2026-06-01T20:55:15.371629310Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-01T20:55:15.392356934Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-01T20:55:15.404758945Z Wrote inspect data to must-gather.
2026-06-01T20:55:15.477576585Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-01T20:55:15.720898387Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-01T20:55:15.865199569Z INFO: INTERCONNECT MODE
2026-06-01T20:55:15.865301838Z INFO: Gathering ovn-kubernetes DBs
2026-06-01T20:55:15.918485490Z W0601 20:55:15.918434    1184 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-06-01T20:55:15.959907108Z Wrote inspect data to must-gather.
2026-06-01T20:55:15.974824229Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-01T20:55:16.069206821Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-01T20:55:16.129379281Z INFO: Gathering OVN_Northbound from ovnkube-node-5zgnz...
2026-06-01T20:55:16.130923892Z INFO: Gathering OVN_Northbound from ovnkube-node-8jnbd...
2026-06-01T20:55:16.131467583Z INFO: Gathering OVN_Northbound from ovnkube-node-knvtx...
2026-06-01T20:55:16.131789989Z INFO: Gathering OVN_Southbound from ovnkube-node-5zgnz...
2026-06-01T20:55:16.132054451Z INFO: Gathering OVN_Southbound from ovnkube-node-8jnbd...
2026-06-01T20:55:16.132308443Z INFO: Gathering OVN_Southbound from ovnkube-node-knvtx...
2026-06-01T20:55:16.325908031Z Gathering data for ns/openshift-monitoring...
2026-06-01T20:55:16.599525427Z tar: Removing leading `/' from member names
2026-06-01T20:55:16.611102887Z tar: Removing leading `/' from member names
2026-06-01T20:55:16.641862976Z tar: Removing leading `/' from member names
2026-06-01T20:55:16.649324339Z tar: Removing leading `/' from member names
2026-06-01T20:55:16.660544328Z tar: Removing leading `/' from member names
2026-06-01T20:55:16.723243925Z INFO: Getting status from alertmanager-main-0
2026-06-01T20:55:16.775631005Z Wrote inspect data to must-gather.
2026-06-01T20:55:17.236723750Z Wrote inspect data to must-gather.
2026-06-01T20:55:17.314641389Z INFO: Waiting for network log collection to complete ...
2026-06-01T20:55:17.315358744Z INFO: Waiting for ovnk database copies to complete ...
2026-06-01T20:55:17.315955998Z INFO: Copying ovnk databases complete.
2026-06-01T20:55:17.317966654Z 4.2M	must-gather/network_logs/ovnk_database_store
2026-06-01T20:55:17.320448856Z ovnk_database_store/
2026-06-01T20:55:17.320448856Z ovnk_database_store/ovnkube-node-8jnbd_nbdb
2026-06-01T20:55:17.332304509Z ovnk_database_store/ovnkube-node-5zgnz_nbdb
2026-06-01T20:55:17.343382880Z ovnk_database_store/ovnkube-node-knvtx_nbdb
2026-06-01T20:55:17.356196847Z ovnk_database_store/ovnkube-node-knvtx_sbdb
2026-06-01T20:55:17.382502620Z ovnk_database_store/ovnkube-node-5zgnz_sbdb
2026-06-01T20:55:17.411419744Z ovnk_database_store/ovnkube-node-8jnbd_sbdb
2026-06-01T20:55:17.441485032Z INFO: Network log collection complete.
2026-06-01T20:55:17.718409267Z Wrote inspect data to must-gather.
2026-06-01T20:55:18.091745276Z Wrote inspect data to must-gather.
2026-06-01T20:55:18.410017296Z W0601 20:55:18.409957    1434 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-06-01T20:55:18.430471464Z Wrote inspect data to must-gather.
2026-06-01T20:55:18.468217998Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-01T20:55:18.701606392Z Gathering data for ns/openshift-network-console...
2026-06-01T20:55:18.899178657Z Wrote inspect data to must-gather.
2026-06-01T20:55:19.195399689Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-01T20:55:19.198482620Z INFO: Fallback to identify the container image from release info
2026-06-01T20:55:19.303689552Z Gathering data for ns/openshift-console-operator...
2026-06-01T20:55:19.751506487Z Gathering data for ns/openshift-console...
2026-06-01T20:55:19.844988458Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-01T20:55:19.998097846Z daemonset.apps/perf-node-gather-daemonset created
2026-06-01T20:55:20.175506342Z Waiting for performance profile collector pods to become ready: 1
2026-06-01T20:55:20.333992546Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-01T20:55:20.373060067Z Wrote inspect data to must-gather.
2026-06-01T20:55:20.771539922Z Gathering data for ns/openshift-dns-operator...
2026-06-01T20:55:21.110073492Z Gathering data for ns/openshift-dns...
2026-06-01T20:55:21.288788357Z Waiting for performance profile collector pods to become ready: 2
2026-06-01T20:55:21.715068778Z Gathering data for ns/openshift-image-registry...
2026-06-01T20:55:22.254101012Z Gathering data for ns/openshift-ingress-operator...
2026-06-01T20:55:22.413508029Z Waiting for performance profile collector pods to become ready: 3
2026-06-01T20:55:22.620815892Z Gathering data for ns/openshift-ingress...
2026-06-01T20:55:23.350004625Z Gathering data for ns/openshift-ingress-canary...
2026-06-01T20:55:23.474406184Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-01T20:55:23.549830226Z Waiting for performance profile collector pods to become ready: 4
2026-06-01T20:55:23.830782825Z Gathering data for ns/openshift-insights...
2026-06-01T20:55:24.668438713Z Waiting for performance profile collector pods to become ready: 5
2026-06-01T20:55:25.785308446Z Waiting for performance profile collector pods to become ready: 6
2026-06-01T20:55:25.966222260Z Gathering data for ns/opendatahub...
2026-06-01T20:55:26.908995772Z Waiting for performance profile collector pods to become ready: 7
2026-06-01T20:55:27.688147386Z Gathering data for ns/openshift-lws-operator...
2026-06-01T20:55:28.032142234Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-01T20:55:28.314017774Z Collecting performance related data for node ip-10-0-134-139.ec2.internal
2026-06-01T20:55:28.320524625Z Collecting performance related data for node ip-10-0-142-171.ec2.internal
2026-06-01T20:55:28.328022216Z Collecting performance related data for node ip-10-0-141-183.ec2.internal
2026-06-01T20:55:28.480938432Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-01T20:55:29.548310726Z Gathering data for ns/openshift-config...
2026-06-01T20:55:29.923176611Z Gathering data for ns/openshift-config-managed...
2026-06-01T20:55:30.392250868Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-01T20:55:30.728577677Z Gathering data for ns/openshift-kube-apiserver...
2026-06-01T20:55:31.120596916Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-01T20:55:31.500787266Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-01T20:55:31.848287794Z Gathering data for ns/openshift-kube-scheduler...
2026-06-01T20:55:32.168997324Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-01T20:55:32.523688267Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-01T20:55:32.892232436Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-01T20:55:33.260445332Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-01T20:55:33.488886238Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-01T20:55:33.878560220Z Gathering data for ns/openshift-multus...
2026-06-01T20:55:35.321431471Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-01T20:55:36.910644953Z Gathering data for ns/openshift-host-network...
2026-06-01T20:55:37.150897145Z Collecting kubelet logs for node ip-10-0-134-139.ec2.internal
2026-06-01T20:55:37.153084605Z Collecting kubelet logs for node ip-10-0-142-171.ec2.internal
2026-06-01T20:55:37.157354534Z Collecting kubelet logs for node ip-10-0-141-183.ec2.internal
2026-06-01T20:55:37.390620109Z Gathering data for ns/openshift-network-diagnostics...
2026-06-01T20:55:37.527625600Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-01T20:55:37.534475368Z INFO: Node performance data collection complete.
2026-06-01T20:55:38.038024297Z Gathering data for ns/openshift-network-node-identity...
2026-06-01T20:55:38.495181698Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-01T20:55:38.540169144Z Gathering data for ns/openshift-network-operator...
2026-06-01T20:55:38.984242269Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-01T20:55:39.315821491Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-01T20:55:39.824568414Z Gathering data for ns/openshift-apiserver-operator...
2026-06-01T20:55:40.177245504Z Gathering data for ns/openshift-apiserver...
2026-06-01T20:55:40.758306821Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-01T20:55:41.081911695Z Gathering data for ns/openshift-controller-manager...
2026-06-01T20:55:41.432684112Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-01T20:55:42.143220376Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-01T20:55:42.510703248Z Gathering data for ns/openshift-service-ca-operator...
2026-06-01T20:55:42.859327034Z Gathering data for ns/openshift-service-ca...
2026-06-01T20:55:43.275863842Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-01T20:55:43.501214288Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-01T20:55:44.316983619Z Wrote inspect data to must-gather.
2026-06-01T20:55:44.317027554Z error: inspection completed with the errors occurred while gathering data:
2026-06-01T20:55:44.317027554Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-01T20:55:44.454877886Z error: the server doesn't have a resource type "clusters"
2026-06-01T20:55:44.619990004Z Caches written to disk