2026-05-21T17:06:55.911922319Z [disk usage checker] Started
2026-05-21T17:06:55.915300571Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-05-21T17:06:56.161905750Z Gathering data for ns/openshift-cluster-version...
2026-05-21T17:06:56.327157502Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-05-21T17:06:56.421358549Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-21T17:06:56.522010884Z Gathering data for ns/default...
2026-05-21T17:06:56.862217499Z Gathering data for ns/openshift...
2026-05-21T17:06:57.327575031Z Gathering data for ns/kube-system...
2026-05-21T17:06:58.051212986Z Gathering data for ns/openshift-etcd...
2026-05-21T17:06:58.421324623Z Waiting on subprocesses to finish execution.
2026-05-21T17:06:58.430271931Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-05-21T17:06:58.430970900Z INFO: Gathering machine config daemon's old logs from all nodes
2026-05-21T17:06:58.434957646Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-05-21T17:06:58.436659557Z INFO: Gathering HAProxy config files
2026-05-21T17:06:58.462601875Z INFO: Collecting host service logs for crio
2026-05-21T17:06:58.462882596Z INFO: Collecting host service logs for kubelet
2026-05-21T17:06:58.463355281Z INFO: Collecting host service logs for rpm-ostreed
2026-05-21T17:06:58.463694000Z INFO: Collecting host service logs for ostree-finalize-staged
2026-05-21T17:06:58.464030418Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-05-21T17:06:58.464388964Z INFO: Collecting host service logs for machine-config-daemon-host
2026-05-21T17:06:58.464737566Z INFO: Collecting host service logs for NetworkManager
2026-05-21T17:06:58.465070908Z INFO: Collecting host service logs for openvswitch
2026-05-21T17:06:58.465420833Z INFO: Collecting host service logs for ovs-configuration
2026-05-21T17:06:58.465772405Z INFO: Collecting host service logs for ovsdb-server
2026-05-21T17:06:58.466198303Z INFO: Collecting host service logs for ovs-vswitchd
2026-05-21T17:06:58.466720640Z INFO: Waiting for worker host service log collection to complete ...
2026-05-21T17:06:58.475160442Z INFO: Waiting for node performance related collection to complete ...
2026-05-21T17:06:58.561318660Z Wrote inspect data to must-gather.
2026-05-21T17:06:58.561442379Z error: inspection completed with the errors occurred while gathering data:
2026-05-21T17:06:58.561442379Z     namespaces "assisted-installer" not found
2026-05-21T17:06:59.112766726Z INFO: Found 1 replicas - prometheus-k8s-0
2026-05-21T17:06:59.140754633Z INFO: "metallb-operator" not detected. Skipping.
2026-05-21T17:06:59.163452166Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-05-21T17:06:59.381572122Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-05-21T17:06:59.381684241Z INFO: on-disk MachineConfig config collection complete.
2026-05-21T17:06:59.433644016Z INFO: Collecting Insights Archives from insights-operator-78bdfb888c-dnchd
2026-05-21T17:06:59.433692756Z insights-runtime-extractor-5nr7k
2026-05-21T17:06:59.433715020Z insights-runtime-extractor-6dhx4
2026-05-21T17:06:59.433735570Z insights-runtime-extractor-lpq4h
2026-05-21T17:06:59.483438686Z INFO: "sriov-network-operator" not detected. Skipping.
2026-05-21T17:06:59.505790477Z No resources found in openshift-etcd namespace.
2026-05-21T17:06:59.760282445Z Wrote inspect data to must-gather.
2026-05-21T17:06:59.799525506Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-05-21T17:06:59.844414761Z ERROR: No running kube-apiserver pods found
2026-05-21T17:06:59.916738850Z INFO: Worker host service log collection to complete.
2026-05-21T17:07:00.004223682Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-05-21T17:07:00.004223682Z See 'oc rsync -h' for help and examples
2026-05-21T17:07:00.050811210Z INFO: Waiting for HAProxy config collection to complete ...
2026-05-21T17:07:00.052952221Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-05-21T17:07:00.060720678Z No resources found
2026-05-21T17:07:00.129057049Z error: the server doesn't have a resource type "performanceprofile"
2026-05-21T17:07:00.540265243Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-21T17:07:00.658290306Z tar: Removing leading `/' from member names
2026-05-21T17:07:00.666772920Z INFO: HAProxy config collection complete.
2026-05-21T17:07:00.765330785Z Wrote inspect data to must-gather.
2026-05-21T17:07:00.881418515Z INFO: 'previous-logs' folder not found on ip-10-0-130-217.ec2.internal, skipping...
2026-05-21T17:07:01.062996590Z Wrote inspect data to must-gather.
2026-05-21T17:07:01.099049511Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-05-21T17:07:01.175771237Z Wrote inspect data to must-gather.
2026-05-21T17:07:01.190078211Z No resources found
2026-05-21T17:07:01.351626604Z INFO: Getting rules from prometheus-k8s-0
2026-05-21T17:07:01.361021070Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-05-21T17:07:01.369636862Z Wrote inspect data to must-gather.
2026-05-21T17:07:01.478191354Z Gathering data for ns/kuadrant-system...
2026-05-21T17:07:01.515329379Z Wrote inspect data to must-gather.
2026-05-21T17:07:01.596748527Z INFO: 'previous-logs' folder not found on ip-10-0-136-21.ec2.internal, skipping...
2026-05-21T17:07:01.619202938Z Wrote inspect data to must-gather.
2026-05-21T17:07:01.640394657Z error: the server doesn't have a resource type "machineconfigs"
2026-05-21T17:07:01.952579894Z Wrote inspect data to must-gather.
2026-05-21T17:07:01.963726737Z INFO: Getting status/config from prometheus-k8s-0
2026-05-21T17:07:01.993921932Z Wrote inspect data to must-gather.
2026-05-21T17:07:01.997071031Z INFO: 'previous-logs' folder not found on ip-10-0-141-23.ec2.internal, skipping...
2026-05-21T17:07:01.997097641Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-05-21T17:07:01.997148993Z INFO: Machine Config Daemon termination log collection complete.
2026-05-21T17:07:02.291901263Z Wrote inspect data to must-gather.
2026-05-21T17:07:02.318685804Z Wrote inspect data to must-gather.
2026-05-21T17:07:02.533925355Z INFO: Getting status/flags from prometheus-k8s-0
2026-05-21T17:07:02.566468813Z error: the server doesn't have a resource type "kubeletconfigs"
2026-05-21T17:07:02.689054626Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-05-21T17:07:02.705678117Z INFO: INTERCONNECT MODE
2026-05-21T17:07:02.705724100Z INFO: Gathering ovn-kubernetes DBs
2026-05-21T17:07:02.782175612Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-05-21T17:07:02.893374104Z Wrote inspect data to must-gather.
2026-05-21T17:07:02.937094031Z INFO: Gathering OVN_Northbound from ovnkube-node-9th77...
2026-05-21T17:07:02.937380535Z INFO: Gathering OVN_Northbound from ovnkube-node-btskc...
2026-05-21T17:07:02.937624955Z INFO: Gathering OVN_Northbound from ovnkube-node-m87sz...
2026-05-21T17:07:02.938001757Z INFO: Gathering OVN_Southbound from ovnkube-node-9th77...
2026-05-21T17:07:02.938321620Z INFO: Gathering OVN_Southbound from ovnkube-node-btskc...
2026-05-21T17:07:02.938624528Z INFO: Gathering OVN_Southbound from ovnkube-node-m87sz...
2026-05-21T17:07:03.150427079Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-05-21T17:07:03.313721820Z Wrote inspect data to must-gather.
2026-05-21T17:07:03.329262047Z tar: Removing leading `/' from member names
2026-05-21T17:07:03.330792578Z tar: Removing leading `/' from member names
2026-05-21T17:07:03.363090402Z tar: Removing leading `/' from member names
2026-05-21T17:07:03.384333152Z tar: Removing leading `/' from member names
2026-05-21T17:07:03.442358930Z tar: Removing leading `/' from member names
2026-05-21T17:07:03.471469515Z tar: Removing leading `/' from member names
2026-05-21T17:07:03.502064543Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-21T17:07:03.616326309Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-05-21T17:07:03.765619127Z Wrote inspect data to must-gather.
2026-05-21T17:07:03.796413134Z Gathering data for ns/openshift-monitoring...
2026-05-21T17:07:04.087916419Z INFO: Getting status from alertmanager-main-0
2026-05-21T17:07:04.095610594Z INFO: Waiting for network log collection to complete ...
2026-05-21T17:07:04.095674130Z INFO: Waiting for ovnk database copies to complete ...
2026-05-21T17:07:04.096220804Z INFO: Copying ovnk databases complete.
2026-05-21T17:07:04.098531824Z 4.1M	must-gather/network_logs/ovnk_database_store
2026-05-21T17:07:04.101257701Z ovnk_database_store/
2026-05-21T17:07:04.101257701Z ovnk_database_store/ovnkube-node-btskc_sbdb
2026-05-21T17:07:04.142773954Z ovnk_database_store/ovnkube-node-btskc_nbdb
2026-05-21T17:07:04.155754350Z ovnk_database_store/ovnkube-node-9th77_sbdb
2026-05-21T17:07:04.184362159Z ovnk_database_store/ovnkube-node-9th77_nbdb
2026-05-21T17:07:04.188513792Z Wrote inspect data to must-gather.
2026-05-21T17:07:04.196331998Z ovnk_database_store/ovnkube-node-m87sz_sbdb
2026-05-21T17:07:04.228695551Z ovnk_database_store/ovnkube-node-m87sz_nbdb
2026-05-21T17:07:04.244110410Z INFO: Network log collection complete.
2026-05-21T17:07:04.497121626Z Wrote inspect data to must-gather.
2026-05-21T17:07:04.805435255Z Wrote inspect data to must-gather.
2026-05-21T17:07:05.098588850Z Wrote inspect data to must-gather.
2026-05-21T17:07:05.384741457Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-05-21T17:07:05.387175663Z INFO: Fallback to identify the container image from release info
2026-05-21T17:07:05.900995567Z Gathering data for ns/openshift-network-console...
2026-05-21T17:07:05.974732325Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:934b226bb305ecfe687cdb9684d7d4cf04b130e6254c2817dd1a6112d4829bda
2026-05-21T17:07:06.103521900Z daemonset.apps/perf-node-gather-daemonset created
2026-05-21T17:07:06.111576324Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-05-21T17:07:06.281882447Z Waiting for performance profile collector pods to become ready: 1
2026-05-21T17:07:06.445355902Z Gathering data for ns/openshift-console-operator...
2026-05-21T17:07:06.929222677Z Gathering data for ns/openshift-console...
2026-05-21T17:07:07.444152317Z Waiting for performance profile collector pods to become ready: 2
2026-05-21T17:07:07.450916898Z Gathering data for ns/openshift-cluster-storage-operator...
2026-05-21T17:07:07.795671345Z Wrote inspect data to must-gather.
2026-05-21T17:07:07.836935304Z Gathering data for ns/openshift-dns-operator...
2026-05-21T17:07:08.148996708Z Gathering data for ns/openshift-dns...
2026-05-21T17:07:08.560654393Z Waiting for performance profile collector pods to become ready: 3
2026-05-21T17:07:08.750512257Z Gathering data for ns/openshift-image-registry...
2026-05-21T17:07:09.226502695Z Gathering data for ns/openshift-ingress-operator...
2026-05-21T17:07:09.588694275Z Gathering data for ns/openshift-ingress...
2026-05-21T17:07:09.686851038Z Waiting for performance profile collector pods to become ready: 4
2026-05-21T17:07:10.377883324Z Gathering data for ns/openshift-ingress-canary...
2026-05-21T17:07:10.812306739Z Waiting for performance profile collector pods to become ready: 5
2026-05-21T17:07:10.902041446Z Gathering data for ns/openshift-insights...
2026-05-21T17:07:11.116233285Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-05-21T17:07:11.924424026Z Waiting for performance profile collector pods to become ready: 6
2026-05-21T17:07:12.967937319Z Gathering data for ns/opendatahub...
2026-05-21T17:07:13.058987236Z Waiting for performance profile collector pods to become ready: 7
2026-05-21T17:07:14.190219496Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-05-21T17:07:14.404308607Z Gathering data for ns/openshift-lws-operator...
2026-05-21T17:07:14.425451946Z Collecting performance related data for node ip-10-0-136-21.ec2.internal
2026-05-21T17:07:14.432389213Z Collecting performance related data for node ip-10-0-130-217.ec2.internal
2026-05-21T17:07:14.440300648Z Collecting performance related data for node ip-10-0-141-23.ec2.internal
2026-05-21T17:07:15.963965097Z Gathering data for ns/openshift-config...
2026-05-21T17:07:16.120672809Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-05-21T17:07:16.270995520Z Gathering data for ns/openshift-config-managed...
2026-05-21T17:07:16.746900387Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-05-21T17:07:17.079355154Z Gathering data for ns/openshift-kube-apiserver...
2026-05-21T17:07:17.421527917Z Gathering data for ns/openshift-kube-controller-manager...
2026-05-21T17:07:17.772287038Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-05-21T17:07:18.113383484Z Gathering data for ns/openshift-kube-scheduler...
2026-05-21T17:07:18.386328592Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-05-21T17:07:18.733244676Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-05-21T17:07:19.100820172Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-05-21T17:07:19.490755228Z Gathering data for ns/openshift-user-workload-monitoring...
2026-05-21T17:07:20.069249309Z Gathering data for ns/openshift-multus...
2026-05-21T17:07:21.125271615Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-05-21T17:07:21.906591339Z Gathering data for ns/openshift-ovn-kubernetes...
2026-05-21T17:07:23.223604696Z Collecting kubelet logs for node ip-10-0-136-21.ec2.internal
2026-05-21T17:07:23.225557090Z Collecting kubelet logs for node ip-10-0-130-217.ec2.internal
2026-05-21T17:07:23.227590611Z Collecting kubelet logs for node ip-10-0-141-23.ec2.internal
2026-05-21T17:07:23.403738631Z Gathering data for ns/openshift-host-network...
2026-05-21T17:07:23.644525513Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-05-21T17:07:23.652023015Z INFO: Node performance data collection complete.
2026-05-21T17:07:23.790102311Z Gathering data for ns/openshift-network-diagnostics...
2026-05-21T17:07:24.343078008Z Gathering data for ns/openshift-network-node-identity...
2026-05-21T17:07:24.771025718Z Gathering data for ns/openshift-network-operator...
2026-05-21T17:07:25.149126226Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-05-21T17:07:25.452589987Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-05-21T17:07:25.919032419Z Gathering data for ns/openshift-apiserver-operator...
2026-05-21T17:07:26.129938569Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-05-21T17:07:26.251233417Z Gathering data for ns/openshift-apiserver...
2026-05-21T17:07:26.667555070Z Gathering data for ns/openshift-controller-manager-operator...
2026-05-21T17:07:26.964395143Z Gathering data for ns/openshift-controller-manager...
2026-05-21T17:07:27.277825205Z Gathering data for ns/openshift-cluster-samples-operator...
2026-05-21T17:07:27.928660733Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-05-21T17:07:28.270818292Z Gathering data for ns/openshift-service-ca-operator...
2026-05-21T17:07:28.587003715Z Gathering data for ns/openshift-service-ca...
2026-05-21T17:07:28.971395912Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-05-21T17:07:30.034320080Z Wrote inspect data to must-gather.
2026-05-21T17:07:30.034364854Z error: inspection completed with the errors occurred while gathering data:
2026-05-21T17:07:30.034364854Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-05-21T17:07:30.171104427Z error: the server doesn't have a resource type "clusters"
2026-05-21T17:07:30.586840849Z Caches written to disk