2026-05-25T13:21:41.077213017Z [disk usage checker] Started
2026-05-25T13:21:41.080796363Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-05-25T13:21:41.283147405Z Gathering data for ns/openshift-cluster-version...
2026-05-25T13:21:41.426584109Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-05-25T13:21:41.523039571Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-25T13:21:41.609359808Z Gathering data for ns/default...
2026-05-25T13:21:41.908217789Z Gathering data for ns/openshift...
2026-05-25T13:21:42.304576552Z Gathering data for ns/kube-system...
2026-05-25T13:21:43.051142346Z Gathering data for ns/openshift-etcd...
2026-05-25T13:21:43.366518929Z Wrote inspect data to must-gather.
2026-05-25T13:21:43.366552278Z error: inspection completed with the errors occurred while gathering data:
2026-05-25T13:21:43.366552278Z     namespaces "assisted-installer" not found
2026-05-25T13:21:43.570572526Z Waiting on subprocesses to finish execution.
2026-05-25T13:21:43.577726059Z INFO: Gathering HAProxy config files
2026-05-25T13:21:43.581389781Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-05-25T13:21:43.582807416Z INFO: Gathering machine config daemon's old logs from all nodes
2026-05-25T13:21:43.593609425Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-05-25T13:21:43.606898848Z INFO: Collecting host service logs for crio
2026-05-25T13:21:43.607275943Z INFO: Collecting host service logs for kubelet
2026-05-25T13:21:43.607582628Z INFO: Collecting host service logs for rpm-ostreed
2026-05-25T13:21:43.607859431Z INFO: Collecting host service logs for ostree-finalize-staged
2026-05-25T13:21:43.608168995Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-05-25T13:21:43.608453566Z INFO: Collecting host service logs for machine-config-daemon-host
2026-05-25T13:21:43.608742076Z INFO: Collecting host service logs for NetworkManager
2026-05-25T13:21:43.609031589Z INFO: Collecting host service logs for openvswitch
2026-05-25T13:21:43.609325848Z INFO: Collecting host service logs for ovs-configuration
2026-05-25T13:21:43.609632554Z INFO: Collecting host service logs for ovsdb-server
2026-05-25T13:21:43.609934926Z INFO: Collecting host service logs for ovs-vswitchd
2026-05-25T13:21:43.610309349Z INFO: Waiting for worker host service log collection to complete ...
2026-05-25T13:21:43.655528527Z INFO: Waiting for node performance related collection to complete ...
2026-05-25T13:21:44.010812841Z No resources found
2026-05-25T13:21:44.092674797Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-05-25T13:21:44.092808860Z INFO: on-disk MachineConfig config collection complete.
2026-05-25T13:21:44.180292117Z No resources found in openshift-etcd namespace.
2026-05-25T13:21:44.443479652Z error: the server doesn't have a resource type "performanceprofile"
2026-05-25T13:21:44.532484564Z Wrote inspect data to must-gather.
2026-05-25T13:21:44.606046251Z INFO: "sriov-network-operator" not detected. Skipping.
2026-05-25T13:21:44.665636496Z INFO: Waiting for HAProxy config collection to complete ...
2026-05-25T13:21:44.783892361Z INFO: "metallb-operator" not detected. Skipping.
2026-05-25T13:21:44.790359597Z INFO: Collecting Insights Archives from insights-operator-78bdfb888c-sp5bh
2026-05-25T13:21:44.790399600Z insights-runtime-extractor-6bldh
2026-05-25T13:21:44.790431609Z insights-runtime-extractor-bmlx5
2026-05-25T13:21:44.790450770Z insights-runtime-extractor-f5nx7
2026-05-25T13:21:44.874822268Z INFO: Found 1 replicas - prometheus-k8s-0
2026-05-25T13:21:45.051810640Z INFO: Worker host service log collection to complete.
2026-05-25T13:21:45.090585470Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-05-25T13:21:45.166469093Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-05-25T13:21:45.209266931Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-05-25T13:21:45.209266931Z See 'oc rsync -h' for help and examples
2026-05-25T13:21:45.258864479Z ERROR: No running kube-apiserver pods found
2026-05-25T13:21:45.305614947Z Wrote inspect data to must-gather.
2026-05-25T13:21:45.329730742Z INFO: HAProxy config collection complete.
2026-05-25T13:21:45.333764208Z No resources found
2026-05-25T13:21:45.601750727Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-25T13:21:45.696199541Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-05-25T13:21:45.842337093Z Wrote inspect data to must-gather.
2026-05-25T13:21:45.910850406Z Wrote inspect data to must-gather.
2026-05-25T13:21:45.914145266Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-05-25T13:21:45.914896335Z Wrote inspect data to must-gather.
2026-05-25T13:21:45.934689531Z Wrote inspect data to must-gather.
2026-05-25T13:21:45.939266278Z Wrote inspect data to must-gather.
2026-05-25T13:21:46.050453775Z Gathering data for ns/openshift-monitoring...
2026-05-25T13:21:46.086855007Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-05-25T13:21:46.092026016Z INFO: 'previous-logs' folder not found on ip-10-0-132-116.ec2.internal, skipping...
2026-05-25T13:21:46.105462702Z error: the server doesn't have a resource type "machineconfigs"
2026-05-25T13:21:46.236772413Z Wrote inspect data to must-gather.
2026-05-25T13:21:46.352869924Z Wrote inspect data to must-gather.
2026-05-25T13:21:46.380799144Z INFO: Getting rules from prometheus-k8s-0
2026-05-25T13:21:46.393266252Z INFO: 'previous-logs' folder not found on ip-10-0-134-255.ec2.internal, skipping...
2026-05-25T13:21:46.523249477Z Wrote inspect data to must-gather.
2026-05-25T13:21:46.614062585Z Wrote inspect data to must-gather.
2026-05-25T13:21:46.678569124Z INFO: 'previous-logs' folder not found on ip-10-0-141-91.ec2.internal, skipping...
2026-05-25T13:21:46.678603675Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-05-25T13:21:46.678611826Z INFO: Machine Config Daemon termination log collection complete.
2026-05-25T13:21:46.777536170Z Wrote inspect data to must-gather.
2026-05-25T13:21:46.795708706Z error: the server doesn't have a resource type "kubeletconfigs"
2026-05-25T13:21:46.804480386Z INFO: Getting status/config from prometheus-k8s-0
2026-05-25T13:21:47.005446408Z Wrote inspect data to must-gather.
2026-05-25T13:21:47.092889650Z INFO: INTERCONNECT MODE
2026-05-25T13:21:47.092935267Z INFO: Gathering ovn-kubernetes DBs
2026-05-25T13:21:47.237007123Z INFO: Getting status/flags from prometheus-k8s-0
2026-05-25T13:21:47.265278642Z Wrote inspect data to must-gather.
2026-05-25T13:21:47.289074377Z INFO: Gathering OVN_Northbound from ovnkube-node-c7fb8...
2026-05-25T13:21:47.289430624Z INFO: Gathering OVN_Northbound from ovnkube-node-jxpcm...
2026-05-25T13:21:47.289698541Z INFO: Gathering OVN_Northbound from ovnkube-node-xrrrl...
2026-05-25T13:21:47.290013250Z INFO: Gathering OVN_Southbound from ovnkube-node-c7fb8...
2026-05-25T13:21:47.290363210Z INFO: Gathering OVN_Southbound from ovnkube-node-jxpcm...
2026-05-25T13:21:47.290648111Z INFO: Gathering OVN_Southbound from ovnkube-node-xrrrl...
2026-05-25T13:21:47.646388714Z tar: Removing leading `/' from member names
2026-05-25T13:21:47.662211609Z tar: Removing leading `/' from member names
2026-05-25T13:21:47.679485825Z Wrote inspect data to must-gather.
2026-05-25T13:21:47.681999475Z tar: Removing leading `/' from member names
2026-05-25T13:21:47.692933232Z tar: Removing leading `/' from member names
2026-05-25T13:21:47.693294521Z tar: Removing leading `/' from member names
2026-05-25T13:21:47.719514882Z tar: Removing leading `/' from member names
2026-05-25T13:21:47.723779797Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-05-25T13:21:47.725139018Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-05-25T13:21:47.938727440Z Wrote inspect data to must-gather.
2026-05-25T13:21:47.999345122Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-05-25T13:21:48.206743628Z Wrote inspect data to must-gather.
2026-05-25T13:21:48.215461252Z INFO: Waiting for network log collection to complete ...
2026-05-25T13:21:48.215521078Z INFO: Waiting for ovnk database copies to complete ...
2026-05-25T13:21:48.215989279Z INFO: Copying ovnk databases complete.
2026-05-25T13:21:48.217994980Z 4.4M	must-gather/network_logs/ovnk_database_store
2026-05-25T13:21:48.220732616Z ovnk_database_store/
2026-05-25T13:21:48.220783281Z ovnk_database_store/ovnkube-node-c7fb8_sbdb
2026-05-25T13:21:48.249858640Z ovnk_database_store/ovnkube-node-xrrrl_nbdb
2026-05-25T13:21:48.262420181Z ovnk_database_store/ovnkube-node-xrrrl_sbdb
2026-05-25T13:21:48.262938613Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-05-25T13:21:48.290936929Z ovnk_database_store/ovnkube-node-jxpcm_nbdb
2026-05-25T13:21:48.304678403Z ovnk_database_store/ovnkube-node-jxpcm_sbdb
2026-05-25T13:21:48.338234369Z ovnk_database_store/ovnkube-node-c7fb8_nbdb
2026-05-25T13:21:48.354366607Z INFO: Network log collection complete.
2026-05-25T13:21:48.385216574Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-25T13:21:48.495650369Z Wrote inspect data to must-gather.
2026-05-25T13:21:48.551579101Z Gathering data for ns/openshift-network-console...
2026-05-25T13:21:48.681394118Z INFO: Getting status from alertmanager-main-0
2026-05-25T13:21:48.799973354Z Wrote inspect data to must-gather.
2026-05-25T13:21:48.982348027Z Gathering data for ns/openshift-console-operator...
2026-05-25T13:21:49.092790164Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-05-25T13:21:49.095172579Z INFO: Fallback to identify the container image from release info
2026-05-25T13:21:49.344414371Z Gathering data for ns/openshift-console...
2026-05-25T13:21:49.587684230Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:934b226bb305ecfe687cdb9684d7d4cf04b130e6254c2817dd1a6112d4829bda
2026-05-25T13:21:49.725934544Z daemonset.apps/perf-node-gather-daemonset created
2026-05-25T13:21:49.787460586Z Gathering data for ns/openshift-cluster-storage-operator...
2026-05-25T13:21:49.865247032Z Waiting for performance profile collector pods to become ready: 1
2026-05-25T13:21:50.111218174Z Gathering data for ns/openshift-dns-operator...
2026-05-25T13:21:50.394414333Z Gathering data for ns/openshift-dns...
2026-05-25T13:21:50.939334343Z Gathering data for ns/openshift-image-registry...
2026-05-25T13:21:51.002450041Z Waiting for performance profile collector pods to become ready: 2
2026-05-25T13:21:51.093731101Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-05-25T13:21:51.407403731Z Gathering data for ns/openshift-ingress-operator...
2026-05-25T13:21:51.688114991Z Gathering data for ns/openshift-ingress...
2026-05-25T13:21:51.996714952Z Gathering data for ns/openshift-ingress-canary...
2026-05-25T13:21:52.139431701Z Waiting for performance profile collector pods to become ready: 3
2026-05-25T13:21:52.356564444Z Gathering data for ns/openshift-insights...
2026-05-25T13:21:53.257638852Z Waiting for performance profile collector pods to become ready: 4
2026-05-25T13:21:54.383442785Z Waiting for performance profile collector pods to become ready: 5
2026-05-25T13:21:54.420356440Z Gathering data for ns/kserve...
2026-05-25T13:21:55.517291624Z Waiting for performance profile collector pods to become ready: 6
2026-05-25T13:21:56.099199569Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-05-25T13:21:56.520305622Z Gathering data for ns/openshift-config...
2026-05-25T13:21:56.653790570Z Waiting for performance profile collector pods to become ready: 7
2026-05-25T13:21:56.764596760Z Gathering data for ns/openshift-config-managed...
2026-05-25T13:21:57.173916821Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-05-25T13:21:57.508393337Z Gathering data for ns/openshift-kube-apiserver...
2026-05-25T13:21:57.761533463Z Gathering data for ns/openshift-kube-controller-manager...
2026-05-25T13:21:57.805495070Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-05-25T13:21:58.079767591Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-05-25T13:21:58.125460349Z Collecting performance related data for node ip-10-0-134-255.ec2.internal
2026-05-25T13:21:58.136764152Z Collecting performance related data for node ip-10-0-132-116.ec2.internal
2026-05-25T13:21:58.147521454Z Collecting performance related data for node ip-10-0-141-91.ec2.internal
2026-05-25T13:21:58.405659285Z Gathering data for ns/openshift-kube-scheduler...
2026-05-25T13:21:58.706460453Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-05-25T13:21:59.070972644Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-05-25T13:21:59.443232668Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-05-25T13:21:59.849625449Z Gathering data for ns/openshift-user-workload-monitoring...
2026-05-25T13:22:00.315567402Z Gathering data for ns/openshift-multus...
2026-05-25T13:22:01.104482589Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-05-25T13:22:01.890988447Z Gathering data for ns/openshift-ovn-kubernetes...
2026-05-25T13:22:04.081349993Z Gathering data for ns/openshift-host-network...
2026-05-25T13:22:04.482125617Z Gathering data for ns/openshift-network-diagnostics...
2026-05-25T13:22:05.037755729Z Gathering data for ns/openshift-network-node-identity...
2026-05-25T13:22:05.503744378Z Gathering data for ns/openshift-network-operator...
2026-05-25T13:22:05.876137975Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-05-25T13:22:06.110374122Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-05-25T13:22:06.229307124Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-05-25T13:22:06.549006017Z Collecting kubelet logs for node ip-10-0-134-255.ec2.internal
2026-05-25T13:22:06.551543379Z Collecting kubelet logs for node ip-10-0-132-116.ec2.internal
2026-05-25T13:22:06.554747099Z Collecting kubelet logs for node ip-10-0-141-91.ec2.internal
2026-05-25T13:22:06.701673890Z Gathering data for ns/openshift-apiserver-operator...
2026-05-25T13:22:06.957959707Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-05-25T13:22:06.963035740Z INFO: Node performance data collection complete.
2026-05-25T13:22:07.051544762Z Gathering data for ns/openshift-apiserver...
2026-05-25T13:22:07.484363183Z Gathering data for ns/openshift-controller-manager-operator...
2026-05-25T13:22:07.764333357Z Gathering data for ns/openshift-controller-manager...
2026-05-25T13:22:08.060193059Z Gathering data for ns/openshift-cluster-samples-operator...
2026-05-25T13:22:08.776287290Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-05-25T13:22:09.109941278Z Gathering data for ns/openshift-service-ca-operator...
2026-05-25T13:22:09.492353164Z Gathering data for ns/openshift-service-ca...
2026-05-25T13:22:09.857991233Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-05-25T13:22:10.848370720Z Wrote inspect data to must-gather.
2026-05-25T13:22:10.848421050Z error: inspection completed with the errors occurred while gathering data:
2026-05-25T13:22:10.848421050Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-05-25T13:22:10.984395733Z error: the server doesn't have a resource type "clusters"
2026-05-25T13:22:11.116717116Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-05-25T13:22:11.132500662Z Caches written to disk