2026-04-16T10:55:00.474924533Z [disk usage checker] Started
2026-04-16T10:55:00.478453569Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-16T10:55:00.690275132Z Gathering data for ns/openshift-cluster-version...
2026-04-16T10:55:00.816206190Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-16T10:55:00.919219193Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-16T10:55:01.007985587Z Gathering data for ns/default...
2026-04-16T10:55:01.378343707Z Gathering data for ns/openshift...
2026-04-16T10:55:01.826213321Z Gathering data for ns/kube-system...
2026-04-16T10:55:02.590802998Z Gathering data for ns/openshift-etcd...
2026-04-16T10:55:02.741559931Z Waiting on subprocesses to finish execution.
2026-04-16T10:55:02.747960340Z INFO: Gathering HAProxy config files
2026-04-16T10:55:02.750684422Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-04-16T10:55:02.756516538Z INFO: Collecting host service logs for crio
2026-04-16T10:55:02.756983434Z INFO: Collecting host service logs for kubelet
2026-04-16T10:55:02.757430562Z INFO: Collecting host service logs for rpm-ostreed
2026-04-16T10:55:02.758306778Z INFO: Collecting host service logs for ostree-finalize-staged
2026-04-16T10:55:02.758661562Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-04-16T10:55:02.759000875Z INFO: Collecting host service logs for machine-config-daemon-host
2026-04-16T10:55:02.759159505Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-04-16T10:55:02.759341037Z INFO: Collecting host service logs for NetworkManager
2026-04-16T10:55:02.759653412Z INFO: Collecting host service logs for openvswitch
2026-04-16T10:55:02.759961956Z INFO: Collecting host service logs for ovs-configuration
2026-04-16T10:55:02.760307215Z INFO: Collecting host service logs for ovsdb-server
2026-04-16T10:55:02.760623197Z INFO: Collecting host service logs for ovs-vswitchd
2026-04-16T10:55:02.761003728Z INFO: Waiting for worker host service log collection to complete ...
2026-04-16T10:55:02.761446322Z INFO: Gathering machine config daemon's old logs from all nodes
2026-04-16T10:55:02.890489991Z INFO: Waiting for node performance related collection to complete ...
2026-04-16T10:55:03.488314165Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-04-16T10:55:03.683206888Z Wrote inspect data to must-gather.
2026-04-16T10:55:03.713194163Z Wrote inspect data to must-gather.
2026-04-16T10:55:03.713231890Z error: inspection completed with the errors occurred while gathering data:
2026-04-16T10:55:03.713231890Z     namespaces "assisted-installer" not found
2026-04-16T10:55:03.722560209Z error: the server doesn't have a resource type "performanceprofile"
2026-04-16T10:55:03.762942472Z INFO: "sriov-network-operator" not detected. Skipping.
2026-04-16T10:55:03.885271999Z No resources found
2026-04-16T10:55:04.000658080Z No resources found in openshift-etcd namespace.
2026-04-16T10:55:04.008327337Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-04-16T10:55:04.081012466Z INFO: "metallb-operator" not detected. Skipping.
2026-04-16T10:55:04.103382982Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-04-16T10:55:04.103477604Z INFO: on-disk MachineConfig config collection complete.
2026-04-16T10:55:04.246100654Z INFO: Found 1 replicas - prometheus-k8s-0
2026-04-16T10:55:04.246788691Z INFO: Collecting Insights Archives from insights-operator-5785d4fcdd-fcg2p
2026-04-16T10:55:04.246788691Z insights-runtime-extractor-2b85g
2026-04-16T10:55:04.246788691Z insights-runtime-extractor-jjxh6
2026-04-16T10:55:04.246788691Z insights-runtime-extractor-xf8wh
2026-04-16T10:55:04.318846547Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-16T10:55:04.329139032Z INFO: Worker host service log collection to complete.
2026-04-16T10:55:04.523940431Z Wrote inspect data to must-gather.
2026-04-16T10:55:04.605852968Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-04-16T10:55:04.633153597Z INFO: Waiting for HAProxy config collection to complete ...
2026-04-16T10:55:04.647048139Z Wrote inspect data to must-gather.
2026-04-16T10:55:04.756669171Z Wrote inspect data to must-gather.
2026-04-16T10:55:04.819829942Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-04-16T10:55:04.819829942Z See 'oc rsync -h' for help and examples
2026-04-16T10:55:04.854016448Z ERROR: No running kube-apiserver pods found
2026-04-16T10:55:04.855835766Z Wrote inspect data to must-gather.
2026-04-16T10:55:04.884616616Z No resources found
2026-04-16T10:55:04.927876313Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-04-16T10:55:04.972480887Z Wrote inspect data to must-gather.
2026-04-16T10:55:05.010787110Z Wrote inspect data to must-gather.
2026-04-16T10:55:05.062619041Z INFO: 'previous-logs' folder not found on ip-10-0-135-1.ec2.internal, skipping...
2026-04-16T10:55:05.100833341Z Wrote inspect data to must-gather.
2026-04-16T10:55:05.105150148Z Gathering data for ns/openshift-monitoring...
2026-04-16T10:55:05.119494918Z tar: Removing leading `/' from member names
2026-04-16T10:55:05.132022700Z INFO: HAProxy config collection complete.
2026-04-16T10:55:05.183782815Z error: the server doesn't have a resource type "machineconfigs"
2026-04-16T10:55:05.332639562Z INFO: 'previous-logs' folder not found on ip-10-0-135-215.ec2.internal, skipping...
2026-04-16T10:55:05.356706029Z Wrote inspect data to must-gather.
2026-04-16T10:55:05.396606244Z Wrote inspect data to must-gather.
2026-04-16T10:55:05.415128483Z INFO: Getting rules from prometheus-k8s-0
2026-04-16T10:55:05.484856043Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-16T10:55:05.610816027Z Wrote inspect data to must-gather.
2026-04-16T10:55:05.612572608Z INFO: 'previous-logs' folder not found on ip-10-0-143-196.ec2.internal, skipping...
2026-04-16T10:55:05.612621453Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-04-16T10:55:05.612651774Z INFO: Machine Config Daemon termination log collection complete.
2026-04-16T10:55:05.617946994Z Wrote inspect data to must-gather.
2026-04-16T10:55:05.755322713Z error: the server doesn't have a resource type "kubeletconfigs"
2026-04-16T10:55:05.866180311Z INFO: Getting status/config from prometheus-k8s-0
2026-04-16T10:55:05.887993781Z INFO: INTERCONNECT MODE
2026-04-16T10:55:05.888021722Z INFO: Gathering ovn-kubernetes DBs
2026-04-16T10:55:05.968038657Z Wrote inspect data to must-gather.
2026-04-16T10:55:06.040369825Z INFO: Gathering OVN_Northbound from ovnkube-node-g7t7h...
2026-04-16T10:55:06.040590716Z INFO: Gathering OVN_Northbound from ovnkube-node-rk78v...
2026-04-16T10:55:06.040811784Z INFO: Gathering OVN_Northbound from ovnkube-node-tmhhw...
2026-04-16T10:55:06.041034330Z INFO: Gathering OVN_Southbound from ovnkube-node-g7t7h...
2026-04-16T10:55:06.041251382Z INFO: Gathering OVN_Southbound from ovnkube-node-rk78v...
2026-04-16T10:55:06.041495103Z INFO: Gathering OVN_Southbound from ovnkube-node-tmhhw...
2026-04-16T10:55:06.254493694Z Wrote inspect data to must-gather.
2026-04-16T10:55:06.324913775Z tar: Removing leading `/' from member names
2026-04-16T10:55:06.335119319Z tar: Removing leading `/' from member names
2026-04-16T10:55:06.335872023Z tar: Removing leading `/' from member names
2026-04-16T10:55:06.349220341Z tar: Removing leading `/' from member names
2026-04-16T10:55:06.353733353Z tar: Removing leading `/' from member names
2026-04-16T10:55:06.369829603Z tar: Removing leading `/' from member names
2026-04-16T10:55:06.378581321Z INFO: Getting status/flags from prometheus-k8s-0
2026-04-16T10:55:06.491036514Z Wrote inspect data to must-gather.
2026-04-16T10:55:06.667652421Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-04-16T10:55:06.718680311Z Wrote inspect data to must-gather.
2026-04-16T10:55:06.765321140Z INFO: Waiting for network log collection to complete ...
2026-04-16T10:55:06.765371778Z INFO: Waiting for ovnk database copies to complete ...
2026-04-16T10:55:06.765885838Z INFO: Copying ovnk databases complete.
2026-04-16T10:55:06.767479788Z 3.2M	must-gather/network_logs/ovnk_database_store
2026-04-16T10:55:06.770084705Z ovnk_database_store/
2026-04-16T10:55:06.770084705Z ovnk_database_store/ovnkube-node-g7t7h_sbdb
2026-04-16T10:55:06.792289720Z ovnk_database_store/ovnkube-node-rk78v_nbdb
2026-04-16T10:55:06.800579920Z ovnk_database_store/ovnkube-node-rk78v_sbdb
2026-04-16T10:55:06.818895612Z ovnk_database_store/ovnkube-node-g7t7h_nbdb
2026-04-16T10:55:06.827654678Z ovnk_database_store/ovnkube-node-tmhhw_sbdb
2026-04-16T10:55:06.842780284Z ovnk_database_store/ovnkube-node-tmhhw_nbdb
2026-04-16T10:55:06.852910930Z INFO: Network log collection complete.
2026-04-16T10:55:06.912380802Z Wrote inspect data to must-gather.
2026-04-16T10:55:06.960758708Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-04-16T10:55:07.084447801Z Wrote inspect data to must-gather.
2026-04-16T10:55:07.173910524Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-04-16T10:55:07.288649878Z Wrote inspect data to must-gather.
2026-04-16T10:55:07.360974429Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-16T10:55:07.525116081Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-04-16T10:55:07.527870644Z INFO: Fallback to identify the container image from release info
2026-04-16T10:55:07.548047579Z INFO: Getting status from alertmanager-main-0
2026-04-16T10:55:07.875884191Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-16T10:55:08.029786120Z Gathering data for ns/openshift-network-console...
2026-04-16T10:55:08.029924025Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc77fc5f1546189d6b57967ccc684e794bd846ea36c3e3c1e61d83a684f0f9b9
2026-04-16T10:55:08.156206764Z daemonset.apps/perf-node-gather-daemonset created
2026-04-16T10:55:08.270443492Z Waiting for performance profile collector pods to become ready: 1
2026-04-16T10:55:08.443846314Z Gathering data for ns/openshift-console-operator...
2026-04-16T10:55:08.854167285Z Gathering data for ns/openshift-console...
2026-04-16T10:55:09.256307776Z Gathering data for ns/openshift-cluster-storage-operator...
2026-04-16T10:55:09.388356050Z Waiting for performance profile collector pods to become ready: 2
2026-04-16T10:55:09.578984833Z Gathering data for ns/openshift-dns-operator...
2026-04-16T10:55:09.880268370Z Gathering data for ns/openshift-dns...
2026-04-16T10:55:10.490045577Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-16T10:55:10.498407696Z Gathering data for ns/openshift-image-registry...
2026-04-16T10:55:10.510568962Z Waiting for performance profile collector pods to become ready: 3
2026-04-16T10:55:10.973937376Z Gathering data for ns/openshift-ingress-operator...
2026-04-16T10:55:11.326949384Z Gathering data for ns/openshift-ingress...
2026-04-16T10:55:11.628780651Z Waiting for performance profile collector pods to become ready: 4
2026-04-16T10:55:11.651885345Z Gathering data for ns/openshift-ingress-canary...
2026-04-16T10:55:12.053520167Z Gathering data for ns/openshift-insights...
2026-04-16T10:55:12.750878874Z Waiting for performance profile collector pods to become ready: 5
2026-04-16T10:55:13.857159129Z Waiting for performance profile collector pods to become ready: 6
2026-04-16T10:55:14.004095278Z Gathering data for ns/openshift-jobset-operator...
2026-04-16T10:55:14.771085583Z Gathering data for ns/openshift-config...
2026-04-16T10:55:14.971633691Z Waiting for performance profile collector pods to become ready: 7
2026-04-16T10:55:15.023719507Z Gathering data for ns/openshift-config-managed...
2026-04-16T10:55:15.416957319Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-04-16T10:55:15.494927981Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-16T10:55:15.672355037Z Gathering data for ns/openshift-kube-apiserver...
2026-04-16T10:55:15.920521350Z Gathering data for ns/openshift-kube-controller-manager...
2026-04-16T10:55:16.083943060Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-04-16T10:55:16.207229457Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-04-16T10:55:16.344762291Z Collecting performance related data for node ip-10-0-143-196.ec2.internal
2026-04-16T10:55:16.353183709Z Collecting performance related data for node ip-10-0-135-1.ec2.internal
2026-04-16T10:55:16.361365963Z Collecting performance related data for node ip-10-0-135-215.ec2.internal
2026-04-16T10:55:16.541638734Z Gathering data for ns/openshift-kube-scheduler...
2026-04-16T10:55:16.826719681Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-04-16T10:55:17.194949477Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-04-16T10:55:17.576212530Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-04-16T10:55:17.958413242Z Gathering data for ns/openshift-user-workload-monitoring...
2026-04-16T10:55:18.450934857Z Gathering data for ns/openshift-multus...
2026-04-16T10:55:20.049035673Z Gathering data for ns/openshift-ovn-kubernetes...
2026-04-16T10:55:20.499380939Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-16T10:55:21.730116788Z Gathering data for ns/openshift-host-network...
2026-04-16T10:55:22.041663029Z Gathering data for ns/openshift-network-diagnostics...
2026-04-16T10:55:22.555245593Z Gathering data for ns/openshift-network-node-identity...
2026-04-16T10:55:22.929133759Z Gathering data for ns/openshift-network-operator...
2026-04-16T10:55:23.300854326Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-04-16T10:55:23.543165474Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-04-16T10:55:24.035850492Z Gathering data for ns/openshift-apiserver-operator...
2026-04-16T10:55:24.332638108Z Gathering data for ns/openshift-apiserver...
2026-04-16T10:55:24.365232514Z Collecting kubelet logs for node ip-10-0-143-196.ec2.internal
2026-04-16T10:55:24.367575104Z Collecting kubelet logs for node ip-10-0-135-1.ec2.internal
2026-04-16T10:55:24.369649058Z Collecting kubelet logs for node ip-10-0-135-215.ec2.internal
2026-04-16T10:55:24.708315379Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-04-16T10:55:24.714370189Z INFO: Node performance data collection complete.
2026-04-16T10:55:24.771553475Z Gathering data for ns/openshift-controller-manager-operator...
2026-04-16T10:55:25.070610196Z Gathering data for ns/openshift-controller-manager...
2026-04-16T10:55:25.324892513Z Gathering data for ns/openshift-cluster-samples-operator...
2026-04-16T10:55:25.503927330Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-16T10:55:25.942419433Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-04-16T10:55:26.207439849Z Gathering data for ns/openshift-service-ca-operator...
2026-04-16T10:55:26.578662113Z Gathering data for ns/openshift-service-ca...
2026-04-16T10:55:26.947166657Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-04-16T10:55:27.846949399Z Wrote inspect data to must-gather.
2026-04-16T10:55:27.846999343Z error: inspection completed with the errors occurred while gathering data:
2026-04-16T10:55:27.846999343Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-04-16T10:55:27.967441097Z error: the server doesn't have a resource type "clusters"
2026-04-16T10:55:28.103786830Z Caches written to disk