2026-04-17T09:20:27.089317504Z [disk usage checker] Started
2026-04-17T09:20:27.125752738Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-17T09:20:27.302798894Z Gathering data for ns/openshift-cluster-version...
2026-04-17T09:20:27.421006256Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-17T09:20:27.503454810Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-17T09:20:27.590713025Z Gathering data for ns/default...
2026-04-17T09:20:27.879225807Z Gathering data for ns/openshift...
2026-04-17T09:20:28.314433914Z Gathering data for ns/kube-system...
2026-04-17T09:20:28.996364653Z Gathering data for ns/openshift-etcd...
2026-04-17T09:20:29.325072966Z Wrote inspect data to must-gather.
2026-04-17T09:20:29.325113164Z error: inspection completed with the errors occurred while gathering data:
2026-04-17T09:20:29.325113164Z     namespaces "assisted-installer" not found
2026-04-17T09:20:29.408247180Z Waiting on subprocesses to finish execution.
2026-04-17T09:20:29.419190995Z INFO: Gathering machine config daemon's old logs from all nodes
2026-04-17T09:20:29.419720733Z INFO: Collecting host service logs for crio
2026-04-17T09:20:29.420067992Z INFO: Collecting host service logs for kubelet
2026-04-17T09:20:29.420411368Z INFO: Collecting host service logs for rpm-ostreed
2026-04-17T09:20:29.420764888Z INFO: Collecting host service logs for ostree-finalize-staged
2026-04-17T09:20:29.421122587Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-04-17T09:20:29.421626291Z INFO: Collecting host service logs for machine-config-daemon-host
2026-04-17T09:20:29.421998066Z INFO: Collecting host service logs for NetworkManager
2026-04-17T09:20:29.422287060Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-04-17T09:20:29.422328590Z INFO: Collecting host service logs for openvswitch
2026-04-17T09:20:29.422627018Z INFO: Collecting host service logs for ovs-configuration
2026-04-17T09:20:29.422905171Z INFO: Collecting host service logs for ovsdb-server
2026-04-17T09:20:29.423188122Z INFO: Collecting host service logs for ovs-vswitchd
2026-04-17T09:20:29.423587026Z INFO: Waiting for worker host service log collection to complete ...
2026-04-17T09:20:29.437912169Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-04-17T09:20:29.438630809Z INFO: Gathering HAProxy config files
2026-04-17T09:20:29.564636643Z INFO: Waiting for node performance related collection to complete ...
2026-04-17T09:20:29.748288082Z No resources found in openshift-etcd namespace.
2026-04-17T09:20:29.980171962Z No resources found
2026-04-17T09:20:30.311572828Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-04-17T09:20:30.311653501Z INFO: on-disk MachineConfig config collection complete.
2026-04-17T09:20:30.438830277Z INFO: Found 1 replicas - prometheus-k8s-0
2026-04-17T09:20:30.594887223Z INFO: "metallb-operator" not detected. Skipping.
2026-04-17T09:20:30.604320953Z INFO: Collecting Insights Archives from insights-operator-585dfdc468-rlbzq
2026-04-17T09:20:30.604370798Z insights-runtime-extractor-4m2cs
2026-04-17T09:20:30.604388728Z insights-runtime-extractor-88rzd
2026-04-17T09:20:30.604407351Z insights-runtime-extractor-fmzk9
2026-04-17T09:20:30.607894367Z error: the server doesn't have a resource type "performanceprofile"
2026-04-17T09:20:30.626644770Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-04-17T09:20:30.643943472Z ERROR: No running kube-apiserver pods found
2026-04-17T09:20:30.763330107Z Wrote inspect data to must-gather.
2026-04-17T09:20:30.793288079Z INFO: Worker host service log collection to complete.
2026-04-17T09:20:30.794611746Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-04-17T09:20:31.095334933Z Wrote inspect data to must-gather.
2026-04-17T09:20:31.097387614Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-04-17T09:20:31.097387614Z See 'oc rsync -h' for help and examples
2026-04-17T09:20:31.292887590Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-04-17T09:20:31.360861022Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-17T09:20:31.384517850Z INFO: "sriov-network-operator" not detected. Skipping.
2026-04-17T09:20:31.388142249Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-04-17T09:20:31.453337384Z Wrote inspect data to must-gather.
2026-04-17T09:20:31.480368590Z INFO: Waiting for HAProxy config collection to complete ...
2026-04-17T09:20:31.495514615Z Wrote inspect data to must-gather.
2026-04-17T09:20:31.539255312Z Wrote inspect data to must-gather.
2026-04-17T09:20:31.564739067Z Wrote inspect data to must-gather.
2026-04-17T09:20:31.566836783Z No resources found
2026-04-17T09:20:31.595906118Z Wrote inspect data to must-gather.
2026-04-17T09:20:31.607817305Z INFO: 'previous-logs' folder not found on ip-10-0-128-212.ec2.internal, skipping...
2026-04-17T09:20:31.783133676Z error: the server doesn't have a resource type "machineconfigs"
2026-04-17T09:20:31.783221127Z tar: Removing leading `/' from member names
2026-04-17T09:20:31.789121647Z INFO: HAProxy config collection complete.
2026-04-17T09:20:31.825036940Z Gathering data for ns/openshift-monitoring...
2026-04-17T09:20:31.871798050Z Wrote inspect data to must-gather.
2026-04-17T09:20:31.886394094Z INFO: 'previous-logs' folder not found on ip-10-0-130-147.ec2.internal, skipping...
2026-04-17T09:20:31.932901575Z INFO: Getting rules from prometheus-k8s-0
2026-04-17T09:20:32.018826610Z Wrote inspect data to must-gather.
2026-04-17T09:20:32.131262184Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-17T09:20:32.139124132Z Wrote inspect data to must-gather.
2026-04-17T09:20:32.143450522Z INFO: 'previous-logs' folder not found on ip-10-0-143-18.ec2.internal, skipping...
2026-04-17T09:20:32.143479776Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-04-17T09:20:32.143518047Z INFO: Machine Config Daemon termination log collection complete.
2026-04-17T09:20:32.224084528Z Wrote inspect data to must-gather.
2026-04-17T09:20:32.325770234Z INFO: Getting status/config from prometheus-k8s-0
2026-04-17T09:20:32.372757788Z Wrote inspect data to must-gather.
2026-04-17T09:20:32.378984646Z error: the server doesn't have a resource type "kubeletconfigs"
2026-04-17T09:20:32.595102865Z Wrote inspect data to must-gather.
2026-04-17T09:20:32.639096908Z INFO: INTERCONNECT MODE
2026-04-17T09:20:32.639132817Z INFO: Gathering ovn-kubernetes DBs
2026-04-17T09:20:32.738780664Z INFO: Getting status/flags from prometheus-k8s-0
2026-04-17T09:20:32.799156717Z Wrote inspect data to must-gather.
2026-04-17T09:20:32.857471181Z INFO: Gathering OVN_Northbound from ovnkube-node-bqmpm...
2026-04-17T09:20:32.857708223Z INFO: Gathering OVN_Northbound from ovnkube-node-pczcn...
2026-04-17T09:20:32.857874291Z INFO: Gathering OVN_Northbound from ovnkube-node-w5vps...
2026-04-17T09:20:32.858117129Z INFO: Gathering OVN_Southbound from ovnkube-node-bqmpm...
2026-04-17T09:20:32.858367340Z INFO: Gathering OVN_Southbound from ovnkube-node-pczcn...
2026-04-17T09:20:32.858626369Z INFO: Gathering OVN_Southbound from ovnkube-node-w5vps...
2026-04-17T09:20:32.976825395Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-04-17T09:20:33.105289540Z Wrote inspect data to must-gather.
2026-04-17T09:20:33.126955457Z tar: Removing leading `/' from member names
2026-04-17T09:20:33.135956849Z tar: Removing leading `/' from member names
2026-04-17T09:20:33.147121859Z tar: Removing leading `/' from member names
2026-04-17T09:20:33.149761021Z tar: Removing leading `/' from member names
2026-04-17T09:20:33.171925945Z tar: Removing leading `/' from member names
2026-04-17T09:20:33.185544898Z tar: Removing leading `/' from member names
2026-04-17T09:20:33.292999518Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-04-17T09:20:33.353949680Z Wrote inspect data to must-gather.
2026-04-17T09:20:33.365375435Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-17T09:20:33.552190162Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-04-17T09:20:33.573862492Z Wrote inspect data to must-gather.
2026-04-17T09:20:33.621471194Z INFO: Waiting for network log collection to complete ...
2026-04-17T09:20:33.621545634Z INFO: Waiting for ovnk database copies to complete ...
2026-04-17T09:20:33.622034333Z INFO: Copying ovnk databases complete.
2026-04-17T09:20:33.623682244Z 2.8M	must-gather/network_logs/ovnk_database_store
2026-04-17T09:20:33.626233002Z ovnk_database_store/
2026-04-17T09:20:33.626233002Z ovnk_database_store/ovnkube-node-bqmpm_nbdb
2026-04-17T09:20:33.633021227Z ovnk_database_store/ovnkube-node-w5vps_sbdb
2026-04-17T09:20:33.650485267Z ovnk_database_store/ovnkube-node-bqmpm_sbdb
2026-04-17T09:20:33.669763141Z ovnk_database_store/ovnkube-node-pczcn_sbdb
2026-04-17T09:20:33.687654683Z ovnk_database_store/ovnkube-node-pczcn_nbdb
2026-04-17T09:20:33.694682518Z ovnk_database_store/ovnkube-node-w5vps_nbdb
2026-04-17T09:20:33.707726171Z INFO: Network log collection complete.
2026-04-17T09:20:33.772982508Z Wrote inspect data to must-gather.
2026-04-17T09:20:33.923980025Z INFO: Getting status from alertmanager-main-0
2026-04-17T09:20:33.984568581Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-17T09:20:34.063220190Z Wrote inspect data to must-gather.
2026-04-17T09:20:34.142210154Z Gathering data for ns/openshift-network-console...
2026-04-17T09:20:34.309257194Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-04-17T09:20:34.311253798Z INFO: Fallback to identify the container image from release info
2026-04-17T09:20:34.544332902Z Gathering data for ns/openshift-console-operator...
2026-04-17T09:20:34.878728107Z Gathering data for ns/openshift-console...
2026-04-17T09:20:34.941025157Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f2123db9953f98da0e43c266e6a8a070bf221533b995f87b7e358cc7498ca6d
2026-04-17T09:20:35.073664528Z daemonset.apps/perf-node-gather-daemonset created
2026-04-17T09:20:35.185670907Z Waiting for performance profile collector pods to become ready: 1
2026-04-17T09:20:35.420789587Z Gathering data for ns/openshift-cluster-storage-operator...
2026-04-17T09:20:35.795140908Z Gathering data for ns/openshift-dns-operator...
2026-04-17T09:20:36.067728900Z Gathering data for ns/openshift-dns...
2026-04-17T09:20:36.296284904Z Waiting for performance profile collector pods to become ready: 2
2026-04-17T09:20:36.664522659Z Gathering data for ns/openshift-image-registry...
2026-04-17T09:20:37.123812493Z Gathering data for ns/openshift-ingress-operator...
2026-04-17T09:20:37.137616663Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-17T09:20:37.425244508Z Waiting for performance profile collector pods to become ready: 3
2026-04-17T09:20:37.442357832Z Gathering data for ns/openshift-ingress...
2026-04-17T09:20:37.769731322Z Gathering data for ns/openshift-ingress-canary...
2026-04-17T09:20:38.149239688Z Gathering data for ns/openshift-insights...
2026-04-17T09:20:38.541856633Z Waiting for performance profile collector pods to become ready: 4
2026-04-17T09:20:39.657741140Z Waiting for performance profile collector pods to become ready: 5
2026-04-17T09:20:39.974203688Z Gathering data for ns/openshift-jobset-operator...
2026-04-17T09:20:40.749293504Z Gathering data for ns/openshift-config...
2026-04-17T09:20:40.779067235Z Waiting for performance profile collector pods to become ready: 6
2026-04-17T09:20:41.047562385Z Gathering data for ns/openshift-config-managed...
2026-04-17T09:20:41.496092632Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-04-17T09:20:41.786145070Z Gathering data for ns/openshift-kube-apiserver...
2026-04-17T09:20:41.907416544Z Waiting for performance profile collector pods to become ready: 7
2026-04-17T09:20:42.051790453Z Gathering data for ns/openshift-kube-controller-manager...
2026-04-17T09:20:42.142699707Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-17T09:20:42.340636554Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-04-17T09:20:42.625211540Z Gathering data for ns/openshift-kube-scheduler...
2026-04-17T09:20:42.926232105Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-04-17T09:20:43.036343893Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-04-17T09:20:43.263811051Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-04-17T09:20:43.286154475Z Collecting performance related data for node ip-10-0-128-212.ec2.internal
2026-04-17T09:20:43.292824941Z Collecting performance related data for node ip-10-0-143-18.ec2.internal
2026-04-17T09:20:43.300629126Z Collecting performance related data for node ip-10-0-130-147.ec2.internal
2026-04-17T09:20:43.659476490Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-04-17T09:20:44.022147697Z Gathering data for ns/openshift-user-workload-monitoring...
2026-04-17T09:20:44.649903066Z Gathering data for ns/openshift-multus...
2026-04-17T09:20:46.189563170Z Gathering data for ns/openshift-ovn-kubernetes...
2026-04-17T09:20:47.147289506Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-17T09:20:47.671871361Z Gathering data for ns/openshift-host-network...
2026-04-17T09:20:48.024778808Z Gathering data for ns/openshift-network-diagnostics...
2026-04-17T09:20:48.581084471Z Gathering data for ns/openshift-network-node-identity...
2026-04-17T09:20:48.990522400Z Gathering data for ns/openshift-network-operator...
2026-04-17T09:20:49.379747671Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-04-17T09:20:49.636143071Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-04-17T09:20:50.077211454Z Gathering data for ns/openshift-apiserver-operator...
2026-04-17T09:20:50.379386172Z Gathering data for ns/openshift-apiserver...
2026-04-17T09:20:50.758971504Z Gathering data for ns/openshift-controller-manager-operator...
2026-04-17T09:20:51.031179903Z Gathering data for ns/openshift-controller-manager...
2026-04-17T09:20:51.320934935Z Collecting kubelet logs for node ip-10-0-128-212.ec2.internal
2026-04-17T09:20:51.322936599Z Collecting kubelet logs for node ip-10-0-143-18.ec2.internal
2026-04-17T09:20:51.325105058Z Collecting kubelet logs for node ip-10-0-130-147.ec2.internal
2026-04-17T09:20:51.343722504Z Gathering data for ns/openshift-cluster-samples-operator...
2026-04-17T09:20:51.672084535Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-04-17T09:20:51.677615497Z INFO: Node performance data collection complete.
2026-04-17T09:20:52.044881958Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-04-17T09:20:52.151848598Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-17T09:20:52.313006993Z Gathering data for ns/openshift-service-ca-operator...
2026-04-17T09:20:52.647844679Z Gathering data for ns/openshift-service-ca...
2026-04-17T09:20:52.988239212Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-04-17T09:20:53.874141630Z Wrote inspect data to must-gather.
2026-04-17T09:20:53.874179278Z error: inspection completed with the errors occurred while gathering data:
2026-04-17T09:20:53.874179278Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-04-17T09:20:53.999084323Z error: the server doesn't have a resource type "clusters"
2026-04-17T09:20:54.135887388Z Caches written to disk