2026-09-18T17:54:32.682800227Z [disk usage checker] Started
2026-09-18T17:54:32.686143476Z [disk usage checker] Volume usage percentage: current = 34 ; allowed = 70
2026-09-18T17:54:33.217865509Z Gathering data for ns/openshift-cluster-version...
2026-09-18T17:54:33.381616297Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-18T17:54:33.485499157Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-18T17:54:33.583985073Z Gathering data for ns/default...
2026-09-18T17:54:33.944752620Z Gathering data for ns/openshift...
2026-09-18T17:54:34.446179446Z Gathering data for ns/kube-system...
2026-09-18T17:54:35.818686892Z Gathering data for ns/openshift-etcd...
2026-09-18T17:54:36.042079751Z Waiting on subprocesses to finish execution.
2026-09-18T17:54:36.047461373Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-18T17:54:36.048595761Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-18T17:54:36.048595761Z INFO: Gathering HAProxy config files
2026-09-18T17:54:36.055777570Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-18T17:54:36.086112731Z INFO: Collecting host service logs for crio
2026-09-18T17:54:36.086589875Z INFO: Collecting host service logs for kubelet
2026-09-18T17:54:36.086954505Z INFO: Collecting host service logs for rpm-ostreed
2026-09-18T17:54:36.087288048Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-18T17:54:36.087670750Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-18T17:54:36.088016278Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-18T17:54:36.088371669Z INFO: Collecting host service logs for NetworkManager
2026-09-18T17:54:36.088728505Z INFO: Collecting host service logs for openvswitch
2026-09-18T17:54:36.089057851Z INFO: Collecting host service logs for ovs-configuration
2026-09-18T17:54:36.089420937Z INFO: Collecting host service logs for ovsdb-server
2026-09-18T17:54:36.089759265Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-18T17:54:36.090134993Z INFO: Waiting for worker host service log collection to complete ...
2026-09-18T17:54:36.099871988Z Executing Istio gather script
2026-09-18T17:54:36.223996095Z INFO: Waiting for node performance related collection to complete ...
2026-09-18T17:54:36.634253961Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-18T17:54:36.634253961Z INFO: on-disk MachineConfig config collection complete.
2026-09-18T17:54:36.995675559Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-18T17:54:37.004860780Z INFO: Collecting Insights Archives from insights-operator-6f9c644dd9-phlgr
2026-09-18T17:54:37.004860780Z insights-runtime-extractor-gg9g5
2026-09-18T17:54:37.004860780Z insights-runtime-extractor-jhrgx
2026-09-18T17:54:37.004860780Z insights-runtime-extractor-kjcm9
2026-09-18T17:54:37.141076236Z No resources found
2026-09-18T17:54:37.181600878Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-18T17:54:37.320073065Z Wrote inspect data to must-gather.
2026-09-18T17:54:37.432463324Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-18T17:54:37.522541843Z Wrote inspect data to must-gather.
2026-09-18T17:54:37.522638561Z error: inspection completed with the errors occurred while gathering data:
2026-09-18T17:54:37.522638561Z     namespaces "assisted-installer" not found
2026-09-18T17:54:37.535688117Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-18T17:54:37.535688117Z See 'oc rsync -h' for help and examples
2026-09-18T17:54:37.539001806Z error: the server doesn't have a resource type "performanceprofile"
2026-09-18T17:54:37.550146185Z No resources found in openshift-etcd namespace.
2026-09-18T17:54:37.652579906Z INFO: "metallb-operator" not detected. Skipping.
2026-09-18T17:54:37.671161653Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-18T17:54:37.869876035Z [disk usage checker] Volume usage percentage: current = 34 ; allowed = 70
2026-09-18T17:54:38.128378183Z INFO: Worker host service log collection to complete.
2026-09-18T17:54:38.397754925Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-18T17:54:38.459516831Z INFO: 'previous-logs' folder not found on ip-10-0-132-99.ec2.internal, skipping...
2026-09-18T17:54:38.464938182Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-18T17:54:38.572867712Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-18T17:54:38.605837311Z ERROR: No running kube-apiserver pods found
2026-09-18T17:54:38.681832177Z No resources found
2026-09-18T17:54:38.741640372Z Wrote inspect data to must-gather.
2026-09-18T17:54:38.748085487Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-18T17:54:38.767323755Z Wrote inspect data to must-gather.
2026-09-18T17:54:38.833133849Z Gathering data for ns/openshift-monitoring...
2026-09-18T17:54:38.906561212Z tar: Removing leading `/' from member names
2026-09-18T17:54:38.914326957Z INFO: HAProxy config collection complete.
2026-09-18T17:54:38.952322844Z Wrote inspect data to must-gather.
2026-09-18T17:54:39.002339335Z Wrote inspect data to must-gather.
2026-09-18T17:54:39.043925052Z Wrote inspect data to must-gather.
2026-09-18T17:54:39.115181516Z error: the server doesn't have a resource type "machineconfigs"
2026-09-18T17:54:39.155308813Z Wrote inspect data to must-gather.
2026-09-18T17:54:39.199695469Z INFO: 'previous-logs' folder not found on ip-10-0-133-177.ec2.internal, skipping...
2026-09-18T17:54:39.339209573Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-18T17:54:39.382976358Z INFO: Getting rules from prometheus-k8s-0
2026-09-18T17:54:39.475770887Z Wrote inspect data to must-gather.
2026-09-18T17:54:39.536422806Z INFO: 'previous-logs' folder not found on ip-10-0-143-5.ec2.internal, skipping...
2026-09-18T17:54:39.536466086Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-18T17:54:39.536502973Z INFO: Machine Config Daemon termination log collection complete.
2026-09-18T17:54:39.606340744Z Wrote inspect data to must-gather.
2026-09-18T17:54:39.680076216Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-18T17:54:39.748960342Z Wrote inspect data to must-gather.
2026-09-18T17:54:39.785823786Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-18T17:54:39.916036930Z INFO: Getting status/config from prometheus-k8s-0
2026-09-18T17:54:40.006248588Z Wrote inspect data to must-gather.
2026-09-18T17:54:40.021837025Z Wrote inspect data to must-gather.
2026-09-18T17:54:40.257454942Z Wrote inspect data to must-gather.
2026-09-18T17:54:40.364353016Z INFO: INTERCONNECT MODE
2026-09-18T17:54:40.364393264Z INFO: Gathering ovn-kubernetes DBs
2026-09-18T17:54:40.415458229Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-18T17:54:40.511116432Z Wrote inspect data to must-gather.
2026-09-18T17:54:40.575025124Z INFO: Gathering OVN_Northbound from ovnkube-node-7dglz...
2026-09-18T17:54:40.575260949Z INFO: Gathering OVN_Northbound from ovnkube-node-gsvlw...
2026-09-18T17:54:40.575485742Z INFO: Gathering OVN_Northbound from ovnkube-node-scpdr...
2026-09-18T17:54:40.575750651Z INFO: Gathering OVN_Southbound from ovnkube-node-7dglz...
2026-09-18T17:54:40.576002449Z INFO: Gathering OVN_Southbound from ovnkube-node-gsvlw...
2026-09-18T17:54:40.576326043Z INFO: Gathering OVN_Southbound from ovnkube-node-scpdr...
2026-09-18T17:54:40.767667869Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-18T17:54:40.849157389Z Wrote inspect data to must-gather.
2026-09-18T17:54:40.940547462Z tar: Removing leading `/' from member names
2026-09-18T17:54:40.949195669Z tar: Removing leading `/' from member names
2026-09-18T17:54:40.949613749Z tar: Removing leading `/' from member names
2026-09-18T17:54:40.960422745Z tar: Removing leading `/' from member names
2026-09-18T17:54:40.962592170Z tar: Removing leading `/' from member names
2026-09-18T17:54:40.988077753Z tar: Removing leading `/' from member names
2026-09-18T17:54:41.107036892Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-18T17:54:41.151769697Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-18T17:54:41.160696202Z Wrote inspect data to must-gather.
2026-09-18T17:54:41.268152560Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-18T17:54:41.413446986Z Wrote inspect data to must-gather.
2026-09-18T17:54:41.525650974Z Wrote inspect data to /must-gather/istio.
2026-09-18T17:54:41.546878049Z INFO: Waiting for network log collection to complete ...
2026-09-18T17:54:41.546927526Z INFO: Waiting for ovnk database copies to complete ...
2026-09-18T17:54:41.547376068Z INFO: Copying ovnk databases complete.
2026-09-18T17:54:41.549303938Z 4.7M	must-gather/network_logs/ovnk_database_store
2026-09-18T17:54:41.551818985Z ovnk_database_store/
2026-09-18T17:54:41.551818985Z ovnk_database_store/ovnkube-node-gsvlw_sbdb
2026-09-18T17:54:41.580678016Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-18T17:54:41.585083669Z ovnk_database_store/ovnkube-node-scpdr_nbdb
2026-09-18T17:54:41.594713915Z ovnk_database_store/ovnkube-node-scpdr_sbdb
2026-09-18T17:54:41.620040543Z ovnk_database_store/ovnkube-node-7dglz_sbdb
2026-09-18T17:54:41.653027659Z ovnk_database_store/ovnkube-node-gsvlw_nbdb
2026-09-18T17:54:41.663701970Z ovnk_database_store/ovnkube-node-7dglz_nbdb
2026-09-18T17:54:41.671808693Z Wrote inspect data to must-gather.
2026-09-18T17:54:41.682183259Z INFO: Network log collection complete.
2026-09-18T17:54:41.797653257Z Wrote inspect data to /must-gather/istio.
2026-09-18T17:54:41.802492995Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-18T17:54:41.827146786Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-18T17:54:42.015587473Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-18T17:54:42.018902160Z INFO: Fallback to identify the container image from release info
2026-09-18T17:54:42.044634366Z Wrote inspect data to /must-gather/istio.
2026-09-18T17:54:42.053449905Z Gathering data for ns/openshift-network-console...
2026-09-18T17:54:42.075411426Z INFO: Getting status from alertmanager-main-0
2026-09-18T17:54:42.284929280Z Wrote inspect data to /must-gather/istio.
2026-09-18T17:54:42.288148131Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-18T17:54:42.492014510Z Wrote inspect data to /must-gather/istio.
2026-09-18T17:54:42.619197394Z Gathering data for ns/openshift-console-operator...
2026-09-18T17:54:42.725564040Z Wrote inspect data to /must-gather/istio.
2026-09-18T17:54:42.729591007Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-18T17:54:42.732262456Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea
2026-09-18T17:54:42.895351664Z daemonset.apps/perf-node-gather-daemonset created
2026-09-18T17:54:42.933535457Z [disk usage checker] Volume usage percentage: current = 34 ; allowed = 70
2026-09-18T17:54:43.007565634Z Wrote inspect data to /must-gather/istio.
2026-09-18T17:54:43.070683552Z Waiting for performance profile collector pods to become ready: 1
2026-09-18T17:54:43.198030986Z Gathering data for ns/openshift-console...
2026-09-18T17:54:43.242083454Z Wrote inspect data to /must-gather/istio.
2026-09-18T17:54:43.245371933Z Inspecting resource crd/inferencepools.inference.networking.k8s.io
2026-09-18T17:54:43.445769121Z Wrote inspect data to /must-gather/istio.
2026-09-18T17:54:43.678471517Z Wrote inspect data to /must-gather/istio.
2026-09-18T17:54:43.681606702Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io
2026-09-18T17:54:43.878990154Z Wrote inspect data to /must-gather/istio.
2026-09-18T17:54:44.000787341Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-18T17:54:44.112109288Z Wrote inspect data to /must-gather/istio.
2026-09-18T17:54:44.117041686Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-18T17:54:44.229613766Z Waiting for performance profile collector pods to become ready: 2
2026-09-18T17:54:44.311458035Z Wrote inspect data to /must-gather/istio.
2026-09-18T17:54:44.540920004Z Wrote inspect data to /must-gather/istio.
2026-09-18T17:54:44.694559145Z Gathering data for ns/openshift-dns-operator...
2026-09-18T17:54:45.130768238Z Gathering data for ns/openshift-dns...
2026-09-18T17:54:45.298752502Z Done executing Istio gather script
2026-09-18T17:54:45.358820569Z Waiting for performance profile collector pods to become ready: 3
2026-09-18T17:54:45.920884768Z Gathering data for ns/openshift-image-registry...
2026-09-18T17:54:46.488950848Z Gathering data for ns/openshift-ingress-operator...
2026-09-18T17:54:46.497695678Z Waiting for performance profile collector pods to become ready: 4
2026-09-18T17:54:46.906249395Z Gathering data for ns/openshift-ingress...
2026-09-18T17:54:47.317811685Z Gathering data for ns/openshift-ingress-canary...
2026-09-18T17:54:47.623529712Z Waiting for performance profile collector pods to become ready: 5
2026-09-18T17:54:47.784537550Z Gathering data for ns/openshift-insights...
2026-09-18T17:54:47.938501382Z [disk usage checker] Volume usage percentage: current = 34 ; allowed = 70
2026-09-18T17:54:48.752914680Z Waiting for performance profile collector pods to become ready: 6
2026-09-18T17:54:49.891028010Z Waiting for performance profile collector pods to become ready: 7
2026-09-18T17:54:50.880721195Z Gathering data for ns/kserve...
2026-09-18T17:54:51.025606422Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-18T17:54:51.293125111Z Collecting performance related data for node ip-10-0-143-5.ec2.internal
2026-09-18T17:54:51.301057183Z Collecting performance related data for node ip-10-0-133-177.ec2.internal
2026-09-18T17:54:51.308637477Z Collecting performance related data for node ip-10-0-132-99.ec2.internal
2026-09-18T17:54:52.943998632Z [disk usage checker] Volume usage percentage: current = 34 ; allowed = 70
2026-09-18T17:54:53.849807430Z Gathering data for ns/openshift-config...
2026-09-18T17:54:54.298731437Z Gathering data for ns/openshift-config-managed...
2026-09-18T17:54:54.933252046Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-18T17:54:55.475059217Z Gathering data for ns/openshift-kube-apiserver...
2026-09-18T17:54:55.854767736Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-18T17:54:56.273622951Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-18T17:54:56.685615034Z Gathering data for ns/openshift-kube-scheduler...
2026-09-18T17:54:57.042299051Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-18T17:54:57.423234026Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-18T17:54:57.899876119Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-18T17:54:57.951288061Z [disk usage checker] Volume usage percentage: current = 34 ; allowed = 70
2026-09-18T17:54:58.279545719Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-18T17:54:58.893524423Z Gathering data for ns/openshift-multus...
2026-09-18T17:55:00.442067166Z Collecting kubelet logs for node ip-10-0-143-5.ec2.internal
2026-09-18T17:55:00.443879762Z Collecting kubelet logs for node ip-10-0-133-177.ec2.internal
2026-09-18T17:55:00.445622057Z Collecting kubelet logs for node ip-10-0-132-99.ec2.internal
2026-09-18T17:55:00.670394427Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-18T17:55:00.995365196Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-97c2p namespace
2026-09-18T17:55:01.002809502Z INFO: Node performance data collection complete.
2026-09-18T17:55:02.364969788Z Gathering data for ns/openshift-host-network...
2026-09-18T17:55:02.759974608Z Gathering data for ns/openshift-network-diagnostics...
2026-09-18T17:55:02.956998953Z [disk usage checker] Volume usage percentage: current = 34 ; allowed = 70
2026-09-18T17:55:03.435838326Z Gathering data for ns/openshift-network-node-identity...
2026-09-18T17:55:03.954462741Z Gathering data for ns/openshift-network-operator...
2026-09-18T17:55:04.393976175Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-18T17:55:04.739598529Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-18T17:55:05.347040605Z Gathering data for ns/openshift-apiserver-operator...
2026-09-18T17:55:05.709658547Z Gathering data for ns/openshift-apiserver...
2026-09-18T17:55:06.201094373Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-18T17:55:06.565345077Z Gathering data for ns/openshift-controller-manager...
2026-09-18T17:55:06.954589124Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-18T17:55:07.745510163Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-18T17:55:07.963027448Z [disk usage checker] Volume usage percentage: current = 34 ; allowed = 70
2026-09-18T17:55:08.125769813Z Gathering data for ns/openshift-service-ca-operator...
2026-09-18T17:55:08.515629690Z Gathering data for ns/openshift-service-ca...
2026-09-18T17:55:08.972830702Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-18T17:55:10.131094857Z Wrote inspect data to must-gather.
2026-09-18T17:55:10.131146424Z error: inspection completed with the errors occurred while gathering data:
2026-09-18T17:55:10.131146424Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-18T17:55:10.280060921Z error: the server doesn't have a resource type "clusters"
2026-09-18T17:55:10.496526545Z Caches written to disk