2026-09-11T08:32:56.819959785Z [disk usage checker] Started
2026-09-11T08:32:56.823125879Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-11T08:32:57.044407382Z Gathering data for ns/openshift-cluster-version...
2026-09-11T08:32:57.235325151Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-11T08:32:57.378327037Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-11T08:32:57.471661349Z Gathering data for ns/default...
2026-09-11T08:32:57.857452161Z Gathering data for ns/openshift...
2026-09-11T08:32:58.330926348Z Gathering data for ns/kube-system...
2026-09-11T08:32:59.207254908Z Gathering data for ns/openshift-etcd...
2026-09-11T08:32:59.324782084Z Waiting on subprocesses to finish execution.
2026-09-11T08:32:59.329167980Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-11T08:32:59.331772223Z Executing Istio gather script
2026-09-11T08:32:59.333447686Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-11T08:32:59.333864372Z INFO: Collecting host service logs for crio
2026-09-11T08:32:59.334166270Z INFO: Collecting host service logs for kubelet
2026-09-11T08:32:59.334474005Z INFO: Collecting host service logs for rpm-ostreed
2026-09-11T08:32:59.334803707Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-11T08:32:59.335174347Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-11T08:32:59.335530005Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-11T08:32:59.335864868Z INFO: Collecting host service logs for NetworkManager
2026-09-11T08:32:59.336203168Z INFO: Collecting host service logs for openvswitch
2026-09-11T08:32:59.336545503Z INFO: Collecting host service logs for ovs-configuration
2026-09-11T08:32:59.336909015Z INFO: Collecting host service logs for ovsdb-server
2026-09-11T08:32:59.337254241Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-11T08:32:59.337657687Z INFO: Waiting for worker host service log collection to complete ...
2026-09-11T08:32:59.341946266Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-11T08:32:59.358285417Z INFO: Gathering HAProxy config files
2026-09-11T08:32:59.740132326Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-11T08:32:59.900804619Z INFO: Waiting for node performance related collection to complete ...
2026-09-11T08:32:59.969794800Z Wrote inspect data to must-gather.
2026-09-11T08:33:00.139559650Z No resources found
2026-09-11T08:33:00.199643729Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-11T08:33:00.231129634Z Wrote inspect data to must-gather.
2026-09-11T08:33:00.231218230Z error: inspection completed with the errors occurred while gathering data:
2026-09-11T08:33:00.231218230Z     namespaces "assisted-installer" not found
2026-09-11T08:33:00.282593329Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-11T08:33:00.519577349Z INFO: Collecting Insights Archives from insights-operator-5844b856db-dfbs4
2026-09-11T08:33:00.519633506Z insights-runtime-extractor-ckf7k
2026-09-11T08:33:00.519654050Z insights-runtime-extractor-fssdv
2026-09-11T08:33:00.519729277Z insights-runtime-extractor-wg6hj
2026-09-11T08:33:00.597984248Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-11T08:33:00.733127526Z INFO: "metallb-operator" not detected. Skipping.
2026-09-11T08:33:00.733957035Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-11T08:33:00.733982059Z INFO: on-disk MachineConfig config collection complete.
2026-09-11T08:33:00.788846167Z No resources found in openshift-etcd namespace.
2026-09-11T08:33:00.879486468Z error: the server doesn't have a resource type "performanceprofile"
2026-09-11T08:33:00.960500848Z ERROR: No running kube-apiserver pods found
2026-09-11T08:33:00.972975740Z INFO: Worker host service log collection to complete.
2026-09-11T08:33:01.065515473Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-11T08:33:01.300846984Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-11T08:33:01.306466460Z Wrote inspect data to must-gather.
2026-09-11T08:33:01.402629409Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-11T08:33:01.433241286Z Wrote inspect data to must-gather.
2026-09-11T08:33:01.436782781Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-11T08:33:01.436782781Z See 'oc rsync -h' for help and examples
2026-09-11T08:33:01.555215510Z Wrote inspect data to must-gather.
2026-09-11T08:33:01.574651361Z Gathering data for ns/openshift-monitoring...
2026-09-11T08:33:01.817393399Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-11T08:33:01.839776041Z INFO: 'previous-logs' folder not found on ip-10-0-131-93.ec2.internal, skipping...
2026-09-11T08:33:01.855342676Z Wrote inspect data to must-gather.
2026-09-11T08:33:01.859883361Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-11T08:33:01.873222777Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-11T08:33:01.897105682Z No resources found
2026-09-11T08:33:01.918194652Z Wrote inspect data to must-gather.
2026-09-11T08:33:02.034240861Z Wrote inspect data to must-gather.
2026-09-11T08:33:02.080337261Z error: the server doesn't have a resource type "machineconfigs"
2026-09-11T08:33:02.092146654Z tar: Removing leading `/' from member names
2026-09-11T08:33:02.098428882Z INFO: HAProxy config collection complete.
2026-09-11T08:33:02.165616675Z INFO: 'previous-logs' folder not found on ip-10-0-136-245.ec2.internal, skipping...
2026-09-11T08:33:02.227247194Z INFO: Getting rules from prometheus-k8s-0
2026-09-11T08:33:02.245976868Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-11T08:33:02.313709897Z Wrote inspect data to must-gather.
2026-09-11T08:33:02.417283013Z INFO: 'previous-logs' folder not found on ip-10-0-142-13.ec2.internal, skipping...
2026-09-11T08:33:02.417308742Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-11T08:33:02.417331579Z INFO: Machine Config Daemon termination log collection complete.
2026-09-11T08:33:02.466089342Z Wrote inspect data to must-gather.
2026-09-11T08:33:02.568621637Z Wrote inspect data to must-gather.
2026-09-11T08:33:02.620095169Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-11T08:33:02.652764851Z INFO: Getting status/config from prometheus-k8s-0
2026-09-11T08:33:02.817510416Z Wrote inspect data to must-gather.
2026-09-11T08:33:02.822403905Z Wrote inspect data to must-gather.
2026-09-11T08:33:03.016404654Z Wrote inspect data to must-gather.
2026-09-11T08:33:03.052799172Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-11T08:33:03.098031946Z INFO: INTERCONNECT MODE
2026-09-11T08:33:03.098079961Z INFO: Gathering ovn-kubernetes DBs
2026-09-11T08:33:03.108891272Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-11T08:33:03.212235499Z Wrote inspect data to must-gather.
2026-09-11T08:33:03.257954492Z INFO: Gathering OVN_Northbound from ovnkube-node-9j5fx...
2026-09-11T08:33:03.258223197Z INFO: Gathering OVN_Northbound from ovnkube-node-9ljvr...
2026-09-11T08:33:03.258451842Z INFO: Gathering OVN_Northbound from ovnkube-node-gdflq...
2026-09-11T08:33:03.258727825Z INFO: Gathering OVN_Southbound from ovnkube-node-9j5fx...
2026-09-11T08:33:03.258987715Z INFO: Gathering OVN_Southbound from ovnkube-node-9ljvr...
2026-09-11T08:33:03.259234555Z INFO: Gathering OVN_Southbound from ovnkube-node-gdflq...
2026-09-11T08:33:03.310423870Z Wrote inspect data to /must-gather/istio.
2026-09-11T08:33:03.329172708Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-11T08:33:03.537094935Z Wrote inspect data to must-gather.
2026-09-11T08:33:03.543773993Z tar: Removing leading `/' from member names
2026-09-11T08:33:03.586332346Z tar: Removing leading `/' from member names
2026-09-11T08:33:03.618017514Z tar: Removing leading `/' from member names
2026-09-11T08:33:03.656893966Z tar: Removing leading `/' from member names
2026-09-11T08:33:03.658028114Z Wrote inspect data to /must-gather/istio.
2026-09-11T08:33:03.660783327Z tar: Removing leading `/' from member names
2026-09-11T08:33:03.663144168Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-11T08:33:03.663764598Z tar: Removing leading `/' from member names
2026-09-11T08:33:03.737026961Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-11T08:33:03.781118739Z Wrote inspect data to must-gather.
2026-09-11T08:33:03.877855695Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-11T08:33:03.916068072Z Wrote inspect data to /must-gather/istio.
2026-09-11T08:33:04.002914000Z Wrote inspect data to must-gather.
2026-09-11T08:33:04.015471422Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-11T08:33:04.101826360Z INFO: Waiting for network log collection to complete ...
2026-09-11T08:33:04.101957524Z INFO: Waiting for ovnk database copies to complete ...
2026-09-11T08:33:04.102487899Z INFO: Copying ovnk databases complete.
2026-09-11T08:33:04.104552516Z 3.7M	must-gather/network_logs/ovnk_database_store
2026-09-11T08:33:04.106631853Z ovnk_database_store/
2026-09-11T08:33:04.106631853Z ovnk_database_store/ovnkube-node-gdflq_sbdb
2026-09-11T08:33:04.129442009Z ovnk_database_store/ovnkube-node-9ljvr_nbdb
2026-09-11T08:33:04.139221000Z ovnk_database_store/ovnkube-node-gdflq_nbdb
2026-09-11T08:33:04.151203445Z ovnk_database_store/ovnkube-node-9j5fx_sbdb
2026-09-11T08:33:04.161501797Z Wrote inspect data to /must-gather/istio.
2026-09-11T08:33:04.165108281Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-11T08:33:04.176496491Z ovnk_database_store/ovnkube-node-9j5fx_nbdb
2026-09-11T08:33:04.185015460Z ovnk_database_store/ovnkube-node-9ljvr_sbdb
2026-09-11T08:33:04.210230863Z INFO: Network log collection complete.
2026-09-11T08:33:04.238407918Z Wrote inspect data to must-gather.
2026-09-11T08:33:04.359266917Z Wrote inspect data to /must-gather/istio.
2026-09-11T08:33:04.420476015Z INFO: Getting status from alertmanager-main-0
2026-09-11T08:33:04.512282655Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-11T08:33:04.514926521Z INFO: Fallback to identify the container image from release info
2026-09-11T08:33:04.543469452Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-11T08:33:04.584772825Z Wrote inspect data to /must-gather/istio.
2026-09-11T08:33:04.588495521Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-11T08:33:04.728686706Z Gathering data for ns/openshift-network-console...
2026-09-11T08:33:04.796793167Z Wrote inspect data to /must-gather/istio.
2026-09-11T08:33:04.968004401Z Wrote inspect data to /must-gather/istio.
2026-09-11T08:33:04.970859720Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-11T08:33:05.134966778Z Wrote inspect data to /must-gather/istio.
2026-09-11T08:33:05.135519539Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:667babb345aeb39d2681913fd91a5c163d48d4ab8a3ba0d3156502181ea1177a
2026-09-11T08:33:05.197763883Z Gathering data for ns/openshift-console-operator...
2026-09-11T08:33:05.253158097Z daemonset.apps/perf-node-gather-daemonset created
2026-09-11T08:33:05.348217795Z Wrote inspect data to /must-gather/istio.
2026-09-11T08:33:05.388867706Z Waiting for performance profile collector pods to become ready: 1
2026-09-11T08:33:05.677407102Z Gathering data for ns/openshift-console...
2026-09-11T08:33:05.956651078Z Done executing Istio gather script
2026-09-11T08:33:06.223140239Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-11T08:33:06.493692985Z Waiting for performance profile collector pods to become ready: 2
2026-09-11T08:33:06.824320462Z Gathering data for ns/openshift-dns-operator...
2026-09-11T08:33:06.887657637Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-11T08:33:07.138129182Z Gathering data for ns/openshift-dns...
2026-09-11T08:33:07.596997829Z Waiting for performance profile collector pods to become ready: 3
2026-09-11T08:33:07.845152876Z Gathering data for ns/openshift-image-registry...
2026-09-11T08:33:08.354922993Z Gathering data for ns/openshift-ingress-operator...
2026-09-11T08:33:08.712059278Z Waiting for performance profile collector pods to become ready: 4
2026-09-11T08:33:08.779940613Z Gathering data for ns/openshift-ingress...
2026-09-11T08:33:09.193663861Z Gathering data for ns/openshift-ingress-canary...
2026-09-11T08:33:09.653362998Z Gathering data for ns/openshift-insights...
2026-09-11T08:33:09.808499901Z Waiting for performance profile collector pods to become ready: 5
2026-09-11T08:33:10.913581140Z Waiting for performance profile collector pods to become ready: 6
2026-09-11T08:33:11.892022813Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-11T08:33:11.940161209Z Gathering data for ns/openshift-config...
2026-09-11T08:33:12.033803505Z Waiting for performance profile collector pods to become ready: 7
2026-09-11T08:33:12.338997217Z Gathering data for ns/openshift-config-managed...
2026-09-11T08:33:12.861879695Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-11T08:33:13.154691395Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-11T08:33:13.202129562Z Gathering data for ns/openshift-kube-apiserver...
2026-09-11T08:33:13.429441932Z Collecting performance related data for node ip-10-0-136-245.ec2.internal
2026-09-11T08:33:13.436570349Z Collecting performance related data for node ip-10-0-131-93.ec2.internal
2026-09-11T08:33:13.446252018Z Collecting performance related data for node ip-10-0-142-13.ec2.internal
2026-09-11T08:33:13.602881171Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-11T08:33:13.975993306Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-11T08:33:14.422994553Z Gathering data for ns/openshift-kube-scheduler...
2026-09-11T08:33:14.818547328Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-11T08:33:15.176446375Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-11T08:33:15.566709876Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-11T08:33:16.038377445Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-11T08:33:16.707598417Z Gathering data for ns/openshift-multus...
2026-09-11T08:33:16.896586224Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-11T08:33:18.802817859Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-11T08:33:21.099994910Z Collecting kubelet logs for node ip-10-0-136-245.ec2.internal
2026-09-11T08:33:21.102021191Z Collecting kubelet logs for node ip-10-0-131-93.ec2.internal
2026-09-11T08:33:21.103720776Z Collecting kubelet logs for node ip-10-0-142-13.ec2.internal
2026-09-11T08:33:21.240039515Z Gathering data for ns/openshift-host-network...
2026-09-11T08:33:21.470070310Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-9dvm5 namespace
2026-09-11T08:33:21.479818989Z INFO: Node performance data collection complete.
2026-09-11T08:33:21.662949692Z Gathering data for ns/openshift-network-diagnostics...
2026-09-11T08:33:21.901151495Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-11T08:33:22.397057337Z Gathering data for ns/openshift-network-node-identity...
2026-09-11T08:33:22.866337355Z Gathering data for ns/openshift-network-operator...
2026-09-11T08:33:23.280613531Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-11T08:33:23.608396688Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-11T08:33:24.209300609Z Gathering data for ns/openshift-apiserver-operator...
2026-09-11T08:33:24.584599722Z Gathering data for ns/openshift-apiserver...
2026-09-11T08:33:25.071168361Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-11T08:33:25.362805627Z Gathering data for ns/openshift-controller-manager...
2026-09-11T08:33:25.658324202Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-11T08:33:26.362837500Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-11T08:33:26.733265962Z Gathering data for ns/openshift-service-ca-operator...
2026-09-11T08:33:26.905918646Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-11T08:33:27.097539506Z Gathering data for ns/openshift-service-ca...
2026-09-11T08:33:27.495343375Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-11T08:33:28.562444752Z Wrote inspect data to must-gather.
2026-09-11T08:33:28.562486314Z error: inspection completed with the errors occurred while gathering data:
2026-09-11T08:33:28.562486314Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-11T08:33:28.681112848Z error: the server doesn't have a resource type "clusters"
2026-09-11T08:33:28.789145888Z Caches written to disk