2026-09-09T17:49:48.186210852Z [disk usage checker] Started
2026-09-09T17:49:48.190420460Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-09T17:49:48.390384142Z Gathering data for ns/openshift-cluster-version...
2026-09-09T17:49:48.518540879Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-09T17:49:48.602323941Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-09T17:49:48.681955323Z Gathering data for ns/default...
2026-09-09T17:49:48.955228603Z Gathering data for ns/openshift...
2026-09-09T17:49:49.425564789Z Gathering data for ns/kube-system...
2026-09-09T17:49:50.095068670Z Gathering data for ns/openshift-etcd...
2026-09-09T17:49:50.394934884Z Wrote inspect data to must-gather.
2026-09-09T17:49:50.394971480Z error: inspection completed with the errors occurred while gathering data:
2026-09-09T17:49:50.394971480Z     namespaces "assisted-installer" not found
2026-09-09T17:49:50.753667979Z Waiting on subprocesses to finish execution.
2026-09-09T17:49:50.759302190Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-09T17:49:50.765861913Z INFO: Gathering HAProxy config files
2026-09-09T17:49:50.765978528Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-09T17:49:50.773489795Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-09T17:49:50.801484048Z INFO: Collecting host service logs for crio
2026-09-09T17:49:50.801839985Z INFO: Collecting host service logs for kubelet
2026-09-09T17:49:50.802175425Z INFO: Collecting host service logs for rpm-ostreed
2026-09-09T17:49:50.802471973Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-09T17:49:50.802777452Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-09T17:49:50.803078064Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-09T17:49:50.803361954Z INFO: Collecting host service logs for NetworkManager
2026-09-09T17:49:50.803652820Z INFO: Collecting host service logs for openvswitch
2026-09-09T17:49:50.803967297Z INFO: Collecting host service logs for ovs-configuration
2026-09-09T17:49:50.804219350Z Executing Istio gather script
2026-09-09T17:49:50.804281999Z INFO: Collecting host service logs for ovsdb-server
2026-09-09T17:49:50.804572823Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-09T17:49:50.804938748Z INFO: Waiting for worker host service log collection to complete ...
2026-09-09T17:49:50.841027808Z INFO: Waiting for node performance related collection to complete ...
2026-09-09T17:49:51.422925039Z INFO: Collecting Insights Archives from insights-operator-76bcd6ccf5-tv8d8
2026-09-09T17:49:51.422979456Z insights-runtime-extractor-2vdjr
2026-09-09T17:49:51.422999100Z insights-runtime-extractor-645mp
2026-09-09T17:49:51.423017727Z insights-runtime-extractor-lvdzx
2026-09-09T17:49:51.453373443Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-09T17:49:51.538857680Z INFO: "metallb-operator" not detected. Skipping.
2026-09-09T17:49:51.549184867Z No resources found
2026-09-09T17:49:51.561000626Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-09T17:49:51.561084015Z INFO: on-disk MachineConfig config collection complete.
2026-09-09T17:49:51.649482679Z No resources found in openshift-etcd namespace.
2026-09-09T17:49:51.756984300Z ERROR: No running kube-apiserver pods found
2026-09-09T17:49:51.868764204Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-09T17:49:52.061520658Z Wrote inspect data to must-gather.
2026-09-09T17:49:52.066097627Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-09T17:49:52.089633442Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-09T17:49:52.214293937Z error: the server doesn't have a resource type "performanceprofile"
2026-09-09T17:49:52.550331057Z No resources found
2026-09-09T17:49:52.603221866Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-09T17:49:52.688012873Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-09T17:49:52.688012873Z See 'oc rsync -h' for help and examples
2026-09-09T17:49:52.735097734Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-09T17:49:52.753522416Z INFO: Worker host service log collection to complete.
2026-09-09T17:49:52.765631842Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-09T17:49:52.825960972Z Wrote inspect data to must-gather.
2026-09-09T17:49:52.868848980Z Wrote inspect data to must-gather.
2026-09-09T17:49:53.013713812Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-09T17:49:53.135270303Z Wrote inspect data to must-gather.
2026-09-09T17:49:53.165301405Z Wrote inspect data to must-gather.
2026-09-09T17:49:53.210421314Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-09T17:49:53.215238835Z INFO: 'previous-logs' folder not found on ip-10-0-130-43.ec2.internal, skipping...
2026-09-09T17:49:53.297917653Z tar: Removing leading `/' from member names
2026-09-09T17:49:53.302179884Z INFO: HAProxy config collection complete.
2026-09-09T17:49:53.330192081Z Wrote inspect data to must-gather.
2026-09-09T17:49:53.331684698Z Wrote inspect data to must-gather.
2026-09-09T17:49:53.349363538Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-09T17:49:53.424983623Z Gathering data for ns/openshift-monitoring...
2026-09-09T17:49:53.426894992Z error: the server doesn't have a resource type "machineconfigs"
2026-09-09T17:49:53.544872765Z INFO: 'previous-logs' folder not found on ip-10-0-136-69.ec2.internal, skipping...
2026-09-09T17:49:53.557771462Z INFO: Getting rules from prometheus-k8s-0
2026-09-09T17:49:53.598104560Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-09T17:49:53.628182500Z Wrote inspect data to must-gather.
2026-09-09T17:49:53.834354769Z INFO: 'previous-logs' folder not found on ip-10-0-141-213.ec2.internal, skipping...
2026-09-09T17:49:53.834462252Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-09T17:49:53.834516872Z INFO: Machine Config Daemon termination log collection complete.
2026-09-09T17:49:53.841291099Z Wrote inspect data to must-gather.
2026-09-09T17:49:53.899215078Z Wrote inspect data to must-gather.
2026-09-09T17:49:53.981628227Z INFO: Getting status/config from prometheus-k8s-0
2026-09-09T17:49:53.994572905Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-09T17:49:54.136579285Z Wrote inspect data to must-gather.
2026-09-09T17:49:54.212880940Z Wrote inspect data to must-gather.
2026-09-09T17:49:54.395441041Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-09T17:49:54.421679544Z INFO: INTERCONNECT MODE
2026-09-09T17:49:54.421751349Z INFO: Gathering ovn-kubernetes DBs
2026-09-09T17:49:54.427201947Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-09T17:49:54.431968569Z Wrote inspect data to must-gather.
2026-09-09T17:49:54.589522057Z Wrote inspect data to /must-gather/istio.
2026-09-09T17:49:54.591698599Z INFO: Gathering OVN_Northbound from ovnkube-node-2sgx9...
2026-09-09T17:49:54.591928775Z INFO: Gathering OVN_Northbound from ovnkube-node-wsht8...
2026-09-09T17:49:54.592166461Z INFO: Gathering OVN_Northbound from ovnkube-node-xkdmr...
2026-09-09T17:49:54.592524187Z INFO: Gathering OVN_Southbound from ovnkube-node-2sgx9...
2026-09-09T17:49:54.592882103Z INFO: Gathering OVN_Southbound from ovnkube-node-wsht8...
2026-09-09T17:49:54.593203138Z INFO: Gathering OVN_Southbound from ovnkube-node-xkdmr...
2026-09-09T17:49:54.648489185Z Wrote inspect data to must-gather.
2026-09-09T17:49:54.707095744Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-09T17:49:54.913304987Z tar: Removing leading `/' from member names
2026-09-09T17:49:54.930939945Z tar: Removing leading `/' from member names
2026-09-09T17:49:54.959299569Z tar: Removing leading `/' from member names
2026-09-09T17:49:54.962773852Z tar: Removing leading `/' from member names
2026-09-09T17:49:54.977671803Z tar: Removing leading `/' from member names
2026-09-09T17:49:54.987400742Z Wrote inspect data to /must-gather/istio.
2026-09-09T17:49:54.992130631Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-09T17:49:54.992955504Z tar: Removing leading `/' from member names
2026-09-09T17:49:55.025764615Z Wrote inspect data to must-gather.
2026-09-09T17:49:55.048524192Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-09T17:49:55.129368678Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-09T17:49:55.221462857Z Wrote inspect data to /must-gather/istio.
2026-09-09T17:49:55.288916634Z Wrote inspect data to must-gather.
2026-09-09T17:49:55.434141064Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-09T17:49:55.469653362Z INFO: Waiting for network log collection to complete ...
2026-09-09T17:49:55.469713157Z INFO: Waiting for ovnk database copies to complete ...
2026-09-09T17:49:55.470227595Z INFO: Copying ovnk databases complete.
2026-09-09T17:49:55.472098438Z 3.6M	must-gather/network_logs/ovnk_database_store
2026-09-09T17:49:55.475427141Z ovnk_database_store/
2026-09-09T17:49:55.475427141Z ovnk_database_store/ovnkube-node-2sgx9_nbdb
2026-09-09T17:49:55.485110650Z Wrote inspect data to /must-gather/istio.
2026-09-09T17:49:55.485313826Z ovnk_database_store/ovnkube-node-wsht8_sbdb
2026-09-09T17:49:55.488792258Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-09T17:49:55.507336249Z ovnk_database_store/ovnkube-node-xkdmr_nbdb
2026-09-09T17:49:55.515293744Z ovnk_database_store/ovnkube-node-wsht8_nbdb
2026-09-09T17:49:55.524802872Z ovnk_database_store/ovnkube-node-xkdmr_sbdb
2026-09-09T17:49:55.539333214Z Wrote inspect data to must-gather.
2026-09-09T17:49:55.550268600Z ovnk_database_store/ovnkube-node-2sgx9_sbdb
2026-09-09T17:49:55.576872763Z INFO: Network log collection complete.
2026-09-09T17:49:55.703212305Z Wrote inspect data to /must-gather/istio.
2026-09-09T17:49:55.734774161Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-09T17:49:55.823345663Z Wrote inspect data to must-gather.
2026-09-09T17:49:55.863751707Z INFO: Getting status from alertmanager-main-0
2026-09-09T17:49:55.915244896Z Wrote inspect data to /must-gather/istio.
2026-09-09T17:49:55.918017459Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-09T17:49:55.954548499Z Gathering data for ns/openshift-network-console...
2026-09-09T17:49:56.104084327Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-09T17:49:56.106356898Z INFO: Fallback to identify the container image from release info
2026-09-09T17:49:56.145295273Z Wrote inspect data to /must-gather/istio.
2026-09-09T17:49:56.347384282Z Wrote inspect data to /must-gather/istio.
2026-09-09T17:49:56.349880286Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-09T17:49:56.374755908Z Gathering data for ns/openshift-console-operator...
2026-09-09T17:49:56.506777326Z Wrote inspect data to /must-gather/istio.
2026-09-09T17:49:56.672973182Z Wrote inspect data to /must-gather/istio.
2026-09-09T17:49:56.771996741Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f39c1daa89e19c5e987a3b759e646ffab6c1b2ab94a97ded81ddf13e73d0399
2026-09-09T17:49:56.837121685Z Gathering data for ns/openshift-console...
2026-09-09T17:49:56.913329044Z daemonset.apps/perf-node-gather-daemonset created
2026-09-09T17:49:57.049182060Z Waiting for performance profile collector pods to become ready: 1
2026-09-09T17:49:57.410697451Z Done executing Istio gather script
2026-09-09T17:49:57.415402934Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-09T17:49:57.876124363Z Gathering data for ns/openshift-dns-operator...
2026-09-09T17:49:58.180550240Z Waiting for performance profile collector pods to become ready: 2
2026-09-09T17:49:58.193539914Z Gathering data for ns/openshift-dns...
2026-09-09T17:49:58.222129679Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-09T17:49:58.744311342Z Gathering data for ns/openshift-image-registry...
2026-09-09T17:49:59.203668720Z Gathering data for ns/openshift-ingress-operator...
2026-09-09T17:49:59.304337732Z Waiting for performance profile collector pods to become ready: 3
2026-09-09T17:49:59.507776402Z Gathering data for ns/openshift-ingress...
2026-09-09T17:49:59.798096401Z Gathering data for ns/openshift-ingress-canary...
2026-09-09T17:50:00.145413731Z Gathering data for ns/openshift-insights...
2026-09-09T17:50:00.420162986Z Waiting for performance profile collector pods to become ready: 4
2026-09-09T17:50:01.531179122Z Waiting for performance profile collector pods to become ready: 5
2026-09-09T17:50:02.074244395Z Gathering data for ns/openshift-config...
2026-09-09T17:50:02.323873087Z Gathering data for ns/openshift-config-managed...
2026-09-09T17:50:02.639354029Z Waiting for performance profile collector pods to become ready: 6
2026-09-09T17:50:02.796132627Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-09T17:50:03.038642123Z Gathering data for ns/openshift-kube-apiserver...
2026-09-09T17:50:03.228132344Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-09T17:50:03.287916676Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-09T17:50:03.562311774Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-09T17:50:03.757017800Z Waiting for performance profile collector pods to become ready: 7
2026-09-09T17:50:03.832152912Z Gathering data for ns/openshift-kube-scheduler...
2026-09-09T17:50:04.073674083Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-09T17:50:04.341103169Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-09T17:50:04.632107968Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-09T17:50:04.879120725Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-09T17:50:04.938515543Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-09T17:50:05.131697588Z Collecting performance related data for node ip-10-0-141-213.ec2.internal
2026-09-09T17:50:05.140650771Z Collecting performance related data for node ip-10-0-130-43.ec2.internal
2026-09-09T17:50:05.152458146Z Collecting performance related data for node ip-10-0-136-69.ec2.internal
2026-09-09T17:50:05.494390221Z Gathering data for ns/openshift-multus...
2026-09-09T17:50:06.934422427Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-09T17:50:08.198396675Z Gathering data for ns/openshift-host-network...
2026-09-09T17:50:08.234056386Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-09T17:50:08.517355554Z Gathering data for ns/openshift-network-diagnostics...
2026-09-09T17:50:09.010969680Z Gathering data for ns/openshift-network-node-identity...
2026-09-09T17:50:09.456956396Z Gathering data for ns/openshift-network-operator...
2026-09-09T17:50:09.810611663Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-09T17:50:10.066383839Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-09T17:50:10.555430443Z Gathering data for ns/openshift-apiserver-operator...
2026-09-09T17:50:10.871871763Z Gathering data for ns/openshift-apiserver...
2026-09-09T17:50:11.233682258Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-09T17:50:11.477312793Z Gathering data for ns/openshift-controller-manager...
2026-09-09T17:50:11.800400625Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-09T17:50:12.439988266Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-09T17:50:12.752860940Z Gathering data for ns/openshift-service-ca-operator...
2026-09-09T17:50:12.882309259Z Collecting kubelet logs for node ip-10-0-141-213.ec2.internal
2026-09-09T17:50:12.884169469Z Collecting kubelet logs for node ip-10-0-130-43.ec2.internal
2026-09-09T17:50:12.886155457Z Collecting kubelet logs for node ip-10-0-136-69.ec2.internal
2026-09-09T17:50:13.094532733Z Gathering data for ns/openshift-service-ca...
2026-09-09T17:50:13.241518858Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-09T17:50:13.252413588Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-k9g2c namespace
2026-09-09T17:50:13.256908790Z INFO: Node performance data collection complete.
2026-09-09T17:50:13.458605252Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-09T17:50:14.277924968Z Wrote inspect data to must-gather.
2026-09-09T17:50:14.277970809Z error: inspection completed with the errors occurred while gathering data:
2026-09-09T17:50:14.277970809Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-09T17:50:14.399975796Z error: the server doesn't have a resource type "clusters"
2026-09-09T17:50:14.535823739Z Caches written to disk