2026-09-16T19:37:08.764785067Z [disk usage checker] Started
2026-09-16T19:37:08.768009876Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-09-16T19:37:08.959810681Z Gathering data for ns/openshift-cluster-version...
2026-09-16T19:37:09.094835474Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-16T19:37:09.187963734Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-16T19:37:09.269669613Z Gathering data for ns/default...
2026-09-16T19:37:09.572400705Z Gathering data for ns/openshift...
2026-09-16T19:37:09.980228476Z Gathering data for ns/kube-system...
2026-09-16T19:37:10.680241084Z Gathering data for ns/openshift-etcd...
2026-09-16T19:37:10.989482256Z Wrote inspect data to must-gather.
2026-09-16T19:37:10.989514233Z error: inspection completed with the errors occurred while gathering data:
2026-09-16T19:37:10.989514233Z     namespaces "assisted-installer" not found
2026-09-16T19:37:11.471168075Z Waiting on subprocesses to finish execution.
2026-09-16T19:37:11.480220567Z Executing Istio gather script
2026-09-16T19:37:11.482283594Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-16T19:37:11.483051146Z INFO: Gathering HAProxy config files
2026-09-16T19:37:11.487280510Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-16T19:37:11.487978734Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-16T19:37:11.496831361Z INFO: Collecting host service logs for crio
2026-09-16T19:37:11.497189809Z INFO: Collecting host service logs for kubelet
2026-09-16T19:37:11.497525401Z INFO: Collecting host service logs for rpm-ostreed
2026-09-16T19:37:11.497890490Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-16T19:37:11.498230603Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-16T19:37:11.498572783Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-16T19:37:11.498929494Z INFO: Collecting host service logs for NetworkManager
2026-09-16T19:37:11.499276165Z INFO: Collecting host service logs for openvswitch
2026-09-16T19:37:11.499617312Z INFO: Collecting host service logs for ovs-configuration
2026-09-16T19:37:11.499967673Z INFO: Collecting host service logs for ovsdb-server
2026-09-16T19:37:11.500313600Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-16T19:37:11.500741054Z INFO: Waiting for worker host service log collection to complete ...
2026-09-16T19:37:11.532562500Z INFO: Waiting for node performance related collection to complete ...
2026-09-16T19:37:11.888879500Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-16T19:37:11.992712916Z INFO: Collecting Insights Archives from insights-operator-5844b856db-dws7b
2026-09-16T19:37:11.992712916Z insights-runtime-extractor-6fkgr
2026-09-16T19:37:11.992712916Z insights-runtime-extractor-jkdgk
2026-09-16T19:37:11.992712916Z insights-runtime-extractor-wdg6x
2026-09-16T19:37:12.330350471Z ERROR: No running kube-apiserver pods found
2026-09-16T19:37:12.365002740Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-16T19:37:12.558316193Z No resources found
2026-09-16T19:37:12.744064974Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-16T19:37:12.744064974Z See 'oc rsync -h' for help and examples
2026-09-16T19:37:12.744643642Z No resources found in openshift-etcd namespace.
2026-09-16T19:37:12.834418841Z error: the server doesn't have a resource type "performanceprofile"
2026-09-16T19:37:13.015724782Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-16T19:37:13.015799360Z INFO: on-disk MachineConfig config collection complete.
2026-09-16T19:37:13.017961368Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-16T19:37:13.062915512Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-16T19:37:13.109074399Z INFO: "metallb-operator" not detected. Skipping.
2026-09-16T19:37:13.122894284Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-16T19:37:13.249406751Z No resources found
2026-09-16T19:37:13.355450705Z Wrote inspect data to must-gather.
2026-09-16T19:37:13.498157937Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-16T19:37:13.618008766Z Wrote inspect data to must-gather.
2026-09-16T19:37:13.625436459Z INFO: Worker host service log collection to complete.
2026-09-16T19:37:13.767030261Z Wrote inspect data to must-gather.
2026-09-16T19:37:13.776950508Z Wrote inspect data to must-gather.
2026-09-16T19:37:13.788054268Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-09-16T19:37:13.852319692Z Gathering data for ns/openshift-monitoring...
2026-09-16T19:37:13.885441278Z Wrote inspect data to must-gather.
2026-09-16T19:37:13.947096790Z Wrote inspect data to must-gather.
2026-09-16T19:37:13.963435048Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-16T19:37:14.100845807Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-16T19:37:14.121762763Z Wrote inspect data to must-gather.
2026-09-16T19:37:14.130775561Z INFO: 'previous-logs' folder not found on ip-10-0-134-125.ec2.internal, skipping...
2026-09-16T19:37:14.291850907Z Wrote inspect data to must-gather.
2026-09-16T19:37:14.360210943Z error: the server doesn't have a resource type "machineconfigs"
2026-09-16T19:37:14.366011102Z tar: Removing leading `/' from member names
2026-09-16T19:37:14.372302693Z INFO: HAProxy config collection complete.
2026-09-16T19:37:14.465780322Z INFO: Getting rules from prometheus-k8s-0
2026-09-16T19:37:14.474507913Z INFO: 'previous-logs' folder not found on ip-10-0-137-226.ec2.internal, skipping...
2026-09-16T19:37:14.577639350Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-16T19:37:14.613714312Z Wrote inspect data to must-gather.
2026-09-16T19:37:14.773182434Z INFO: 'previous-logs' folder not found on ip-10-0-142-175.ec2.internal, skipping...
2026-09-16T19:37:14.773218244Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-16T19:37:14.773248828Z INFO: Machine Config Daemon termination log collection complete.
2026-09-16T19:37:14.869991838Z Wrote inspect data to must-gather.
2026-09-16T19:37:14.920797117Z Wrote inspect data to must-gather.
2026-09-16T19:37:14.930256195Z INFO: Getting status/config from prometheus-k8s-0
2026-09-16T19:37:15.056783433Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-16T19:37:15.060628594Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-16T19:37:15.229487944Z INFO: INTERCONNECT MODE
2026-09-16T19:37:15.229581706Z INFO: Gathering ovn-kubernetes DBs
2026-09-16T19:37:15.282662775Z Wrote inspect data to must-gather.
2026-09-16T19:37:15.390629054Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-16T19:37:15.498531873Z INFO: Gathering OVN_Northbound from ovnkube-node-bx8nl...
2026-09-16T19:37:15.498787097Z INFO: Gathering OVN_Northbound from ovnkube-node-nz9xs...
2026-09-16T19:37:15.499113635Z INFO: Gathering OVN_Northbound from ovnkube-node-xdr6v...
2026-09-16T19:37:15.499436884Z INFO: Gathering OVN_Southbound from ovnkube-node-bx8nl...
2026-09-16T19:37:15.499726750Z INFO: Gathering OVN_Southbound from ovnkube-node-nz9xs...
2026-09-16T19:37:15.500053215Z INFO: Gathering OVN_Southbound from ovnkube-node-xdr6v...
2026-09-16T19:37:15.551378441Z Wrote inspect data to must-gather.
2026-09-16T19:37:15.590476395Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-16T19:37:15.711439829Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-16T19:37:15.822995708Z tar: Removing leading `/' from member names
2026-09-16T19:37:15.835377686Z tar: Removing leading `/' from member names
2026-09-16T19:37:15.851229204Z tar: Removing leading `/' from member names
2026-09-16T19:37:15.857160938Z tar: Removing leading `/' from member names
2026-09-16T19:37:15.912053645Z Wrote inspect data to must-gather.
2026-09-16T19:37:15.929492900Z tar: Removing leading `/' from member names
2026-09-16T19:37:15.948751665Z tar: Removing leading `/' from member names
2026-09-16T19:37:16.036985178Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-16T19:37:16.201984981Z Wrote inspect data to must-gather.
2026-09-16T19:37:16.295307547Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-16T19:37:16.311139770Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-16T19:37:16.411848687Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-16T19:37:16.477003960Z INFO: Waiting for network log collection to complete ...
2026-09-16T19:37:16.477041104Z INFO: Waiting for ovnk database copies to complete ...
2026-09-16T19:37:16.477512544Z INFO: Copying ovnk databases complete.
2026-09-16T19:37:16.481167647Z 3.9M	must-gather/network_logs/ovnk_database_store
2026-09-16T19:37:16.484208278Z ovnk_database_store/
2026-09-16T19:37:16.484254018Z ovnk_database_store/ovnkube-node-bx8nl_nbdb
2026-09-16T19:37:16.498916755Z ovnk_database_store/ovnkube-node-nz9xs_nbdb
2026-09-16T19:37:16.507603432Z ovnk_database_store/ovnkube-node-xdr6v_sbdb
2026-09-16T19:37:16.531313665Z ovnk_database_store/ovnkube-node-xdr6v_nbdb
2026-09-16T19:37:16.532871105Z Wrote inspect data to /must-gather/istio.
2026-09-16T19:37:16.542108857Z ovnk_database_store/ovnkube-node-nz9xs_sbdb
2026-09-16T19:37:16.570862020Z ovnk_database_store/ovnkube-node-bx8nl_sbdb
2026-09-16T19:37:16.572229504Z Wrote inspect data to must-gather.
2026-09-16T19:37:16.598421589Z INFO: Network log collection complete.
2026-09-16T19:37:16.631449044Z Gathering data for ns/openshift-network-console...
2026-09-16T19:37:16.748683739Z INFO: Getting status from alertmanager-main-0
2026-09-16T19:37:16.781213606Z Wrote inspect data to /must-gather/istio.
2026-09-16T19:37:16.783663197Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-16T19:37:16.901412961Z Wrote inspect data to must-gather.
2026-09-16T19:37:17.001054284Z Wrote inspect data to /must-gather/istio.
2026-09-16T19:37:17.156930129Z Gathering data for ns/openshift-console-operator...
2026-09-16T19:37:17.209159355Z Wrote inspect data to must-gather.
2026-09-16T19:37:17.227265024Z Wrote inspect data to /must-gather/istio.
2026-09-16T19:37:17.230067759Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-16T19:37:17.425377929Z Wrote inspect data to /must-gather/istio.
2026-09-16T19:37:17.496868463Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-16T19:37:17.499551450Z INFO: Fallback to identify the container image from release info
2026-09-16T19:37:17.612024712Z Gathering data for ns/openshift-console...
2026-09-16T19:37:17.640328087Z Wrote inspect data to /must-gather/istio.
2026-09-16T19:37:17.643158373Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-16T19:37:17.858685404Z Wrote inspect data to /must-gather/istio.
2026-09-16T19:37:18.067221681Z Wrote inspect data to /must-gather/istio.
2026-09-16T19:37:18.070923575Z Inspecting resource crd/inferencepools.inference.networking.k8s.io
2026-09-16T19:37:18.118010162Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:667babb345aeb39d2681913fd91a5c163d48d4ab8a3ba0d3156502181ea1177a
2026-09-16T19:37:18.176029288Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-16T19:37:18.268618876Z daemonset.apps/perf-node-gather-daemonset created
2026-09-16T19:37:18.270388973Z Wrote inspect data to /must-gather/istio.
2026-09-16T19:37:18.419843664Z Waiting for performance profile collector pods to become ready: 1
2026-09-16T19:37:18.493986878Z Wrote inspect data to /must-gather/istio.
2026-09-16T19:37:18.497185496Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io
2026-09-16T19:37:18.699433048Z Wrote inspect data to /must-gather/istio.
2026-09-16T19:37:18.782170341Z Gathering data for ns/openshift-dns-operator...
2026-09-16T19:37:18.813729585Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-09-16T19:37:18.919934896Z Wrote inspect data to /must-gather/istio.
2026-09-16T19:37:18.923063032Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-16T19:37:19.108364943Z Wrote inspect data to /must-gather/istio.
2026-09-16T19:37:19.128774766Z Gathering data for ns/openshift-dns...
2026-09-16T19:37:19.283799412Z Wrote inspect data to /must-gather/istio.
2026-09-16T19:37:19.550229646Z Waiting for performance profile collector pods to become ready: 2
2026-09-16T19:37:19.786295626Z Gathering data for ns/openshift-image-registry...
2026-09-16T19:37:19.990913964Z Done executing Istio gather script
2026-09-16T19:37:20.289843210Z Gathering data for ns/openshift-ingress-operator...
2026-09-16T19:37:20.629110316Z Gathering data for ns/openshift-ingress...
2026-09-16T19:37:20.676516168Z Waiting for performance profile collector pods to become ready: 3
2026-09-16T19:37:20.981805999Z Gathering data for ns/openshift-ingress-canary...
2026-09-16T19:37:21.366896534Z Gathering data for ns/openshift-insights...
2026-09-16T19:37:21.792312595Z Waiting for performance profile collector pods to become ready: 4
2026-09-16T19:37:22.901542524Z Waiting for performance profile collector pods to become ready: 5
2026-09-16T19:37:23.790284714Z Gathering data for ns/kserve...
2026-09-16T19:37:23.819700525Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-09-16T19:37:24.025982330Z Waiting for performance profile collector pods to become ready: 6
2026-09-16T19:37:25.149454576Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-16T19:37:25.386667344Z Collecting performance related data for node ip-10-0-134-125.ec2.internal
2026-09-16T19:37:25.393407204Z Collecting performance related data for node ip-10-0-137-226.ec2.internal
2026-09-16T19:37:25.400702576Z Collecting performance related data for node ip-10-0-142-175.ec2.internal
2026-09-16T19:37:25.521731674Z Gathering data for ns/openshift-config...
2026-09-16T19:37:25.863210629Z Gathering data for ns/openshift-config-managed...
2026-09-16T19:37:26.387133516Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-16T19:37:26.754222024Z Gathering data for ns/openshift-kube-apiserver...
2026-09-16T19:37:27.083838326Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-16T19:37:27.392526490Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-16T19:37:27.714966905Z Gathering data for ns/openshift-kube-scheduler...
2026-09-16T19:37:28.071676656Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-16T19:37:28.441191452Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-16T19:37:28.787430469Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-16T19:37:28.825067959Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-09-16T19:37:29.121337641Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-16T19:37:29.676332736Z Gathering data for ns/openshift-multus...
2026-09-16T19:37:31.192609550Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-16T19:37:32.416758535Z Gathering data for ns/openshift-host-network...
2026-09-16T19:37:32.748809508Z Gathering data for ns/openshift-network-diagnostics...
2026-09-16T19:37:33.318525160Z Gathering data for ns/openshift-network-node-identity...
2026-09-16T19:37:33.553448849Z Collecting kubelet logs for node ip-10-0-134-125.ec2.internal
2026-09-16T19:37:33.555544552Z Collecting kubelet logs for node ip-10-0-137-226.ec2.internal
2026-09-16T19:37:33.557687804Z Collecting kubelet logs for node ip-10-0-142-175.ec2.internal
2026-09-16T19:37:33.801177373Z Gathering data for ns/openshift-network-operator...
2026-09-16T19:37:33.831007460Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-09-16T19:37:33.951142228Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-grqt8 namespace
2026-09-16T19:37:33.957339247Z INFO: Node performance data collection complete.
2026-09-16T19:37:34.220041243Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-16T19:37:34.501518279Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-16T19:37:34.990766410Z Gathering data for ns/openshift-apiserver-operator...
2026-09-16T19:37:35.300348634Z Gathering data for ns/openshift-apiserver...
2026-09-16T19:37:35.693113079Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-16T19:37:35.966076649Z Gathering data for ns/openshift-controller-manager...
2026-09-16T19:37:36.291705014Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-16T19:37:36.943635526Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-16T19:37:37.277316700Z Gathering data for ns/openshift-service-ca-operator...
2026-09-16T19:37:37.591309683Z Gathering data for ns/openshift-service-ca...
2026-09-16T19:37:37.964870043Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-16T19:37:38.835331538Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-09-16T19:37:38.844802018Z Wrote inspect data to must-gather.
2026-09-16T19:37:38.844851021Z error: inspection completed with the errors occurred while gathering data:
2026-09-16T19:37:38.844851021Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-16T19:37:38.973973262Z error: the server doesn't have a resource type "clusters"
2026-09-16T19:37:39.114583847Z Caches written to disk