2026-09-07T13:27:58.014550992Z [disk usage checker] Started
2026-09-07T13:27:58.017893376Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-09-07T13:27:58.219268671Z Gathering data for ns/openshift-cluster-version...
2026-09-07T13:27:58.366567363Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-07T13:27:58.488982890Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-07T13:27:58.596953017Z Gathering data for ns/default...
2026-09-07T13:27:58.997181012Z Gathering data for ns/openshift...
2026-09-07T13:27:59.461979986Z Gathering data for ns/kube-system...
2026-09-07T13:28:00.385663518Z Gathering data for ns/openshift-etcd...
2026-09-07T13:28:00.585269742Z Waiting on subprocesses to finish execution.
2026-09-07T13:28:00.590341370Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-07T13:28:00.594761701Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-07T13:28:00.599094608Z INFO: Gathering HAProxy config files
2026-09-07T13:28:00.599768061Z Executing Istio gather script
2026-09-07T13:28:00.610422712Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-07T13:28:00.647054257Z INFO: Collecting host service logs for crio
2026-09-07T13:28:00.647320114Z INFO: Collecting host service logs for kubelet
2026-09-07T13:28:00.647661327Z INFO: Collecting host service logs for rpm-ostreed
2026-09-07T13:28:00.647961440Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-07T13:28:00.648265642Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-07T13:28:00.648590953Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-07T13:28:00.648893529Z INFO: Collecting host service logs for NetworkManager
2026-09-07T13:28:00.649187375Z INFO: Collecting host service logs for openvswitch
2026-09-07T13:28:00.649495164Z INFO: Collecting host service logs for ovs-configuration
2026-09-07T13:28:00.649804402Z INFO: Collecting host service logs for ovsdb-server
2026-09-07T13:28:00.650101090Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-07T13:28:00.650547016Z INFO: Waiting for worker host service log collection to complete ...
2026-09-07T13:28:01.048967112Z INFO: Waiting for node performance related collection to complete ...
2026-09-07T13:28:01.235541189Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-07T13:28:01.244678781Z Wrote inspect data to must-gather.
2026-09-07T13:28:01.244721585Z error: inspection completed with the errors occurred while gathering data:
2026-09-07T13:28:01.244721585Z     namespaces "assisted-installer" not found
2026-09-07T13:28:01.376507893Z INFO: "metallb-operator" not detected. Skipping.
2026-09-07T13:28:01.547882074Z INFO: Collecting Insights Archives from insights-operator-76bcd6ccf5-mqbrq
2026-09-07T13:28:01.551452884Z insights-runtime-extractor-f2tb7
2026-09-07T13:28:01.551497618Z insights-runtime-extractor-jnlxq
2026-09-07T13:28:01.551520642Z insights-runtime-extractor-xrfss
2026-09-07T13:28:01.603930791Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-07T13:28:01.686254541Z Wrote inspect data to must-gather.
2026-09-07T13:28:01.722264877Z No resources found in openshift-etcd namespace.
2026-09-07T13:28:01.756292946Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-07T13:28:01.769296786Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-07T13:28:01.769347832Z INFO: on-disk MachineConfig config collection complete.
2026-09-07T13:28:01.945073775Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-07T13:28:01.945073775Z See 'oc rsync -h' for help and examples
2026-09-07T13:28:01.949914827Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-07T13:28:02.003836824Z Wrote inspect data to must-gather.
2026-09-07T13:28:02.016459350Z error: the server doesn't have a resource type "performanceprofile"
2026-09-07T13:28:02.050570739Z INFO: Worker host service log collection to complete.
2026-09-07T13:28:02.146098166Z No resources found
2026-09-07T13:28:02.394901987Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-07T13:28:02.434662142Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-07T13:28:02.662954229Z No resources found
2026-09-07T13:28:02.742895938Z Wrote inspect data to must-gather.
2026-09-07T13:28:02.920828804Z Wrote inspect data to must-gather.
2026-09-07T13:28:02.940492376Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-07T13:28:02.975717954Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-07T13:28:02.996785942Z Wrote inspect data to must-gather.
2026-09-07T13:28:03.000238146Z Wrote inspect data to must-gather.
2026-09-07T13:28:03.031618513Z ERROR: No running kube-apiserver pods found
2026-09-07T13:28:03.041569788Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-09-07T13:28:03.067566725Z INFO: 'previous-logs' folder not found on ip-10-0-130-230.ec2.internal, skipping...
2026-09-07T13:28:03.188999244Z Wrote inspect data to must-gather.
2026-09-07T13:28:03.211668279Z error: the server doesn't have a resource type "machineconfigs"
2026-09-07T13:28:03.311240623Z tar: Removing leading `/' from member names
2026-09-07T13:28:03.320529033Z INFO: HAProxy config collection complete.
2026-09-07T13:28:03.405380588Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-07T13:28:03.431171513Z INFO: 'previous-logs' folder not found on ip-10-0-135-235.ec2.internal, skipping...
2026-09-07T13:28:03.466909360Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-07T13:28:03.504982957Z Wrote inspect data to must-gather.
2026-09-07T13:28:03.512492987Z INFO: Getting rules from prometheus-k8s-0
2026-09-07T13:28:03.583111109Z Gathering data for ns/openshift-monitoring...
2026-09-07T13:28:03.675023765Z Wrote inspect data to must-gather.
2026-09-07T13:28:03.714351602Z INFO: 'previous-logs' folder not found on ip-10-0-141-166.ec2.internal, skipping...
2026-09-07T13:28:03.714377579Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-07T13:28:03.714422469Z INFO: Machine Config Daemon termination log collection complete.
2026-09-07T13:28:03.777850944Z Wrote inspect data to must-gather.
2026-09-07T13:28:03.826686975Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-07T13:28:03.996852021Z INFO: Getting status/config from prometheus-k8s-0
2026-09-07T13:28:04.024639824Z Wrote inspect data to must-gather.
2026-09-07T13:28:04.029414102Z Wrote inspect data to must-gather.
2026-09-07T13:28:04.231146219Z Wrote inspect data to must-gather.
2026-09-07T13:28:04.282339700Z INFO: INTERCONNECT MODE
2026-09-07T13:28:04.282370860Z INFO: Gathering ovn-kubernetes DBs
2026-09-07T13:28:04.380402542Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-07T13:28:04.431002090Z Wrote inspect data to must-gather.
2026-09-07T13:28:04.442335575Z INFO: Gathering OVN_Northbound from ovnkube-node-24n9w...
2026-09-07T13:28:04.442616950Z INFO: Gathering OVN_Northbound from ovnkube-node-5x579...
2026-09-07T13:28:04.442874917Z INFO: Gathering OVN_Northbound from ovnkube-node-r4ggx...
2026-09-07T13:28:04.443147057Z INFO: Gathering OVN_Southbound from ovnkube-node-24n9w...
2026-09-07T13:28:04.443414864Z INFO: Gathering OVN_Southbound from ovnkube-node-5x579...
2026-09-07T13:28:04.443703251Z INFO: Gathering OVN_Southbound from ovnkube-node-r4ggx...
2026-09-07T13:28:04.471978327Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-07T13:28:04.661159740Z Wrote inspect data to /must-gather/istio.
2026-09-07T13:28:04.782669532Z Wrote inspect data to must-gather.
2026-09-07T13:28:04.901898169Z Wrote inspect data to /must-gather/istio.
2026-09-07T13:28:04.904270756Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-07T13:28:04.970686513Z tar: Removing leading `/' from member names
2026-09-07T13:28:04.977897800Z tar: Removing leading `/' from member names
2026-09-07T13:28:04.988199443Z tar: Removing leading `/' from member names
2026-09-07T13:28:05.005129930Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-07T13:28:05.005841564Z tar: Removing leading `/' from member names
2026-09-07T13:28:05.013077072Z Wrote inspect data to must-gather.
2026-09-07T13:28:05.024243273Z tar: Removing leading `/' from member names
2026-09-07T13:28:05.025823254Z tar: Removing leading `/' from member names
2026-09-07T13:28:05.136147558Z Wrote inspect data to /must-gather/istio.
2026-09-07T13:28:05.252455639Z Wrote inspect data to must-gather.
2026-09-07T13:28:05.293619241Z INFO: Waiting for network log collection to complete ...
2026-09-07T13:28:05.293783267Z INFO: Waiting for ovnk database copies to complete ...
2026-09-07T13:28:05.294321169Z INFO: Copying ovnk databases complete.
2026-09-07T13:28:05.297044450Z 2.8M	must-gather/network_logs/ovnk_database_store
2026-09-07T13:28:05.299672199Z ovnk_database_store/
2026-09-07T13:28:05.299672199Z ovnk_database_store/ovnkube-node-r4ggx_sbdb
2026-09-07T13:28:05.318663353Z ovnk_database_store/ovnkube-node-5x579_sbdb
2026-09-07T13:28:05.335907441Z ovnk_database_store/ovnkube-node-r4ggx_nbdb
2026-09-07T13:28:05.344229880Z ovnk_database_store/ovnkube-node-5x579_nbdb
2026-09-07T13:28:05.352194302Z ovnk_database_store/ovnkube-node-24n9w_sbdb
2026-09-07T13:28:05.353299567Z Wrote inspect data to /must-gather/istio.
2026-09-07T13:28:05.357269396Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-07T13:28:05.370564121Z ovnk_database_store/ovnkube-node-24n9w_nbdb
2026-09-07T13:28:05.378837058Z INFO: Network log collection complete.
2026-09-07T13:28:05.464088905Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-07T13:28:05.475311110Z Wrote inspect data to must-gather.
2026-09-07T13:28:05.546548817Z Wrote inspect data to /must-gather/istio.
2026-09-07T13:28:05.721582338Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-07T13:28:05.723704484Z INFO: Fallback to identify the container image from release info
2026-09-07T13:28:05.730024637Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-07T13:28:05.733669287Z Wrote inspect data to /must-gather/istio.
2026-09-07T13:28:05.736801301Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-07T13:28:05.963033255Z Wrote inspect data to /must-gather/istio.
2026-09-07T13:28:06.115907414Z INFO: Getting status from alertmanager-main-0
2026-09-07T13:28:06.168607819Z Wrote inspect data to /must-gather/istio.
2026-09-07T13:28:06.172643185Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-07T13:28:06.296298288Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f39c1daa89e19c5e987a3b759e646ffab6c1b2ab94a97ded81ddf13e73d0399
2026-09-07T13:28:06.358208154Z Wrote inspect data to /must-gather/istio.
2026-09-07T13:28:06.374495443Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-07T13:28:06.419009211Z daemonset.apps/perf-node-gather-daemonset created
2026-09-07T13:28:06.567072283Z Waiting for performance profile collector pods to become ready: 1
2026-09-07T13:28:06.578583684Z Wrote inspect data to /must-gather/istio.
2026-09-07T13:28:06.983082414Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-07T13:28:07.171665719Z Gathering data for ns/openshift-network-console...
2026-09-07T13:28:07.232782712Z Done executing Istio gather script
2026-09-07T13:28:07.619915147Z Gathering data for ns/openshift-console-operator...
2026-09-07T13:28:07.682658489Z Waiting for performance profile collector pods to become ready: 2
2026-09-07T13:28:08.030741805Z Gathering data for ns/openshift-console...
2026-09-07T13:28:08.046716244Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-09-07T13:28:08.571978718Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-07T13:28:08.783177108Z Waiting for performance profile collector pods to become ready: 3
2026-09-07T13:28:09.100537278Z Gathering data for ns/openshift-dns-operator...
2026-09-07T13:28:09.538959971Z Gathering data for ns/openshift-dns...
2026-09-07T13:28:09.897256920Z Waiting for performance profile collector pods to become ready: 4
2026-09-07T13:28:10.266176103Z Gathering data for ns/openshift-image-registry...
2026-09-07T13:28:10.802148777Z Gathering data for ns/openshift-ingress-operator...
2026-09-07T13:28:11.003044673Z Waiting for performance profile collector pods to become ready: 5
2026-09-07T13:28:11.164640279Z Gathering data for ns/openshift-ingress...
2026-09-07T13:28:11.549873694Z Gathering data for ns/openshift-ingress-canary...
2026-09-07T13:28:11.977966829Z Gathering data for ns/openshift-insights...
2026-09-07T13:28:12.109960277Z Waiting for performance profile collector pods to become ready: 6
2026-09-07T13:28:13.051372084Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-09-07T13:28:13.213520100Z Waiting for performance profile collector pods to become ready: 7
2026-09-07T13:28:13.979974137Z Gathering data for ns/openshift-jobset-operator...
2026-09-07T13:28:14.324479017Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-07T13:28:14.578163349Z Collecting performance related data for node ip-10-0-141-166.ec2.internal
2026-09-07T13:28:14.584923810Z Collecting performance related data for node ip-10-0-130-230.ec2.internal
2026-09-07T13:28:14.591701968Z Collecting performance related data for node ip-10-0-135-235.ec2.internal
2026-09-07T13:28:15.000521958Z Gathering data for ns/openshift-config...
2026-09-07T13:28:15.371929610Z Gathering data for ns/openshift-config-managed...
2026-09-07T13:28:15.988899473Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-07T13:28:16.376722395Z Gathering data for ns/openshift-kube-apiserver...
2026-09-07T13:28:16.737976486Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-07T13:28:17.076334659Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-07T13:28:17.509702213Z Gathering data for ns/openshift-kube-scheduler...
2026-09-07T13:28:17.848624985Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-07T13:28:18.056051988Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-09-07T13:28:18.241517957Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-07T13:28:18.689450839Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-07T13:28:19.059688225Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-07T13:28:19.621006834Z Gathering data for ns/openshift-multus...
2026-09-07T13:28:21.529450087Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-07T13:28:22.456867808Z Collecting kubelet logs for node ip-10-0-141-166.ec2.internal
2026-09-07T13:28:22.458817872Z Collecting kubelet logs for node ip-10-0-130-230.ec2.internal
2026-09-07T13:28:22.460989940Z Collecting kubelet logs for node ip-10-0-135-235.ec2.internal
2026-09-07T13:28:22.790771508Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-cq5rd namespace
2026-09-07T13:28:22.798420845Z INFO: Node performance data collection complete.
2026-09-07T13:28:23.060414297Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-09-07T13:28:23.213069808Z Gathering data for ns/openshift-host-network...
2026-09-07T13:28:23.619129558Z Gathering data for ns/openshift-network-diagnostics...
2026-09-07T13:28:24.274417590Z Gathering data for ns/openshift-network-node-identity...
2026-09-07T13:28:24.722711936Z Gathering data for ns/openshift-network-operator...
2026-09-07T13:28:25.248489782Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-07T13:28:25.550941629Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-07T13:28:26.075170408Z Gathering data for ns/openshift-apiserver-operator...
2026-09-07T13:28:26.394342487Z Gathering data for ns/openshift-apiserver...
2026-09-07T13:28:26.870557136Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-07T13:28:27.160545207Z Gathering data for ns/openshift-controller-manager...
2026-09-07T13:28:27.458748228Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-07T13:28:28.064902767Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-09-07T13:28:28.196815566Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-07T13:28:28.510433600Z Gathering data for ns/openshift-service-ca-operator...
2026-09-07T13:28:28.877379985Z Gathering data for ns/openshift-service-ca...
2026-09-07T13:28:29.302251176Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-07T13:28:30.332763259Z Wrote inspect data to must-gather.
2026-09-07T13:28:30.332809432Z error: inspection completed with the errors occurred while gathering data:
2026-09-07T13:28:30.332809432Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-07T13:28:30.456516068Z error: the server doesn't have a resource type "clusters"
2026-09-07T13:28:30.588149494Z Caches written to disk