2026-09-15T10:07:58.793863410Z [disk usage checker] Started
2026-09-15T10:07:58.797432507Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-15T10:07:59.009317242Z Gathering data for ns/openshift-cluster-version...
2026-09-15T10:07:59.157056057Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-15T10:07:59.248060979Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-15T10:07:59.336606953Z Gathering data for ns/default...
2026-09-15T10:07:59.652820201Z Gathering data for ns/openshift...
2026-09-15T10:08:00.150448261Z Gathering data for ns/kube-system...
2026-09-15T10:08:00.866937031Z Gathering data for ns/openshift-etcd...
2026-09-15T10:08:01.176753405Z Wrote inspect data to must-gather.
2026-09-15T10:08:01.176791969Z error: inspection completed with the errors occurred while gathering data:
2026-09-15T10:08:01.176791969Z     namespaces "assisted-installer" not found
2026-09-15T10:08:01.710992988Z Waiting on subprocesses to finish execution.
2026-09-15T10:08:01.724187913Z Executing Istio gather script
2026-09-15T10:08:01.724690487Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-15T10:08:01.727217735Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-15T10:08:01.732436732Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-15T10:08:01.741688285Z INFO: Collecting host service logs for crio
2026-09-15T10:08:01.742091445Z INFO: Collecting host service logs for kubelet
2026-09-15T10:08:01.742494394Z INFO: Collecting host service logs for rpm-ostreed
2026-09-15T10:08:01.742842363Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-15T10:08:01.743205250Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-15T10:08:01.743559931Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-15T10:08:01.743908233Z INFO: Collecting host service logs for NetworkManager
2026-09-15T10:08:01.744235099Z INFO: Collecting host service logs for openvswitch
2026-09-15T10:08:01.744600124Z INFO: Collecting host service logs for ovs-configuration
2026-09-15T10:08:01.744978095Z INFO: Collecting host service logs for ovsdb-server
2026-09-15T10:08:01.745501933Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-15T10:08:01.745914952Z INFO: Waiting for worker host service log collection to complete ...
2026-09-15T10:08:01.763452389Z INFO: Gathering HAProxy config files
2026-09-15T10:08:01.772231397Z INFO: Waiting for node performance related collection to complete ...
2026-09-15T10:08:02.243669026Z INFO: Collecting Insights Archives from insights-operator-5844b856db-mm9kx
2026-09-15T10:08:02.243669026Z insights-runtime-extractor-cmnll
2026-09-15T10:08:02.243669026Z insights-runtime-extractor-d8g45
2026-09-15T10:08:02.243669026Z insights-runtime-extractor-r4ml7
2026-09-15T10:08:02.558206686Z No resources found in openshift-etcd namespace.
2026-09-15T10:08:03.032603242Z ERROR: No running kube-apiserver pods found
2026-09-15T10:08:03.056198473Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-15T10:08:03.079878583Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-15T10:08:03.088270481Z No resources found
2026-09-15T10:08:03.105562460Z error: the server doesn't have a resource type "performanceprofile"
2026-09-15T10:08:03.141049820Z INFO: "metallb-operator" not detected. Skipping.
2026-09-15T10:08:03.149345220Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-15T10:08:03.164678039Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-15T10:08:03.164710901Z INFO: on-disk MachineConfig config collection complete.
2026-09-15T10:08:03.216967073Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-15T10:08:03.234787500Z Wrote inspect data to must-gather.
2026-09-15T10:08:03.306033582Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-15T10:08:03.306033582Z See 'oc rsync -h' for help and examples
2026-09-15T10:08:03.375282337Z INFO: Worker host service log collection to complete.
2026-09-15T10:08:03.647860913Z Wrote inspect data to must-gather.
2026-09-15T10:08:03.681543071Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-15T10:08:03.808813920Z Wrote inspect data to must-gather.
2026-09-15T10:08:03.835359312Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-15T10:08:03.839200341Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-15T10:08:03.926820064Z Gathering data for ns/openshift-monitoring...
2026-09-15T10:08:04.080250633Z Wrote inspect data to must-gather.
2026-09-15T10:08:04.080250633Z INFO: 'previous-logs' folder not found on ip-10-0-133-96.ec2.internal, skipping...
2026-09-15T10:08:04.151515132Z Wrote inspect data to must-gather.
2026-09-15T10:08:04.256330913Z tar: Removing leading `/' from member names
2026-09-15T10:08:04.262162817Z INFO: HAProxy config collection complete.
2026-09-15T10:08:04.280324316Z No resources found
2026-09-15T10:08:04.353687364Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-15T10:08:04.394883095Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-15T10:08:04.520162637Z error: the server doesn't have a resource type "machineconfigs"
2026-09-15T10:08:04.546832984Z Wrote inspect data to must-gather.
2026-09-15T10:08:04.611894434Z Wrote inspect data to must-gather.
2026-09-15T10:08:04.654198292Z INFO: 'previous-logs' folder not found on ip-10-0-138-61.ec2.internal, skipping...
2026-09-15T10:08:04.724723308Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-15T10:08:04.864683203Z Wrote inspect data to must-gather.
2026-09-15T10:08:04.883504113Z INFO: Getting rules from prometheus-k8s-0
2026-09-15T10:08:04.969861457Z INFO: 'previous-logs' folder not found on ip-10-0-143-187.ec2.internal, skipping...
2026-09-15T10:08:04.969900225Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-15T10:08:04.969930105Z INFO: Machine Config Daemon termination log collection complete.
2026-09-15T10:08:05.035322611Z Wrote inspect data to must-gather.
2026-09-15T10:08:05.193970506Z Wrote inspect data to must-gather.
2026-09-15T10:08:05.228317106Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-15T10:08:05.383413419Z INFO: Getting status/config from prometheus-k8s-0
2026-09-15T10:08:05.501565726Z Wrote inspect data to must-gather.
2026-09-15T10:08:05.502573840Z Wrote inspect data to must-gather.
2026-09-15T10:08:05.560241086Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-15T10:08:05.735608963Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-15T10:08:05.776376345Z Wrote inspect data to must-gather.
2026-09-15T10:08:05.872035186Z INFO: INTERCONNECT MODE
2026-09-15T10:08:05.872088581Z INFO: Gathering ovn-kubernetes DBs
2026-09-15T10:08:05.885828439Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-15T10:08:06.057353763Z Wrote inspect data to must-gather.
2026-09-15T10:08:06.083679923Z INFO: Gathering OVN_Northbound from ovnkube-node-9ztkr...
2026-09-15T10:08:06.084249961Z INFO: Gathering OVN_Northbound from ovnkube-node-mkb7t...
2026-09-15T10:08:06.084584658Z INFO: Gathering OVN_Northbound from ovnkube-node-rj76d...
2026-09-15T10:08:06.084930621Z INFO: Gathering OVN_Southbound from ovnkube-node-9ztkr...
2026-09-15T10:08:06.085211927Z INFO: Gathering OVN_Southbound from ovnkube-node-mkb7t...
2026-09-15T10:08:06.085517345Z INFO: Gathering OVN_Southbound from ovnkube-node-rj76d...
2026-09-15T10:08:06.228739087Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-15T10:08:06.398435821Z tar: Removing leading `/' from member names
2026-09-15T10:08:06.437093286Z tar: Removing leading `/' from member names
2026-09-15T10:08:06.438949430Z tar: Removing leading `/' from member names
2026-09-15T10:08:06.455773406Z tar: Removing leading `/' from member names
2026-09-15T10:08:06.477417992Z W0915 10:08:06.477357    1272 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-09-15T10:08:06.481924587Z tar: Removing leading `/' from member names
2026-09-15T10:08:06.484200890Z Wrote inspect data to must-gather.
2026-09-15T10:08:06.509372570Z tar: Removing leading `/' from member names
2026-09-15T10:08:06.560371816Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-15T10:08:06.560461159Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-15T10:08:06.633753650Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-15T10:08:06.818620139Z Gathering data for ns/openshift-network-console...
2026-09-15T10:08:06.833421917Z Wrote inspect data to /must-gather/istio.
2026-09-15T10:08:06.880440396Z Wrote inspect data to must-gather.
2026-09-15T10:08:06.969910108Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-15T10:08:07.076433719Z INFO: Waiting for network log collection to complete ...
2026-09-15T10:08:07.076475875Z INFO: Waiting for ovnk database copies to complete ...
2026-09-15T10:08:07.076984436Z INFO: Copying ovnk databases complete.
2026-09-15T10:08:07.078952978Z 2.8M	must-gather/network_logs/ovnk_database_store
2026-09-15T10:08:07.083711993Z ovnk_database_store/
2026-09-15T10:08:07.083782822Z ovnk_database_store/ovnkube-node-mkb7t_nbdb
2026-09-15T10:08:07.098279095Z ovnk_database_store/ovnkube-node-mkb7t_sbdb
2026-09-15T10:08:07.117837689Z Wrote inspect data to /must-gather/istio.
2026-09-15T10:08:07.118809689Z ovnk_database_store/ovnkube-node-rj76d_sbdb
2026-09-15T10:08:07.121671038Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-15T10:08:07.137786874Z ovnk_database_store/ovnkube-node-9ztkr_nbdb
2026-09-15T10:08:07.146755947Z ovnk_database_store/ovnkube-node-9ztkr_sbdb
2026-09-15T10:08:07.166887779Z ovnk_database_store/ovnkube-node-rj76d_nbdb
2026-09-15T10:08:07.178621590Z INFO: Network log collection complete.
2026-09-15T10:08:07.250545216Z Wrote inspect data to must-gather.
2026-09-15T10:08:07.385412071Z Gathering data for ns/openshift-console-operator...
2026-09-15T10:08:07.388848639Z Wrote inspect data to /must-gather/istio.
2026-09-15T10:08:07.437858269Z INFO: Getting status from alertmanager-main-0
2026-09-15T10:08:07.604237880Z Wrote inspect data to must-gather.
2026-09-15T10:08:07.643686438Z Wrote inspect data to /must-gather/istio.
2026-09-15T10:08:07.646064657Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-15T10:08:07.859280325Z Gathering data for ns/openshift-console...
2026-09-15T10:08:07.866051517Z Wrote inspect data to /must-gather/istio.
2026-09-15T10:08:07.914499397Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-15T10:08:07.918461444Z INFO: Fallback to identify the container image from release info
2026-09-15T10:08:08.098222137Z Wrote inspect data to /must-gather/istio.
2026-09-15T10:08:08.100960768Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-15T10:08:08.333204917Z Wrote inspect data to /must-gather/istio.
2026-09-15T10:08:08.466951719Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-15T10:08:08.513476547Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:667babb345aeb39d2681913fd91a5c163d48d4ab8a3ba0d3156502181ea1177a
2026-09-15T10:08:08.566173466Z Wrote inspect data to /must-gather/istio.
2026-09-15T10:08:08.570318099Z Inspecting resource crd/inferencepools.inference.networking.k8s.io
2026-09-15T10:08:08.664913916Z daemonset.apps/perf-node-gather-daemonset created
2026-09-15T10:08:08.765544840Z Wrote inspect data to /must-gather/istio.
2026-09-15T10:08:08.825345074Z Waiting for performance profile collector pods to become ready: 1
2026-09-15T10:08:08.868065500Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-15T10:08:09.007984225Z Wrote inspect data to /must-gather/istio.
2026-09-15T10:08:09.010342394Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io
2026-09-15T10:08:09.096105137Z Gathering data for ns/openshift-dns-operator...
2026-09-15T10:08:09.216023345Z Wrote inspect data to /must-gather/istio.
2026-09-15T10:08:09.440869891Z Wrote inspect data to /must-gather/istio.
2026-09-15T10:08:09.443230078Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-15T10:08:09.467570975Z Gathering data for ns/openshift-dns...
2026-09-15T10:08:09.608323008Z Wrote inspect data to /must-gather/istio.
2026-09-15T10:08:09.814843606Z Wrote inspect data to /must-gather/istio.
2026-09-15T10:08:09.971598784Z Waiting for performance profile collector pods to become ready: 2
2026-09-15T10:08:10.144729562Z Gathering data for ns/openshift-image-registry...
2026-09-15T10:08:10.562253159Z Done executing Istio gather script
2026-09-15T10:08:10.656088601Z Gathering data for ns/openshift-ingress-operator...
2026-09-15T10:08:10.989637374Z Gathering data for ns/openshift-ingress...
2026-09-15T10:08:11.114715502Z Waiting for performance profile collector pods to become ready: 3
2026-09-15T10:08:11.342550969Z Gathering data for ns/openshift-ingress-canary...
2026-09-15T10:08:11.754417023Z Gathering data for ns/openshift-insights...
2026-09-15T10:08:12.252910056Z Waiting for performance profile collector pods to become ready: 4
2026-09-15T10:08:13.378787769Z Waiting for performance profile collector pods to become ready: 5
2026-09-15T10:08:13.872757898Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-15T10:08:14.241456119Z Gathering data for ns/kserve...
2026-09-15T10:08:14.504321656Z Waiting for performance profile collector pods to become ready: 6
2026-09-15T10:08:15.581824503Z Gathering data for ns/openshift-config...
2026-09-15T10:08:15.627152734Z Waiting for performance profile collector pods to become ready: 7
2026-09-15T10:08:15.842447610Z Gathering data for ns/openshift-config-managed...
2026-09-15T10:08:16.260454102Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-15T10:08:16.541528050Z Gathering data for ns/openshift-kube-apiserver...
2026-09-15T10:08:16.762514982Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-15T10:08:16.830985609Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-15T10:08:17.057625730Z Collecting performance related data for node ip-10-0-143-187.ec2.internal
2026-09-15T10:08:17.065999950Z Collecting performance related data for node ip-10-0-138-61.ec2.internal
2026-09-15T10:08:17.076646834Z Collecting performance related data for node ip-10-0-133-96.ec2.internal
2026-09-15T10:08:17.252369892Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-15T10:08:17.669587489Z Gathering data for ns/openshift-kube-scheduler...
2026-09-15T10:08:18.054356081Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-15T10:08:18.456420136Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-15T10:08:18.850260037Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-15T10:08:18.877348223Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-15T10:08:19.189645001Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-15T10:08:19.820321065Z Gathering data for ns/openshift-multus...
2026-09-15T10:08:21.491336431Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-15T10:08:23.045103663Z Gathering data for ns/openshift-host-network...
2026-09-15T10:08:23.429010273Z Gathering data for ns/openshift-network-diagnostics...
2026-09-15T10:08:23.882037476Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-15T10:08:24.059018544Z Gathering data for ns/openshift-network-node-identity...
2026-09-15T10:08:24.572815126Z Gathering data for ns/openshift-network-operator...
2026-09-15T10:08:25.083005982Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-15T10:08:25.407941339Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-15T10:08:25.749502743Z Collecting kubelet logs for node ip-10-0-143-187.ec2.internal
2026-09-15T10:08:25.752008098Z Collecting kubelet logs for node ip-10-0-138-61.ec2.internal
2026-09-15T10:08:25.754400441Z Collecting kubelet logs for node ip-10-0-133-96.ec2.internal
2026-09-15T10:08:26.000122562Z Gathering data for ns/openshift-apiserver-operator...
2026-09-15T10:08:26.145579152Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-smjsm namespace
2026-09-15T10:08:26.150622928Z INFO: Node performance data collection complete.
2026-09-15T10:08:26.360246999Z Gathering data for ns/openshift-apiserver...
2026-09-15T10:08:26.807175579Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-15T10:08:27.135590068Z Gathering data for ns/openshift-controller-manager...
2026-09-15T10:08:27.512161837Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-15T10:08:28.275415077Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-15T10:08:28.661149985Z Gathering data for ns/openshift-service-ca-operator...
2026-09-15T10:08:28.886924028Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-15T10:08:29.016675701Z Gathering data for ns/openshift-service-ca...
2026-09-15T10:08:29.420151954Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-15T10:08:30.409130351Z Wrote inspect data to must-gather.
2026-09-15T10:08:30.409179602Z error: inspection completed with the errors occurred while gathering data:
2026-09-15T10:08:30.409179602Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-15T10:08:30.552081115Z error: the server doesn't have a resource type "clusters"
2026-09-15T10:08:30.712904047Z Caches written to disk