2026-07-24T18:11:15.602430013Z [disk usage checker] Started
2026-07-24T18:11:15.605884946Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-07-24T18:11:15.794251925Z Gathering data for ns/openshift-cluster-version...
2026-07-24T18:11:15.939904419Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-07-24T18:11:16.028332978Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-24T18:11:16.115399218Z Gathering data for ns/default...
2026-07-24T18:11:16.408771994Z Gathering data for ns/openshift...
2026-07-24T18:11:16.798909645Z Gathering data for ns/kube-system...
2026-07-24T18:11:17.508090557Z Gathering data for ns/openshift-etcd...
2026-07-24T18:11:17.800075910Z Wrote inspect data to must-gather.
2026-07-24T18:11:17.800164495Z error: inspection completed with the errors occurred while gathering data:
2026-07-24T18:11:17.800164495Z     namespaces "assisted-installer" not found
2026-07-24T18:11:18.319445776Z Waiting on subprocesses to finish execution.
2026-07-24T18:11:18.327782499Z Executing Istio gather script
2026-07-24T18:11:18.329175672Z INFO: Gathering HAProxy config files
2026-07-24T18:11:18.331413500Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-07-24T18:11:18.332408251Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-07-24T18:11:18.367780487Z INFO: Gathering machine config daemon's old logs from all nodes
2026-07-24T18:11:18.392530259Z INFO: Collecting host service logs for crio
2026-07-24T18:11:18.392948443Z INFO: Collecting host service logs for kubelet
2026-07-24T18:11:18.393342938Z INFO: Collecting host service logs for rpm-ostreed
2026-07-24T18:11:18.393687973Z INFO: Collecting host service logs for ostree-finalize-staged
2026-07-24T18:11:18.394014897Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-07-24T18:11:18.394361296Z INFO: Collecting host service logs for machine-config-daemon-host
2026-07-24T18:11:18.394709751Z INFO: Collecting host service logs for NetworkManager
2026-07-24T18:11:18.395043865Z INFO: Collecting host service logs for openvswitch
2026-07-24T18:11:18.395387517Z INFO: Collecting host service logs for ovs-configuration
2026-07-24T18:11:18.395742616Z INFO: Collecting host service logs for ovsdb-server
2026-07-24T18:11:18.396090704Z INFO: Collecting host service logs for ovs-vswitchd
2026-07-24T18:11:18.396573255Z INFO: Waiting for worker host service log collection to complete ...
2026-07-24T18:11:18.417899470Z INFO: Waiting for node performance related collection to complete ...
2026-07-24T18:11:18.861337414Z Wrote inspect data to must-gather.
2026-07-24T18:11:19.566222399Z INFO: "sriov-network-operator" not detected. Skipping.
2026-07-24T18:11:19.595837402Z No resources found in openshift-etcd namespace.
2026-07-24T18:11:19.599471179Z INFO: "metallb-operator" not detected. Skipping.
2026-07-24T18:11:19.651053436Z INFO: Found 1 replicas - prometheus-k8s-0
2026-07-24T18:11:19.699846982Z INFO: Collecting Insights Archives from insights-operator-5885fdb759-r866t
2026-07-24T18:11:19.699893093Z insights-runtime-extractor-rfthx
2026-07-24T18:11:19.699910341Z insights-runtime-extractor-wcjjq
2026-07-24T18:11:19.699927995Z insights-runtime-extractor-xxr95
2026-07-24T18:11:19.997924899Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-07-24T18:11:20.022560549Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-07-24T18:11:20.069860176Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-07-24T18:11:20.069938951Z INFO: on-disk MachineConfig config collection complete.
2026-07-24T18:11:20.149224411Z No resources found
2026-07-24T18:11:20.192047117Z Wrote inspect data to must-gather.
2026-07-24T18:11:20.376522019Z Wrote inspect data to must-gather.
2026-07-24T18:11:20.446558744Z No resources found
2026-07-24T18:11:20.502843206Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-07-24T18:11:20.502843206Z See 'oc rsync -h' for help and examples
2026-07-24T18:11:20.598495097Z INFO: Worker host service log collection to complete.
2026-07-24T18:11:20.623053949Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-07-24T18:11:20.668665755Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-07-24T18:11:20.681385924Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-07-24T18:11:20.689664781Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-24T18:11:20.694848207Z error: the server doesn't have a resource type "performanceprofile"
2026-07-24T18:11:20.729566296Z ERROR: No running kube-apiserver pods found
2026-07-24T18:11:20.766734751Z Wrote inspect data to must-gather.
2026-07-24T18:11:20.875771104Z Wrote inspect data to must-gather.
2026-07-24T18:11:20.934612625Z INFO: 'previous-logs' folder not found on ip-10-0-128-56.ec2.internal, skipping...
2026-07-24T18:11:20.944185159Z Wrote inspect data to must-gather.
2026-07-24T18:11:21.028393580Z INFO: Waiting for HAProxy config collection to complete ...
2026-07-24T18:11:21.069359103Z Wrote inspect data to must-gather.
2026-07-24T18:11:21.118524504Z Wrote inspect data to must-gather.
2026-07-24T18:11:21.219430617Z Gathering data for ns/openshift-monitoring...
2026-07-24T18:11:21.295412292Z tar: Removing leading `/' from member names
2026-07-24T18:11:21.301720279Z INFO: HAProxy config collection complete.
2026-07-24T18:11:21.324128954Z INFO: Getting rules from prometheus-k8s-0
2026-07-24T18:11:21.352164603Z INFO: 'previous-logs' folder not found on ip-10-0-130-74.ec2.internal, skipping...
2026-07-24T18:11:21.376732262Z error: the server doesn't have a resource type "machineconfigs"
2026-07-24T18:11:21.432678683Z Wrote inspect data to must-gather.
2026-07-24T18:11:21.561100085Z error: the server doesn't have a resource type "machineconfigpools"
2026-07-24T18:11:21.621945251Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-07-24T18:11:21.673748935Z INFO: 'previous-logs' folder not found on ip-10-0-133-173.ec2.internal, skipping...
2026-07-24T18:11:21.673861131Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-07-24T18:11:21.673910624Z INFO: Machine Config Daemon termination log collection complete.
2026-07-24T18:11:21.729032518Z Wrote inspect data to must-gather.
2026-07-24T18:11:21.777240589Z INFO: Getting status/config from prometheus-k8s-0
2026-07-24T18:11:21.805012097Z Wrote inspect data to must-gather.
2026-07-24T18:11:21.976725113Z error: the server doesn't have a resource type "kubeletconfigs"
2026-07-24T18:11:22.036868033Z INFO: INTERCONNECT MODE
2026-07-24T18:11:22.036897617Z INFO: Gathering ovn-kubernetes DBs
2026-07-24T18:11:22.196929750Z INFO: Getting status/flags from prometheus-k8s-0
2026-07-24T18:11:22.203704115Z INFO: Gathering OVN_Northbound from ovnkube-node-c78hw...
2026-07-24T18:11:22.203928181Z INFO: Gathering OVN_Northbound from ovnkube-node-jc4ql...
2026-07-24T18:11:22.204166005Z INFO: Gathering OVN_Northbound from ovnkube-node-kwwwg...
2026-07-24T18:11:22.204490080Z INFO: Gathering OVN_Southbound from ovnkube-node-c78hw...
2026-07-24T18:11:22.204791110Z INFO: Gathering OVN_Southbound from ovnkube-node-jc4ql...
2026-07-24T18:11:22.205064156Z INFO: Gathering OVN_Southbound from ovnkube-node-kwwwg...
2026-07-24T18:11:22.213814769Z Wrote inspect data to must-gather.
2026-07-24T18:11:22.502685569Z tar: Removing leading `/' from member names
2026-07-24T18:11:22.509044824Z tar: Removing leading `/' from member names
2026-07-24T18:11:22.523063635Z tar: Removing leading `/' from member names
2026-07-24T18:11:22.561377582Z tar: Removing leading `/' from member names
2026-07-24T18:11:22.565100655Z tar: Removing leading `/' from member names
2026-07-24T18:11:22.570350591Z tar: Removing leading `/' from member names
2026-07-24T18:11:22.598357839Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-07-24T18:11:22.608979146Z Wrote inspect data to must-gather.
2026-07-24T18:11:22.692450769Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-07-24T18:11:22.845817455Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-07-24T18:11:22.870601431Z Wrote inspect data to must-gather.
2026-07-24T18:11:23.111497517Z Wrote inspect data to must-gather.
2026-07-24T18:11:23.126602663Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-07-24T18:11:23.155057839Z INFO: Waiting for network log collection to complete ...
2026-07-24T18:11:23.155179268Z INFO: Waiting for ovnk database copies to complete ...
2026-07-24T18:11:23.155935539Z INFO: Copying ovnk databases complete.
2026-07-24T18:11:23.158038548Z 2.8M	must-gather/network_logs/ovnk_database_store
2026-07-24T18:11:23.160759384Z ovnk_database_store/
2026-07-24T18:11:23.160759384Z ovnk_database_store/ovnkube-node-c78hw_sbdb
2026-07-24T18:11:23.180275123Z ovnk_database_store/ovnkube-node-c78hw_nbdb
2026-07-24T18:11:23.187713587Z ovnk_database_store/ovnkube-node-jc4ql_nbdb
2026-07-24T18:11:23.194285922Z ovnk_database_store/ovnkube-node-kwwwg_sbdb
2026-07-24T18:11:23.214555494Z ovnk_database_store/ovnkube-node-jc4ql_sbdb
2026-07-24T18:11:23.234482092Z ovnk_database_store/ovnkube-node-kwwwg_nbdb
2026-07-24T18:11:23.243943949Z INFO: Network log collection complete.
2026-07-24T18:11:23.305089762Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-07-24T18:11:23.340136449Z W0724 18:11:23.340076    1458 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-07-24T18:11:23.344624126Z Wrote inspect data to must-gather.
2026-07-24T18:11:23.376352520Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-24T18:11:23.522572593Z Wrote inspect data to /must-gather/istio.
2026-07-24T18:11:23.557163933Z INFO: Getting status from alertmanager-main-0
2026-07-24T18:11:23.577063650Z Gathering data for ns/openshift-network-console...
2026-07-24T18:11:23.685732452Z Wrote inspect data to must-gather.
2026-07-24T18:11:23.760783895Z Wrote inspect data to /must-gather/istio.
2026-07-24T18:11:23.762977674Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-07-24T18:11:23.980860518Z Wrote inspect data to /must-gather/istio.
2026-07-24T18:11:23.988274996Z Wrote inspect data to must-gather.
2026-07-24T18:11:24.097002726Z Gathering data for ns/openshift-console-operator...
2026-07-24T18:11:24.209458092Z Wrote inspect data to /must-gather/istio.
2026-07-24T18:11:24.212991906Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-07-24T18:11:24.270513283Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-07-24T18:11:24.273022630Z INFO: Fallback to identify the container image from release info
2026-07-24T18:11:24.404690423Z Wrote inspect data to /must-gather/istio.
2026-07-24T18:11:24.522792130Z Gathering data for ns/openshift-console...
2026-07-24T18:11:24.602413191Z Wrote inspect data to /must-gather/istio.
2026-07-24T18:11:24.606633091Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-07-24T18:11:24.822342570Z Wrote inspect data to /must-gather/istio.
2026-07-24T18:11:24.982334519Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811
2026-07-24T18:11:25.041728008Z Wrote inspect data to /must-gather/istio.
2026-07-24T18:11:25.045588508Z Inspecting resource crd/inferencepools.inference.networking.k8s.io
2026-07-24T18:11:25.064090985Z Gathering data for ns/openshift-cluster-storage-operator...
2026-07-24T18:11:25.129330989Z daemonset.apps/perf-node-gather-daemonset created
2026-07-24T18:11:25.235300110Z Wrote inspect data to /must-gather/istio.
2026-07-24T18:11:25.279525594Z Waiting for performance profile collector pods to become ready: 1
2026-07-24T18:11:25.441670167Z Wrote inspect data to /must-gather/istio.
2026-07-24T18:11:25.445029991Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io
2026-07-24T18:11:25.633372220Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-07-24T18:11:25.637493088Z Gathering data for ns/openshift-dns-operator...
2026-07-24T18:11:25.651816069Z Wrote inspect data to /must-gather/istio.
2026-07-24T18:11:25.853991819Z Wrote inspect data to /must-gather/istio.
2026-07-24T18:11:25.856942943Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-07-24T18:11:25.958093620Z Gathering data for ns/openshift-dns...
2026-07-24T18:11:26.024766235Z Wrote inspect data to /must-gather/istio.
2026-07-24T18:11:26.205116275Z Wrote inspect data to /must-gather/istio.
2026-07-24T18:11:26.418151326Z Waiting for performance profile collector pods to become ready: 2
2026-07-24T18:11:26.643448386Z Gathering data for ns/openshift-image-registry...
2026-07-24T18:11:26.909764076Z Done executing Istio gather script
2026-07-24T18:11:27.147246143Z Gathering data for ns/openshift-ingress-operator...
2026-07-24T18:11:27.472805645Z Gathering data for ns/openshift-ingress...
2026-07-24T18:11:27.553079144Z Waiting for performance profile collector pods to become ready: 3
2026-07-24T18:11:27.796001014Z Gathering data for ns/openshift-ingress-canary...
2026-07-24T18:11:28.161547573Z Gathering data for ns/openshift-insights...
2026-07-24T18:11:28.680396581Z Waiting for performance profile collector pods to become ready: 4
2026-07-24T18:11:29.800601437Z Waiting for performance profile collector pods to become ready: 5
2026-07-24T18:11:30.531436063Z Gathering data for ns/kserve...
2026-07-24T18:11:30.643030495Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-07-24T18:11:30.936395791Z Waiting for performance profile collector pods to become ready: 6
2026-07-24T18:11:31.850920877Z Gathering data for ns/openshift-config...
2026-07-24T18:11:32.049110276Z Waiting for performance profile collector pods to become ready: 7
2026-07-24T18:11:32.141630783Z Gathering data for ns/openshift-config-managed...
2026-07-24T18:11:32.544752942Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-07-24T18:11:32.795507448Z Gathering data for ns/openshift-kube-apiserver...
2026-07-24T18:11:33.043791369Z Gathering data for ns/openshift-kube-controller-manager...
2026-07-24T18:11:33.175117288Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-07-24T18:11:33.363543763Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-07-24T18:11:33.487738408Z Collecting performance related data for node ip-10-0-128-56.ec2.internal
2026-07-24T18:11:33.494467807Z Collecting performance related data for node ip-10-0-133-173.ec2.internal
2026-07-24T18:11:33.501283179Z Collecting performance related data for node ip-10-0-130-74.ec2.internal
2026-07-24T18:11:33.741960356Z Gathering data for ns/openshift-kube-scheduler...
2026-07-24T18:11:34.077267651Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-07-24T18:11:34.454771901Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-07-24T18:11:34.914491855Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-07-24T18:11:35.259571662Z Gathering data for ns/openshift-user-workload-monitoring...
2026-07-24T18:11:35.649225027Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-07-24T18:11:35.723031152Z Gathering data for ns/openshift-multus...
2026-07-24T18:11:37.116466073Z Gathering data for ns/openshift-ovn-kubernetes...
2026-07-24T18:11:38.506416366Z Gathering data for ns/openshift-host-network...
2026-07-24T18:11:38.833107927Z Gathering data for ns/openshift-network-diagnostics...
2026-07-24T18:11:39.416519870Z Gathering data for ns/openshift-network-node-identity...
2026-07-24T18:11:39.823085451Z Gathering data for ns/openshift-network-operator...
2026-07-24T18:11:40.171736638Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-07-24T18:11:40.463684034Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-07-24T18:11:40.655401472Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-07-24T18:11:40.954854591Z Gathering data for ns/openshift-apiserver-operator...
2026-07-24T18:11:41.249420771Z Gathering data for ns/openshift-apiserver...
2026-07-24T18:11:41.637966610Z Collecting kubelet logs for node ip-10-0-128-56.ec2.internal
2026-07-24T18:11:41.639716525Z Collecting kubelet logs for node ip-10-0-133-173.ec2.internal
2026-07-24T18:11:41.640807931Z Gathering data for ns/openshift-controller-manager-operator...
2026-07-24T18:11:41.641403653Z Collecting kubelet logs for node ip-10-0-130-74.ec2.internal
2026-07-24T18:11:41.955699530Z Gathering data for ns/openshift-controller-manager...
2026-07-24T18:11:42.006505238Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-zc275 namespace
2026-07-24T18:11:42.013086908Z INFO: Node performance data collection complete.
2026-07-24T18:11:42.276350057Z Gathering data for ns/openshift-cluster-samples-operator...
2026-07-24T18:11:42.882772729Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-07-24T18:11:43.151750233Z Gathering data for ns/openshift-service-ca-operator...
2026-07-24T18:11:43.435783555Z Gathering data for ns/openshift-service-ca...
2026-07-24T18:11:43.776685479Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-07-24T18:11:44.603309421Z Wrote inspect data to must-gather.
2026-07-24T18:11:44.603354361Z error: inspection completed with the errors occurred while gathering data:
2026-07-24T18:11:44.603354361Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-07-24T18:11:44.736924710Z error: the server doesn't have a resource type "clusters"
2026-07-24T18:11:44.942443450Z Caches written to disk