2026-09-17T21:44:54.861450901Z [disk usage checker] Started
2026-09-17T21:44:54.864509815Z [disk usage checker] Volume usage percentage: current = 44 ; allowed = 70
2026-09-17T21:44:55.184865966Z Gathering data for ns/openshift-cluster-version...
2026-09-17T21:44:55.326963526Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T21:44:55.430085705Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T21:44:55.520569722Z Gathering data for ns/default...
2026-09-17T21:44:55.850271852Z Gathering data for ns/openshift...
2026-09-17T21:44:56.307003154Z Gathering data for ns/kube-system...
2026-09-17T21:44:57.080298182Z Gathering data for ns/openshift-etcd...
2026-09-17T21:44:57.425002258Z Wrote inspect data to must-gather.
2026-09-17T21:44:57.425037158Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T21:44:57.425037158Z     namespaces "assisted-installer" not found
2026-09-17T21:44:57.748308095Z Waiting on subprocesses to finish execution.
2026-09-17T21:44:57.755124279Z INFO: Gathering HAProxy config files
2026-09-17T21:44:57.768939077Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-17T21:44:57.776041081Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-17T21:44:57.776381648Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-17T21:44:57.791558722Z Executing Istio gather script
2026-09-17T21:44:57.805126698Z INFO: Waiting for node performance related collection to complete ...
2026-09-17T21:44:57.832276290Z INFO: Collecting host service logs for crio
2026-09-17T21:44:57.832719674Z INFO: Collecting host service logs for kubelet
2026-09-17T21:44:57.833098978Z INFO: Collecting host service logs for rpm-ostreed
2026-09-17T21:44:57.833474858Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-17T21:44:57.833822479Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-17T21:44:57.834161292Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-17T21:44:57.834646817Z INFO: Collecting host service logs for NetworkManager
2026-09-17T21:44:57.835589463Z INFO: Collecting host service logs for openvswitch
2026-09-17T21:44:57.835935959Z INFO: Collecting host service logs for ovs-configuration
2026-09-17T21:44:57.836271242Z INFO: Collecting host service logs for ovsdb-server
2026-09-17T21:44:57.836638508Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-17T21:44:57.837189632Z INFO: Waiting for worker host service log collection to complete ...
2026-09-17T21:44:58.094456289Z No resources found in openshift-etcd namespace.
2026-09-17T21:44:58.158843493Z INFO: "metallb-operator" not detected. Skipping.
2026-09-17T21:44:58.164464320Z INFO: Collecting Insights Archives from insights-operator-6f9c644dd9-4rvqw
2026-09-17T21:44:58.164638291Z insights-runtime-extractor-5hc26
2026-09-17T21:44:58.164663645Z insights-runtime-extractor-h5f7g
2026-09-17T21:44:58.164684328Z insights-runtime-extractor-zpxgv
2026-09-17T21:44:58.339673378Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-17T21:44:58.339763834Z INFO: on-disk MachineConfig config collection complete.
2026-09-17T21:44:58.612406536Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-17T21:44:59.045565757Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-17T21:44:59.071819756Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-17T21:44:59.151662168Z error: the server doesn't have a resource type "performanceprofile"
2026-09-17T21:44:59.154965023Z No resources found
2026-09-17T21:44:59.195659601Z Wrote inspect data to must-gather.
2026-09-17T21:44:59.223772408Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-17T21:44:59.232525481Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-17T21:44:59.232525481Z See 'oc rsync -h' for help and examples
2026-09-17T21:44:59.337941399Z INFO: Worker host service log collection to complete.
2026-09-17T21:44:59.428137091Z ERROR: No running kube-apiserver pods found
2026-09-17T21:44:59.784438384Z Wrote inspect data to must-gather.
2026-09-17T21:44:59.834811486Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-17T21:44:59.929852464Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-17T21:44:59.965301279Z No resources found
2026-09-17T21:44:59.983187950Z Wrote inspect data to must-gather.
2026-09-17T21:45:00.055678783Z [disk usage checker] Volume usage percentage: current = 44 ; allowed = 70
2026-09-17T21:45:00.103710772Z Wrote inspect data to must-gather.
2026-09-17T21:45:00.146686879Z Gathering data for ns/openshift-monitoring...
2026-09-17T21:45:00.169573007Z Wrote inspect data to must-gather.
2026-09-17T21:45:00.173683279Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T21:45:00.309517134Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-17T21:45:00.383999489Z Wrote inspect data to must-gather.
2026-09-17T21:45:00.421619431Z tar: Removing leading `/' from member names
2026-09-17T21:45:00.435284152Z INFO: HAProxy config collection complete.
2026-09-17T21:45:00.451181321Z error: the server doesn't have a resource type "machineconfigs"
2026-09-17T21:45:00.478689021Z INFO: 'previous-logs' folder not found on ip-10-0-129-240.ec2.internal, skipping...
2026-09-17T21:45:00.503842010Z Wrote inspect data to must-gather.
2026-09-17T21:45:00.638089265Z Wrote inspect data to must-gather.
2026-09-17T21:45:00.689500664Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-17T21:45:00.793927096Z INFO: Getting rules from prometheus-k8s-0
2026-09-17T21:45:00.801160595Z INFO: 'previous-logs' folder not found on ip-10-0-131-94.ec2.internal, skipping...
2026-09-17T21:45:00.944724465Z Wrote inspect data to must-gather.
2026-09-17T21:45:00.952270594Z Wrote inspect data to must-gather.
2026-09-17T21:45:01.116740943Z INFO: 'previous-logs' folder not found on ip-10-0-143-254.ec2.internal, skipping...
2026-09-17T21:45:01.116785697Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-17T21:45:01.116796898Z INFO: Machine Config Daemon termination log collection complete.
2026-09-17T21:45:01.130778172Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-17T21:45:01.160309896Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-17T21:45:01.224972477Z Wrote inspect data to must-gather.
2026-09-17T21:45:01.267468995Z INFO: Getting status/config from prometheus-k8s-0
2026-09-17T21:45:01.404233446Z Wrote inspect data to must-gather.
2026-09-17T21:45:01.531172587Z INFO: INTERCONNECT MODE
2026-09-17T21:45:01.531202437Z INFO: Gathering ovn-kubernetes DBs
2026-09-17T21:45:01.664094128Z Wrote inspect data to must-gather.
2026-09-17T21:45:01.727089524Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-17T21:45:01.740257163Z INFO: Gathering OVN_Northbound from ovnkube-node-2pwxh...
2026-09-17T21:45:01.740478872Z INFO: Gathering OVN_Northbound from ovnkube-node-8wlt5...
2026-09-17T21:45:01.740742239Z INFO: Gathering OVN_Northbound from ovnkube-node-hg45d...
2026-09-17T21:45:01.741054955Z INFO: Gathering OVN_Southbound from ovnkube-node-2pwxh...
2026-09-17T21:45:01.741311201Z INFO: Gathering OVN_Southbound from ovnkube-node-8wlt5...
2026-09-17T21:45:01.741620334Z INFO: Gathering OVN_Southbound from ovnkube-node-hg45d...
2026-09-17T21:45:01.800740182Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T21:45:02.014436992Z Wrote inspect data to must-gather.
2026-09-17T21:45:02.057759373Z tar: Removing leading `/' from member names
2026-09-17T21:45:02.077782664Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-17T21:45:02.122578075Z tar: Removing leading `/' from member names
2026-09-17T21:45:02.136218642Z tar: Removing leading `/' from member names
2026-09-17T21:45:02.136348747Z tar: Removing leading `/' from member names
2026-09-17T21:45:02.136531721Z tar: Removing leading `/' from member names
2026-09-17T21:45:02.148247663Z tar: Removing leading `/' from member names
2026-09-17T21:45:02.323626051Z Wrote inspect data to must-gather.
2026-09-17T21:45:02.358436261Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-17T21:45:02.513587231Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-17T21:45:02.571805972Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T21:45:02.647703193Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-17T21:45:02.659993735Z INFO: Waiting for network log collection to complete ...
2026-09-17T21:45:02.660023561Z INFO: Waiting for ovnk database copies to complete ...
2026-09-17T21:45:02.660472648Z INFO: Copying ovnk databases complete.
2026-09-17T21:45:02.662132179Z 4.7M	must-gather/network_logs/ovnk_database_store
2026-09-17T21:45:02.666142891Z ovnk_database_store/
2026-09-17T21:45:02.666194581Z ovnk_database_store/ovnkube-node-2pwxh_nbdb
2026-09-17T21:45:02.678657780Z Wrote inspect data to must-gather.
2026-09-17T21:45:02.679072553Z ovnk_database_store/ovnkube-node-hg45d_nbdb
2026-09-17T21:45:02.691700687Z ovnk_database_store/ovnkube-node-8wlt5_nbdb
2026-09-17T21:45:02.705307899Z ovnk_database_store/ovnkube-node-hg45d_sbdb
2026-09-17T21:45:02.740146804Z ovnk_database_store/ovnkube-node-8wlt5_sbdb
2026-09-17T21:45:02.755502685Z Wrote inspect data to /must-gather/istio.
2026-09-17T21:45:02.773281572Z ovnk_database_store/ovnkube-node-2pwxh_sbdb
2026-09-17T21:45:02.803875349Z INFO: Network log collection complete.
2026-09-17T21:45:02.812452075Z Gathering data for ns/openshift-network-console...
2026-09-17T21:45:02.994379537Z Wrote inspect data to /must-gather/istio.
2026-09-17T21:45:02.998661597Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-17T21:45:03.008241131Z Wrote inspect data to must-gather.
2026-09-17T21:45:03.087776528Z INFO: Getting status from alertmanager-main-0
2026-09-17T21:45:03.234210989Z Wrote inspect data to /must-gather/istio.
2026-09-17T21:45:03.321350232Z Gathering data for ns/openshift-console-operator...
2026-09-17T21:45:03.321792285Z Wrote inspect data to must-gather.
2026-09-17T21:45:03.459287902Z Wrote inspect data to /must-gather/istio.
2026-09-17T21:45:03.462627345Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-17T21:45:03.615685163Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-17T21:45:03.621078427Z INFO: Fallback to identify the container image from release info
2026-09-17T21:45:03.658671403Z Wrote inspect data to /must-gather/istio.
2026-09-17T21:45:03.757596496Z Gathering data for ns/openshift-console...
2026-09-17T21:45:03.878139136Z Wrote inspect data to /must-gather/istio.
2026-09-17T21:45:03.882670985Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-17T21:45:04.082126289Z Wrote inspect data to /must-gather/istio.
2026-09-17T21:45:04.258769600Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea
2026-09-17T21:45:04.309777833Z Wrote inspect data to /must-gather/istio.
2026-09-17T21:45:04.313963795Z Inspecting resource crd/inferencepools.inference.networking.k8s.io
2026-09-17T21:45:04.341660302Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-17T21:45:04.408908236Z daemonset.apps/perf-node-gather-daemonset created
2026-09-17T21:45:04.503673488Z Wrote inspect data to /must-gather/istio.
2026-09-17T21:45:04.552614856Z Waiting for performance profile collector pods to become ready: 1
2026-09-17T21:45:04.711805944Z Wrote inspect data to /must-gather/istio.
2026-09-17T21:45:04.715030685Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io
2026-09-17T21:45:04.915144061Z Wrote inspect data to /must-gather/istio.
2026-09-17T21:45:04.932647406Z Gathering data for ns/openshift-dns-operator...
2026-09-17T21:45:05.081979631Z [disk usage checker] Volume usage percentage: current = 44 ; allowed = 70
2026-09-17T21:45:05.113913084Z Wrote inspect data to /must-gather/istio.
2026-09-17T21:45:05.117180937Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-17T21:45:05.286862496Z Gathering data for ns/openshift-dns...
2026-09-17T21:45:05.297523840Z Wrote inspect data to /must-gather/istio.
2026-09-17T21:45:05.474947877Z Wrote inspect data to /must-gather/istio.
2026-09-17T21:45:05.681467550Z Waiting for performance profile collector pods to become ready: 2
2026-09-17T21:45:05.929968076Z Gathering data for ns/openshift-image-registry...
2026-09-17T21:45:06.192757451Z Done executing Istio gather script
2026-09-17T21:45:06.425424886Z Gathering data for ns/openshift-ingress-operator...
2026-09-17T21:45:06.760960059Z Gathering data for ns/openshift-ingress...
2026-09-17T21:45:06.816919944Z Waiting for performance profile collector pods to become ready: 3
2026-09-17T21:45:07.092573872Z Gathering data for ns/openshift-ingress-canary...
2026-09-17T21:45:07.484213431Z Gathering data for ns/openshift-insights...
2026-09-17T21:45:07.931887603Z Waiting for performance profile collector pods to become ready: 4
2026-09-17T21:45:09.056687430Z Waiting for performance profile collector pods to become ready: 5
2026-09-17T21:45:09.881473228Z Gathering data for ns/kserve...
2026-09-17T21:45:10.086387070Z [disk usage checker] Volume usage percentage: current = 44 ; allowed = 70
2026-09-17T21:45:10.192920457Z Waiting for performance profile collector pods to become ready: 6
2026-09-17T21:45:11.328710530Z Waiting for performance profile collector pods to become ready: 7
2026-09-17T21:45:11.938903962Z Gathering data for ns/openshift-config...
2026-09-17T21:45:12.260287343Z Gathering data for ns/openshift-config-managed...
2026-09-17T21:45:12.440236702Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-17T21:45:12.702964663Z Collecting performance related data for node ip-10-0-143-254.ec2.internal
2026-09-17T21:45:12.713577474Z Collecting performance related data for node ip-10-0-129-240.ec2.internal
2026-09-17T21:45:12.721378241Z Collecting performance related data for node ip-10-0-131-94.ec2.internal
2026-09-17T21:45:12.795153345Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-17T21:45:13.149712239Z Gathering data for ns/openshift-kube-apiserver...
2026-09-17T21:45:13.485819496Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-17T21:45:13.877463372Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-17T21:45:14.274753322Z Gathering data for ns/openshift-kube-scheduler...
2026-09-17T21:45:14.599409113Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-17T21:45:14.913159992Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-17T21:45:15.091045602Z [disk usage checker] Volume usage percentage: current = 44 ; allowed = 70
2026-09-17T21:45:15.296658392Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-17T21:45:15.676771448Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-17T21:45:16.311334456Z Gathering data for ns/openshift-multus...
2026-09-17T21:45:17.832509035Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-17T21:45:19.182821696Z Gathering data for ns/openshift-host-network...
2026-09-17T21:45:19.503777376Z Gathering data for ns/openshift-network-diagnostics...
2026-09-17T21:45:20.089881055Z Gathering data for ns/openshift-network-node-identity...
2026-09-17T21:45:20.097237226Z [disk usage checker] Volume usage percentage: current = 44 ; allowed = 70
2026-09-17T21:45:20.580515548Z Gathering data for ns/openshift-network-operator...
2026-09-17T21:45:20.983860292Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-17T21:45:21.028459468Z Collecting kubelet logs for node ip-10-0-143-254.ec2.internal
2026-09-17T21:45:21.030713686Z Collecting kubelet logs for node ip-10-0-129-240.ec2.internal
2026-09-17T21:45:21.032589692Z Collecting kubelet logs for node ip-10-0-131-94.ec2.internal
2026-09-17T21:45:21.337666825Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-17T21:45:21.482660457Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-4cltr namespace
2026-09-17T21:45:21.489677057Z INFO: Node performance data collection complete.
2026-09-17T21:45:21.884721895Z Gathering data for ns/openshift-apiserver-operator...
2026-09-17T21:45:22.219936494Z Gathering data for ns/openshift-apiserver...
2026-09-17T21:45:22.687863295Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-17T21:45:22.983833691Z Gathering data for ns/openshift-controller-manager...
2026-09-17T21:45:23.328557368Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-17T21:45:24.046922403Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-17T21:45:24.367467298Z Gathering data for ns/openshift-service-ca-operator...
2026-09-17T21:45:24.703964816Z Gathering data for ns/openshift-service-ca...
2026-09-17T21:45:25.097083728Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-17T21:45:25.102221247Z [disk usage checker] Volume usage percentage: current = 44 ; allowed = 70
2026-09-17T21:45:26.030501457Z Wrote inspect data to must-gather.
2026-09-17T21:45:26.030546933Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T21:45:26.030546933Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-17T21:45:26.164281492Z error: the server doesn't have a resource type "clusters"
2026-09-17T21:45:26.308891815Z Caches written to disk