2026-09-17T18:06:53.246589694Z [disk usage checker] Started
2026-09-17T18:06:53.249730284Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-09-17T18:06:53.455103346Z Gathering data for ns/openshift-cluster-version...
2026-09-17T18:06:53.652146841Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T18:06:53.782465699Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T18:06:53.879743047Z Gathering data for ns/default...
2026-09-17T18:06:54.317821975Z Gathering data for ns/openshift...
2026-09-17T18:06:54.807529756Z Gathering data for ns/kube-system...
2026-09-17T18:06:55.635557476Z Gathering data for ns/openshift-etcd...
2026-09-17T18:06:56.078436300Z Wrote inspect data to must-gather.
2026-09-17T18:06:56.078467605Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T18:06:56.078467605Z     namespaces "assisted-installer" not found
2026-09-17T18:06:56.091548282Z Waiting on subprocesses to finish execution.
2026-09-17T18:06:56.098159370Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-17T18:06:56.098455107Z INFO: Collecting host service logs for crio
2026-09-17T18:06:56.098744206Z INFO: Collecting host service logs for kubelet
2026-09-17T18:06:56.099370764Z INFO: Collecting host service logs for rpm-ostreed
2026-09-17T18:06:56.099699603Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-17T18:06:56.100043250Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-17T18:06:56.100498334Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-17T18:06:56.100850482Z INFO: Collecting host service logs for NetworkManager
2026-09-17T18:06:56.101210106Z INFO: Collecting host service logs for openvswitch
2026-09-17T18:06:56.101646097Z INFO: Collecting host service logs for ovs-configuration
2026-09-17T18:06:56.101980500Z INFO: Collecting host service logs for ovsdb-server
2026-09-17T18:06:56.102430295Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-17T18:06:56.102801284Z INFO: Waiting for worker host service log collection to complete ...
2026-09-17T18:06:56.105898087Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-17T18:06:56.119785989Z Executing Istio gather script
2026-09-17T18:06:56.120435097Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-17T18:06:56.131978354Z INFO: Gathering HAProxy config files
2026-09-17T18:06:56.232099889Z INFO: Waiting for node performance related collection to complete ...
2026-09-17T18:06:56.899862554Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-17T18:06:56.909529723Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-17T18:06:57.019145581Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-17T18:06:57.019145581Z INFO: on-disk MachineConfig config collection complete.
2026-09-17T18:06:57.195529320Z INFO: "metallb-operator" not detected. Skipping.
2026-09-17T18:06:57.283487581Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-17T18:06:57.418215996Z INFO: Collecting Insights Archives from insights-operator-6f9c644dd9-dqbxl
2026-09-17T18:06:57.418215996Z insights-runtime-extractor-9jwbf
2026-09-17T18:06:57.418215996Z insights-runtime-extractor-stkx7
2026-09-17T18:06:57.418215996Z insights-runtime-extractor-xf4jk
2026-09-17T18:06:57.606677451Z Wrote inspect data to must-gather.
2026-09-17T18:06:57.611681535Z No resources found
2026-09-17T18:06:57.648760422Z error: the server doesn't have a resource type "performanceprofile"
2026-09-17T18:06:57.906680651Z No resources found in openshift-etcd namespace.
2026-09-17T18:06:57.929123438Z INFO: Worker host service log collection to complete.
2026-09-17T18:06:57.931946269Z ERROR: No running kube-apiserver pods found
2026-09-17T18:06:58.264362321Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-09-17T18:06:58.301837952Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-17T18:06:58.368873863Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-17T18:06:58.376722010Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T18:06:58.487084137Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-17T18:06:58.539260506Z Wrote inspect data to must-gather.
2026-09-17T18:06:58.578941201Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-17T18:06:58.610813912Z No resources found
2026-09-17T18:06:58.899176245Z Wrote inspect data to must-gather.
2026-09-17T18:06:58.918533719Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-17T18:06:58.918533719Z See 'oc rsync -h' for help and examples
2026-09-17T18:06:58.930048323Z Wrote inspect data to must-gather.
2026-09-17T18:06:58.966786523Z Wrote inspect data to must-gather.
2026-09-17T18:06:58.973423934Z INFO: 'previous-logs' folder not found on ip-10-0-134-49.ec2.internal, skipping...
2026-09-17T18:06:58.992903705Z Wrote inspect data to must-gather.
2026-09-17T18:06:58.996214216Z Gathering data for ns/openshift-monitoring...
2026-09-17T18:06:59.113360459Z Wrote inspect data to must-gather.
2026-09-17T18:06:59.199989977Z tar: Removing leading `/' from member names
2026-09-17T18:06:59.205501117Z INFO: HAProxy config collection complete.
2026-09-17T18:06:59.246440864Z error: the server doesn't have a resource type "machineconfigs"
2026-09-17T18:06:59.299141645Z INFO: Getting rules from prometheus-k8s-0
2026-09-17T18:06:59.333143733Z Wrote inspect data to must-gather.
2026-09-17T18:06:59.357124555Z INFO: 'previous-logs' folder not found on ip-10-0-135-179.ec2.internal, skipping...
2026-09-17T18:06:59.436078428Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-17T18:06:59.666424152Z Wrote inspect data to must-gather.
2026-09-17T18:06:59.677874642Z INFO: 'previous-logs' folder not found on ip-10-0-142-4.ec2.internal, skipping...
2026-09-17T18:06:59.677906523Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-17T18:06:59.677933093Z INFO: Machine Config Daemon termination log collection complete.
2026-09-17T18:06:59.716262941Z Wrote inspect data to must-gather.
2026-09-17T18:06:59.780507926Z INFO: Getting status/config from prometheus-k8s-0
2026-09-17T18:06:59.841335748Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-17T18:06:59.920700299Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-17T18:06:59.934765366Z Wrote inspect data to must-gather.
2026-09-17T18:07:00.147776162Z Wrote inspect data to must-gather.
2026-09-17T18:07:00.230146572Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-17T18:07:00.247698512Z INFO: INTERCONNECT MODE
2026-09-17T18:07:00.247698512Z INFO: Gathering ovn-kubernetes DBs
2026-09-17T18:07:00.398761848Z Wrote inspect data to must-gather.
2026-09-17T18:07:00.420815639Z INFO: Gathering OVN_Northbound from ovnkube-node-9qk8j...
2026-09-17T18:07:00.421083572Z INFO: Gathering OVN_Northbound from ovnkube-node-c528h...
2026-09-17T18:07:00.421346967Z INFO: Gathering OVN_Northbound from ovnkube-node-ksrc4...
2026-09-17T18:07:00.421659456Z INFO: Gathering OVN_Southbound from ovnkube-node-9qk8j...
2026-09-17T18:07:00.422010096Z INFO: Gathering OVN_Southbound from ovnkube-node-c528h...
2026-09-17T18:07:00.422341733Z INFO: Gathering OVN_Southbound from ovnkube-node-ksrc4...
2026-09-17T18:07:00.530373297Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-17T18:07:00.728075978Z tar: Removing leading `/' from member names
2026-09-17T18:07:00.729880165Z tar: Removing leading `/' from member names
2026-09-17T18:07:00.758235560Z tar: Removing leading `/' from member names
2026-09-17T18:07:00.766215708Z tar: Removing leading `/' from member names
2026-09-17T18:07:00.784518002Z tar: Removing leading `/' from member names
2026-09-17T18:07:00.786171670Z tar: Removing leading `/' from member names
2026-09-17T18:07:00.832658648Z Wrote inspect data to must-gather.
2026-09-17T18:07:00.912823198Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-17T18:07:00.956044207Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T18:07:01.090854963Z Wrote inspect data to must-gather.
2026-09-17T18:07:01.119750368Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-17T18:07:01.210626258Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-17T18:07:01.306297525Z INFO: Waiting for network log collection to complete ...
2026-09-17T18:07:01.306426034Z INFO: Waiting for ovnk database copies to complete ...
2026-09-17T18:07:01.306939021Z INFO: Copying ovnk databases complete.
2026-09-17T18:07:01.309100277Z 3.6M	must-gather/network_logs/ovnk_database_store
2026-09-17T18:07:01.312027811Z ovnk_database_store/
2026-09-17T18:07:01.312092160Z ovnk_database_store/ovnkube-node-9qk8j_sbdb
2026-09-17T18:07:01.337414986Z ovnk_database_store/ovnkube-node-ksrc4_nbdb
2026-09-17T18:07:01.346998972Z ovnk_database_store/ovnkube-node-c528h_sbdb
2026-09-17T18:07:01.349077248Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:07:01.370348284Z ovnk_database_store/ovnkube-node-ksrc4_sbdb
2026-09-17T18:07:01.375404196Z Wrote inspect data to must-gather.
2026-09-17T18:07:01.397541931Z ovnk_database_store/ovnkube-node-9qk8j_nbdb
2026-09-17T18:07:01.407196192Z ovnk_database_store/ovnkube-node-c528h_nbdb
2026-09-17T18:07:01.420837233Z INFO: Network log collection complete.
2026-09-17T18:07:01.575781797Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:07:01.578915700Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-17T18:07:01.597844441Z W0917 18:07:01.597791    1519 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-09-17T18:07:01.605006427Z Wrote inspect data to must-gather.
2026-09-17T18:07:01.663144732Z INFO: Getting status from alertmanager-main-0
2026-09-17T18:07:01.666886580Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T18:07:01.798075314Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:07:01.875022524Z Gathering data for ns/openshift-network-console...
2026-09-17T18:07:01.904181097Z Wrote inspect data to must-gather.
2026-09-17T18:07:02.018436436Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:07:02.021358313Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-17T18:07:02.186836116Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-17T18:07:02.189080412Z INFO: Fallback to identify the container image from release info
2026-09-17T18:07:02.218469285Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:07:02.412834907Z Gathering data for ns/openshift-console-operator...
2026-09-17T18:07:02.434734587Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:07:02.436716495Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-17T18:07:02.654077446Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:07:02.799554439Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea
2026-09-17T18:07:02.867103594Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:07:02.873198848Z Inspecting resource crd/inferencepools.inference.networking.k8s.io
2026-09-17T18:07:02.904459495Z Gathering data for ns/openshift-console...
2026-09-17T18:07:02.938375465Z daemonset.apps/perf-node-gather-daemonset created
2026-09-17T18:07:03.072814858Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:07:03.097440413Z Waiting for performance profile collector pods to become ready: 1
2026-09-17T18:07:03.249291309Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:07:03.253110987Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io
2026-09-17T18:07:03.269143766Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-09-17T18:07:03.441166659Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:07:03.570612254Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-17T18:07:03.642205533Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:07:03.644630046Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-17T18:07:03.817781688Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:07:04.010981873Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:07:04.248520721Z Waiting for performance profile collector pods to become ready: 2
2026-09-17T18:07:04.249996222Z Gathering data for ns/openshift-dns-operator...
2026-09-17T18:07:04.673037181Z Gathering data for ns/openshift-dns...
2026-09-17T18:07:04.726145702Z Done executing Istio gather script
2026-09-17T18:07:05.380030858Z Waiting for performance profile collector pods to become ready: 3
2026-09-17T18:07:05.478293754Z Gathering data for ns/openshift-image-registry...
2026-09-17T18:07:06.153648564Z Gathering data for ns/openshift-ingress-operator...
2026-09-17T18:07:06.512461448Z Waiting for performance profile collector pods to become ready: 4
2026-09-17T18:07:06.588201008Z Gathering data for ns/openshift-ingress...
2026-09-17T18:07:07.048808703Z Gathering data for ns/openshift-ingress-canary...
2026-09-17T18:07:07.618426717Z Gathering data for ns/openshift-insights...
2026-09-17T18:07:07.647252369Z Waiting for performance profile collector pods to become ready: 5
2026-09-17T18:07:08.273829316Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-09-17T18:07:08.754337593Z Waiting for performance profile collector pods to become ready: 6
2026-09-17T18:07:09.890443212Z Waiting for performance profile collector pods to become ready: 7
2026-09-17T18:07:10.452349706Z Gathering data for ns/kserve...
2026-09-17T18:07:11.019850603Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-17T18:07:11.267478314Z Collecting performance related data for node ip-10-0-134-49.ec2.internal
2026-09-17T18:07:11.277136324Z Collecting performance related data for node ip-10-0-142-4.ec2.internal
2026-09-17T18:07:11.283505182Z Collecting performance related data for node ip-10-0-135-179.ec2.internal
2026-09-17T18:07:12.618069864Z Gathering data for ns/openshift-config...
2026-09-17T18:07:13.048326717Z Gathering data for ns/openshift-config-managed...
2026-09-17T18:07:13.278409980Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-09-17T18:07:13.652079245Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-17T18:07:14.064811041Z Gathering data for ns/openshift-kube-apiserver...
2026-09-17T18:07:14.469069946Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-17T18:07:14.897576147Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-17T18:07:15.321232432Z Gathering data for ns/openshift-kube-scheduler...
2026-09-17T18:07:15.782337136Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-17T18:07:16.151224516Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-17T18:07:16.642334024Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-17T18:07:17.072118959Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-17T18:07:17.715884718Z Gathering data for ns/openshift-multus...
2026-09-17T18:07:18.282715036Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-09-17T18:07:19.390828563Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-17T18:07:19.483775984Z Collecting kubelet logs for node ip-10-0-134-49.ec2.internal
2026-09-17T18:07:19.485515455Z Collecting kubelet logs for node ip-10-0-142-4.ec2.internal
2026-09-17T18:07:19.487681078Z Collecting kubelet logs for node ip-10-0-135-179.ec2.internal
2026-09-17T18:07:19.847414479Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-wlfjm namespace
2026-09-17T18:07:19.853210797Z INFO: Node performance data collection complete.
2026-09-17T18:07:20.764322467Z Gathering data for ns/openshift-host-network...
2026-09-17T18:07:21.210093548Z Gathering data for ns/openshift-network-diagnostics...
2026-09-17T18:07:21.864882474Z Gathering data for ns/openshift-network-node-identity...
2026-09-17T18:07:22.364321441Z Gathering data for ns/openshift-network-operator...
2026-09-17T18:07:22.824478036Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-17T18:07:23.209361630Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-17T18:07:23.287711435Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-09-17T18:07:23.770832188Z Gathering data for ns/openshift-apiserver-operator...
2026-09-17T18:07:24.148956751Z Gathering data for ns/openshift-apiserver...
2026-09-17T18:07:24.610484266Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-17T18:07:24.984261195Z Gathering data for ns/openshift-controller-manager...
2026-09-17T18:07:25.389641432Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-17T18:07:26.157639815Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-17T18:07:26.528324008Z Gathering data for ns/openshift-service-ca-operator...
2026-09-17T18:07:26.961039170Z Gathering data for ns/openshift-service-ca...
2026-09-17T18:07:27.438835646Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-17T18:07:28.292047589Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-09-17T18:07:28.423825059Z Wrote inspect data to must-gather.
2026-09-17T18:07:28.423867740Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T18:07:28.423867740Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-17T18:07:28.553506434Z error: the server doesn't have a resource type "clusters"
2026-09-17T18:07:28.630501677Z Caches written to disk