2026-09-17T07:54:16.444917084Z [disk usage checker] Started
2026-09-17T07:54:16.448974166Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-17T07:54:16.638785296Z Gathering data for ns/openshift-cluster-version...
2026-09-17T07:54:16.774342424Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T07:54:16.865911346Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T07:54:16.951211302Z Gathering data for ns/default...
2026-09-17T07:54:17.429675443Z Gathering data for ns/openshift...
2026-09-17T07:54:17.970678944Z Gathering data for ns/kube-system...
2026-09-17T07:54:18.777955783Z Gathering data for ns/openshift-etcd...
2026-09-17T07:54:19.000076883Z Waiting on subprocesses to finish execution.
2026-09-17T07:54:19.010003066Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-17T07:54:19.011130203Z INFO: Collecting host service logs for crio
2026-09-17T07:54:19.011471451Z INFO: Collecting host service logs for kubelet
2026-09-17T07:54:19.011839816Z INFO: Collecting host service logs for rpm-ostreed
2026-09-17T07:54:19.012199224Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-17T07:54:19.012642198Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-17T07:54:19.013076782Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-17T07:54:19.013403895Z INFO: Collecting host service logs for NetworkManager
2026-09-17T07:54:19.013715987Z INFO: Collecting host service logs for openvswitch
2026-09-17T07:54:19.014052885Z INFO: Collecting host service logs for ovs-configuration
2026-09-17T07:54:19.014365972Z INFO: Collecting host service logs for ovsdb-server
2026-09-17T07:54:19.014667611Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-17T07:54:19.015092920Z INFO: Waiting for worker host service log collection to complete ...
2026-09-17T07:54:19.018166165Z Executing Istio gather script
2026-09-17T07:54:19.020293600Z INFO: Gathering HAProxy config files
2026-09-17T07:54:19.022664721Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-17T07:54:19.161313425Z INFO: Waiting for node performance related collection to complete ...
2026-09-17T07:54:19.165282062Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-17T07:54:19.460685579Z No resources found
2026-09-17T07:54:19.466019781Z Wrote inspect data to must-gather.
2026-09-17T07:54:19.466102093Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T07:54:19.466102093Z     namespaces "assisted-installer" not found
2026-09-17T07:54:19.709132750Z No resources found in openshift-etcd namespace.
2026-09-17T07:54:19.901366671Z error: the server doesn't have a resource type "performanceprofile"
2026-09-17T07:54:19.950253377Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-17T07:54:20.078412097Z INFO: Collecting Insights Archives from insights-operator-5844b856db-fwkfn
2026-09-17T07:54:20.078460117Z insights-runtime-extractor-lzhlj
2026-09-17T07:54:20.078482725Z insights-runtime-extractor-mxdhz
2026-09-17T07:54:20.078502305Z insights-runtime-extractor-sn2dt
2026-09-17T07:54:20.108450747Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-17T07:54:20.108665849Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-17T07:54:20.348095300Z INFO: Worker host service log collection to complete.
2026-09-17T07:54:20.372590223Z INFO: "metallb-operator" not detected. Skipping.
2026-09-17T07:54:20.375968557Z Wrote inspect data to must-gather.
2026-09-17T07:54:20.447496922Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-17T07:54:20.447574835Z INFO: on-disk MachineConfig config collection complete.
2026-09-17T07:54:20.464073147Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-17T07:54:20.485501201Z Wrote inspect data to must-gather.
2026-09-17T07:54:20.650891216Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-17T07:54:21.034313667Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-17T07:54:21.034313667Z See 'oc rsync -h' for help and examples
2026-09-17T07:54:21.052214599Z ERROR: No running kube-apiserver pods found
2026-09-17T07:54:21.056222756Z Wrote inspect data to must-gather.
2026-09-17T07:54:21.141430700Z Wrote inspect data to must-gather.
2026-09-17T07:54:21.157080153Z INFO: 'previous-logs' folder not found on ip-10-0-131-105.ec2.internal, skipping...
2026-09-17T07:54:21.222668592Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T07:54:21.244653717Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-17T07:54:21.322466947Z Wrote inspect data to must-gather.
2026-09-17T07:54:21.410921928Z No resources found
2026-09-17T07:54:21.418505945Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-17T07:54:21.420830466Z Wrote inspect data to must-gather.
2026-09-17T07:54:21.458539356Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-17T07:54:21.535854293Z Wrote inspect data to must-gather.
2026-09-17T07:54:21.580112364Z tar: Removing leading `/' from member names
2026-09-17T07:54:21.586062541Z INFO: HAProxy config collection complete.
2026-09-17T07:54:21.613755881Z INFO: 'previous-logs' folder not found on ip-10-0-132-17.ec2.internal, skipping...
2026-09-17T07:54:21.700748430Z Wrote inspect data to must-gather.
2026-09-17T07:54:21.721470435Z error: the server doesn't have a resource type "machineconfigs"
2026-09-17T07:54:21.805476749Z Gathering data for ns/openshift-monitoring...
2026-09-17T07:54:21.910499399Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-17T07:54:21.923179973Z INFO: 'previous-logs' folder not found on ip-10-0-141-215.ec2.internal, skipping...
2026-09-17T07:54:21.923219633Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-17T07:54:21.923255693Z INFO: Machine Config Daemon termination log collection complete.
2026-09-17T07:54:21.925549936Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-17T07:54:21.936545463Z INFO: Getting rules from prometheus-k8s-0
2026-09-17T07:54:21.996847374Z Wrote inspect data to must-gather.
2026-09-17T07:54:22.141970334Z Wrote inspect data to must-gather.
2026-09-17T07:54:22.240888194Z Wrote inspect data to must-gather.
2026-09-17T07:54:22.301715958Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-17T07:54:22.369108326Z INFO: Getting status/config from prometheus-k8s-0
2026-09-17T07:54:22.502117040Z Wrote inspect data to must-gather.
2026-09-17T07:54:22.548209613Z INFO: INTERCONNECT MODE
2026-09-17T07:54:22.548234224Z INFO: Gathering ovn-kubernetes DBs
2026-09-17T07:54:22.685567845Z Wrote inspect data to must-gather.
2026-09-17T07:54:22.705379188Z INFO: Gathering OVN_Northbound from ovnkube-node-2frz9...
2026-09-17T07:54:22.705615124Z INFO: Gathering OVN_Northbound from ovnkube-node-68n7z...
2026-09-17T07:54:22.705855560Z INFO: Gathering OVN_Northbound from ovnkube-node-q6kw9...
2026-09-17T07:54:22.706144888Z INFO: Gathering OVN_Southbound from ovnkube-node-2frz9...
2026-09-17T07:54:22.706379499Z INFO: Gathering OVN_Southbound from ovnkube-node-68n7z...
2026-09-17T07:54:22.706657745Z INFO: Gathering OVN_Southbound from ovnkube-node-q6kw9...
2026-09-17T07:54:22.797141254Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-17T07:54:22.861454945Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-17T07:54:23.042603113Z Wrote inspect data to must-gather.
2026-09-17T07:54:23.080912158Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:54:23.114538421Z tar: Removing leading `/' from member names
2026-09-17T07:54:23.125989863Z tar: Removing leading `/' from member names
2026-09-17T07:54:23.126094596Z tar: Removing leading `/' from member names
2026-09-17T07:54:23.149210470Z tar: Removing leading `/' from member names
2026-09-17T07:54:23.164480198Z tar: Removing leading `/' from member names
2026-09-17T07:54:23.217536717Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-17T07:54:23.267375927Z Wrote inspect data to must-gather.
2026-09-17T07:54:23.348159992Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:54:23.351459396Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-17T07:54:23.468963172Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-17T07:54:23.487749433Z Wrote inspect data to must-gather.
2026-09-17T07:54:23.493408840Z INFO: Waiting for network log collection to complete ...
2026-09-17T07:54:23.493437679Z INFO: Waiting for ovnk database copies to complete ...
2026-09-17T07:54:23.551130909Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:54:23.671731565Z Wrote inspect data to must-gather.
2026-09-17T07:54:23.719281530Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-17T07:54:23.738708193Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:54:23.741179026Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-17T07:54:23.864917338Z Wrote inspect data to must-gather.
2026-09-17T07:54:23.927220538Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:54:24.125985673Z tar: Removing leading `/' from member names
2026-09-17T07:54:24.135259534Z INFO: Copying ovnk databases complete.
2026-09-17T07:54:24.135426374Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-17T07:54:24.137336147Z 3.7M	must-gather/network_logs/ovnk_database_store
2026-09-17T07:54:24.137475410Z INFO: Fallback to identify the container image from release info
2026-09-17T07:54:24.140841787Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:54:24.142413034Z ovnk_database_store/
2026-09-17T07:54:24.142457737Z ovnk_database_store/ovnkube-node-q6kw9_sbdb
2026-09-17T07:54:24.145114123Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-17T07:54:24.167009480Z ovnk_database_store/ovnkube-node-68n7z_sbdb
2026-09-17T07:54:24.178030897Z INFO: Getting status from alertmanager-main-0
2026-09-17T07:54:24.195128853Z ovnk_database_store/ovnkube-node-68n7z_nbdb
2026-09-17T07:54:24.206123626Z ovnk_database_store/ovnkube-node-q6kw9_nbdb
2026-09-17T07:54:24.211434128Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T07:54:24.215785532Z ovnk_database_store/ovnkube-node-2frz9_sbdb
2026-09-17T07:54:24.240631338Z ovnk_database_store/ovnkube-node-2frz9_nbdb
2026-09-17T07:54:24.251701850Z INFO: Network log collection complete.
2026-09-17T07:54:24.358765475Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:54:24.537456311Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:54:24.539969450Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-17T07:54:24.684037776Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:667babb345aeb39d2681913fd91a5c163d48d4ab8a3ba0d3156502181ea1177a
2026-09-17T07:54:24.706300976Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:54:24.799431587Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T07:54:24.811527458Z daemonset.apps/perf-node-gather-daemonset created
2026-09-17T07:54:24.921635544Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:54:24.951490176Z Waiting for performance profile collector pods to become ready: 1
2026-09-17T07:54:25.023981510Z Gathering data for ns/openshift-network-console...
2026-09-17T07:54:25.497872978Z Gathering data for ns/openshift-console-operator...
2026-09-17T07:54:25.570783429Z Done executing Istio gather script
2026-09-17T07:54:25.874628400Z Gathering data for ns/openshift-console...
2026-09-17T07:54:26.072107978Z Waiting for performance profile collector pods to become ready: 2
2026-09-17T07:54:26.411324306Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-17T07:54:26.469964508Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-17T07:54:26.921632773Z Gathering data for ns/openshift-dns-operator...
2026-09-17T07:54:27.196376025Z Waiting for performance profile collector pods to become ready: 3
2026-09-17T07:54:27.209525554Z Gathering data for ns/openshift-dns...
2026-09-17T07:54:28.158477658Z Gathering data for ns/openshift-image-registry...
2026-09-17T07:54:28.310023153Z Waiting for performance profile collector pods to become ready: 4
2026-09-17T07:54:28.658329676Z Gathering data for ns/openshift-ingress-operator...
2026-09-17T07:54:29.023439188Z Gathering data for ns/openshift-ingress...
2026-09-17T07:54:29.397260971Z Gathering data for ns/openshift-ingress-canary...
2026-09-17T07:54:29.426084687Z Waiting for performance profile collector pods to become ready: 5
2026-09-17T07:54:29.779503496Z Gathering data for ns/openshift-insights...
2026-09-17T07:54:30.533148645Z Waiting for performance profile collector pods to become ready: 6
2026-09-17T07:54:31.475215376Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-17T07:54:31.637359233Z Waiting for performance profile collector pods to become ready: 7
2026-09-17T07:54:31.790797461Z Gathering data for ns/openshift-config...
2026-09-17T07:54:32.099516127Z Gathering data for ns/openshift-config-managed...
2026-09-17T07:54:32.604917762Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-17T07:54:32.747887713Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-17T07:54:32.896129975Z Gathering data for ns/openshift-kube-apiserver...
2026-09-17T07:54:33.004363229Z Collecting performance related data for node ip-10-0-131-105.ec2.internal
2026-09-17T07:54:33.012150832Z Collecting performance related data for node ip-10-0-141-215.ec2.internal
2026-09-17T07:54:33.019567343Z Collecting performance related data for node ip-10-0-132-17.ec2.internal
2026-09-17T07:54:33.202023642Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-17T07:54:33.530023775Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-17T07:54:33.903212049Z Gathering data for ns/openshift-kube-scheduler...
2026-09-17T07:54:34.388332446Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-17T07:54:34.717945803Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-17T07:54:35.047186263Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-17T07:54:35.373006547Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-17T07:54:35.960415372Z Gathering data for ns/openshift-multus...
2026-09-17T07:54:36.480575167Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-17T07:54:37.496520895Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-17T07:54:39.011500272Z Gathering data for ns/openshift-host-network...
2026-09-17T07:54:39.306450299Z Gathering data for ns/openshift-network-diagnostics...
2026-09-17T07:54:39.832142463Z Gathering data for ns/openshift-network-node-identity...
2026-09-17T07:54:40.265084686Z Gathering data for ns/openshift-network-operator...
2026-09-17T07:54:40.791343239Z Collecting kubelet logs for node ip-10-0-131-105.ec2.internal
2026-09-17T07:54:40.793273017Z Collecting kubelet logs for node ip-10-0-141-215.ec2.internal
2026-09-17T07:54:40.795383326Z Collecting kubelet logs for node ip-10-0-132-17.ec2.internal
2026-09-17T07:54:40.879347078Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-17T07:54:41.157958926Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-xsbln namespace
2026-09-17T07:54:41.164165076Z INFO: Node performance data collection complete.
2026-09-17T07:54:41.187010405Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-17T07:54:41.485421822Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-17T07:54:41.695804090Z Gathering data for ns/openshift-apiserver-operator...
2026-09-17T07:54:41.987014588Z Gathering data for ns/openshift-apiserver...
2026-09-17T07:54:42.372975454Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-17T07:54:42.657523518Z Gathering data for ns/openshift-controller-manager...
2026-09-17T07:54:43.003075042Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-17T07:54:43.773899812Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-17T07:54:44.089375027Z Gathering data for ns/openshift-service-ca-operator...
2026-09-17T07:54:44.451744938Z Gathering data for ns/openshift-service-ca...
2026-09-17T07:54:44.856953388Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-17T07:54:45.830125253Z Wrote inspect data to must-gather.
2026-09-17T07:54:45.830171662Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T07:54:45.830171662Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-17T07:54:45.956037642Z error: the server doesn't have a resource type "clusters"
2026-09-17T07:54:46.081574196Z Caches written to disk