2026-09-17T18:29:43.365064086Z [disk usage checker] Started
2026-09-17T18:29:43.368497756Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-17T18:29:43.564398605Z Gathering data for ns/openshift-cluster-version...
2026-09-17T18:29:43.707551544Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T18:29:43.806753661Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T18:29:43.892272779Z Gathering data for ns/default...
2026-09-17T18:29:44.187315562Z Gathering data for ns/openshift...
2026-09-17T18:29:44.595623885Z Gathering data for ns/kube-system...
2026-09-17T18:29:45.275244713Z Gathering data for ns/openshift-etcd...
2026-09-17T18:29:45.608805838Z Wrote inspect data to must-gather.
2026-09-17T18:29:45.608836750Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T18:29:45.608836750Z     namespaces "assisted-installer" not found
2026-09-17T18:29:46.134305994Z Waiting on subprocesses to finish execution.
2026-09-17T18:29:46.140352960Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-17T18:29:46.143908676Z INFO: Gathering HAProxy config files
2026-09-17T18:29:46.145372002Z INFO: Collecting host service logs for crio
2026-09-17T18:29:46.145712200Z INFO: Collecting host service logs for kubelet
2026-09-17T18:29:46.146076875Z INFO: Collecting host service logs for rpm-ostreed
2026-09-17T18:29:46.146401514Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-17T18:29:46.146703692Z Executing Istio gather script
2026-09-17T18:29:46.146833286Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-17T18:29:46.147160972Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-17T18:29:46.147498410Z INFO: Collecting host service logs for NetworkManager
2026-09-17T18:29:46.147907912Z INFO: Collecting host service logs for openvswitch
2026-09-17T18:29:46.148258562Z INFO: Collecting host service logs for ovs-configuration
2026-09-17T18:29:46.148612022Z INFO: Collecting host service logs for ovsdb-server
2026-09-17T18:29:46.148960271Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-17T18:29:46.149380842Z INFO: Waiting for worker host service log collection to complete ...
2026-09-17T18:29:46.155457869Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-17T18:29:46.166076123Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-17T18:29:46.190249149Z INFO: Waiting for node performance related collection to complete ...
2026-09-17T18:29:46.610171965Z No resources found in openshift-etcd namespace.
2026-09-17T18:29:46.673067770Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-17T18:29:46.864751743Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-17T18:29:47.233167795Z INFO: Collecting Insights Archives from insights-operator-6f9c644dd9-kbpfw
2026-09-17T18:29:47.233167795Z insights-runtime-extractor-4bpm9
2026-09-17T18:29:47.233167795Z insights-runtime-extractor-tzrvf
2026-09-17T18:29:47.233167795Z insights-runtime-extractor-zrbjn
2026-09-17T18:29:47.309412681Z error: the server doesn't have a resource type "performanceprofile"
2026-09-17T18:29:47.335898387Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-17T18:29:47.584137854Z No resources found
2026-09-17T18:29:47.593992337Z INFO: "metallb-operator" not detected. Skipping.
2026-09-17T18:29:47.619799508Z ERROR: No running kube-apiserver pods found
2026-09-17T18:29:47.669405100Z Wrote inspect data to must-gather.
2026-09-17T18:29:47.802273000Z Wrote inspect data to must-gather.
2026-09-17T18:29:47.832651270Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-17T18:29:47.871480820Z INFO: Worker host service log collection to complete.
2026-09-17T18:29:47.915287956Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-17T18:29:48.001824230Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-17T18:29:48.030156487Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-17T18:29:48.030235217Z INFO: on-disk MachineConfig config collection complete.
2026-09-17T18:29:48.104161323Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-17T18:29:48.104161323Z See 'oc rsync -h' for help and examples
2026-09-17T18:29:48.122358502Z Wrote inspect data to must-gather.
2026-09-17T18:29:48.223461526Z INFO: 'previous-logs' folder not found on ip-10-0-131-182.ec2.internal, skipping...
2026-09-17T18:29:48.495973148Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-17T18:29:48.655309156Z Wrote inspect data to must-gather.
2026-09-17T18:29:48.806941848Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T18:29:48.899799457Z tar: Removing leading `/' from member names
2026-09-17T18:29:48.902992586Z Gathering data for ns/openshift-monitoring...
2026-09-17T18:29:48.907395527Z INFO: HAProxy config collection complete.
2026-09-17T18:29:49.014631759Z error: the server doesn't have a resource type "machineconfigs"
2026-09-17T18:29:49.017516582Z No resources found
2026-09-17T18:29:49.073501041Z Wrote inspect data to must-gather.
2026-09-17T18:29:49.080699887Z Wrote inspect data to must-gather.
2026-09-17T18:29:49.111363106Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-17T18:29:49.143611076Z Wrote inspect data to must-gather.
2026-09-17T18:29:49.154578115Z INFO: Getting rules from prometheus-k8s-0
2026-09-17T18:29:49.290126362Z INFO: 'previous-logs' folder not found on ip-10-0-135-40.ec2.internal, skipping...
2026-09-17T18:29:49.298217524Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-17T18:29:49.377235246Z Wrote inspect data to must-gather.
2026-09-17T18:29:49.565813516Z Wrote inspect data to must-gather.
2026-09-17T18:29:49.604773193Z INFO: 'previous-logs' folder not found on ip-10-0-139-237.ec2.internal, skipping...
2026-09-17T18:29:49.604808339Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-17T18:29:49.604839815Z INFO: Machine Config Daemon termination log collection complete.
2026-09-17T18:29:49.654005885Z INFO: Getting status/config from prometheus-k8s-0
2026-09-17T18:29:49.693211932Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-17T18:29:49.702126891Z Wrote inspect data to must-gather.
2026-09-17T18:29:49.770302813Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-17T18:29:49.963173276Z Wrote inspect data to must-gather.
2026-09-17T18:29:50.018411177Z Wrote inspect data to must-gather.
2026-09-17T18:29:50.114947915Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-17T18:29:50.268448251Z Wrote inspect data to must-gather.
2026-09-17T18:29:50.304254005Z INFO: INTERCONNECT MODE
2026-09-17T18:29:50.304367605Z INFO: Gathering ovn-kubernetes DBs
2026-09-17T18:29:50.381767974Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-17T18:29:50.471775816Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T18:29:50.516909554Z INFO: Gathering OVN_Northbound from ovnkube-node-6bfng...
2026-09-17T18:29:50.517149929Z INFO: Gathering OVN_Northbound from ovnkube-node-fzxzd...
2026-09-17T18:29:50.517376896Z INFO: Gathering OVN_Northbound from ovnkube-node-vwtvz...
2026-09-17T18:29:50.517691666Z INFO: Gathering OVN_Southbound from ovnkube-node-6bfng...
2026-09-17T18:29:50.517961318Z INFO: Gathering OVN_Southbound from ovnkube-node-fzxzd...
2026-09-17T18:29:50.518211433Z INFO: Gathering OVN_Southbound from ovnkube-node-vwtvz...
2026-09-17T18:29:50.520821944Z Wrote inspect data to must-gather.
2026-09-17T18:29:50.690491670Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-17T18:29:50.781939594Z tar: Removing leading `/' from member names
2026-09-17T18:29:50.827291207Z tar: Removing leading `/' from member names
2026-09-17T18:29:50.913207223Z tar: Removing leading `/' from member names
2026-09-17T18:29:50.923444372Z tar: Removing leading `/' from member names
2026-09-17T18:29:50.942715007Z tar: Removing leading `/' from member names
2026-09-17T18:29:50.946281218Z tar: Removing leading `/' from member names
2026-09-17T18:29:50.997590203Z Wrote inspect data to must-gather.
2026-09-17T18:29:51.085993654Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-17T18:29:51.151997338Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-17T18:29:51.284586236Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T18:29:51.384285031Z Wrote inspect data to must-gather.
2026-09-17T18:29:51.389052889Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:29:51.542124593Z Gathering data for ns/openshift-network-console...
2026-09-17T18:29:51.543668690Z INFO: Waiting for network log collection to complete ...
2026-09-17T18:29:51.543778577Z INFO: Waiting for ovnk database copies to complete ...
2026-09-17T18:29:51.544296020Z INFO: Copying ovnk databases complete.
2026-09-17T18:29:51.546733326Z 3.9M	must-gather/network_logs/ovnk_database_store
2026-09-17T18:29:51.548901865Z ovnk_database_store/
2026-09-17T18:29:51.548955314Z ovnk_database_store/ovnkube-node-6bfng_sbdb
2026-09-17T18:29:51.574737579Z ovnk_database_store/ovnkube-node-fzxzd_nbdb
2026-09-17T18:29:51.586270227Z ovnk_database_store/ovnkube-node-fzxzd_sbdb
2026-09-17T18:29:51.593236763Z INFO: Getting status from alertmanager-main-0
2026-09-17T18:29:51.613228441Z ovnk_database_store/ovnkube-node-vwtvz_sbdb
2026-09-17T18:29:51.643560854Z ovnk_database_store/ovnkube-node-vwtvz_nbdb
2026-09-17T18:29:51.654619347Z ovnk_database_store/ovnkube-node-6bfng_nbdb
2026-09-17T18:29:51.660376112Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:29:51.662627963Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-17T18:29:51.667382113Z INFO: Network log collection complete.
2026-09-17T18:29:51.743593072Z Wrote inspect data to must-gather.
2026-09-17T18:29:51.887958298Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:29:52.058516796Z Wrote inspect data to must-gather.
2026-09-17T18:29:52.060714714Z Gathering data for ns/openshift-console-operator...
2026-09-17T18:29:52.104864984Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:29:52.108601726Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-17T18:29:52.317409761Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:29:52.345268201Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-17T18:29:52.348901327Z INFO: Fallback to identify the container image from release info
2026-09-17T18:29:52.497194146Z Gathering data for ns/openshift-console...
2026-09-17T18:29:52.537572908Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:29:52.539756574Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-17T18:29:52.762369979Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:29:52.973019179Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:29:52.976215642Z Inspecting resource crd/inferencepools.inference.networking.k8s.io
2026-09-17T18:29:53.015153115Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea
2026-09-17T18:29:53.058225529Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-17T18:29:53.169483172Z daemonset.apps/perf-node-gather-daemonset created
2026-09-17T18:29:53.185522427Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:29:53.299406200Z Waiting for performance profile collector pods to become ready: 1
2026-09-17T18:29:53.392784058Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:29:53.395363717Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io
2026-09-17T18:29:53.535133915Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-17T18:29:53.593784368Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:29:53.650832468Z Gathering data for ns/openshift-dns-operator...
2026-09-17T18:29:53.806916450Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:29:53.809101682Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-17T18:29:53.999594436Z Gathering data for ns/openshift-dns...
2026-09-17T18:29:54.003971644Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:29:54.179996994Z Wrote inspect data to /must-gather/istio.
2026-09-17T18:29:54.420630794Z Waiting for performance profile collector pods to become ready: 2
2026-09-17T18:29:54.648635479Z Gathering data for ns/openshift-image-registry...
2026-09-17T18:29:54.897452480Z Done executing Istio gather script
2026-09-17T18:29:55.122176806Z Gathering data for ns/openshift-ingress-operator...
2026-09-17T18:29:55.444214734Z Gathering data for ns/openshift-ingress...
2026-09-17T18:29:55.555753069Z Waiting for performance profile collector pods to become ready: 3
2026-09-17T18:29:55.782176563Z Gathering data for ns/openshift-ingress-canary...
2026-09-17T18:29:56.218344654Z Gathering data for ns/openshift-insights...
2026-09-17T18:29:56.679417493Z Waiting for performance profile collector pods to become ready: 4
2026-09-17T18:29:57.795508410Z Waiting for performance profile collector pods to become ready: 5
2026-09-17T18:29:58.539604173Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-17T18:29:58.573071704Z Gathering data for ns/kserve...
2026-09-17T18:29:58.911850268Z Waiting for performance profile collector pods to become ready: 6
2026-09-17T18:30:00.035280881Z Waiting for performance profile collector pods to become ready: 7
2026-09-17T18:30:00.239834582Z Gathering data for ns/openshift-config...
2026-09-17T18:30:00.523152126Z Gathering data for ns/openshift-config-managed...
2026-09-17T18:30:00.932173416Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-17T18:30:01.163340254Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-17T18:30:01.206307768Z Gathering data for ns/openshift-kube-apiserver...
2026-09-17T18:30:01.466188640Z Collecting performance related data for node ip-10-0-131-182.ec2.internal
2026-09-17T18:30:01.474432435Z Collecting performance related data for node ip-10-0-135-40.ec2.internal
2026-09-17T18:30:01.481312424Z Collecting performance related data for node ip-10-0-139-237.ec2.internal
2026-09-17T18:30:01.562323079Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-17T18:30:01.940783332Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-17T18:30:02.341828701Z Gathering data for ns/openshift-kube-scheduler...
2026-09-17T18:30:02.692507185Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-17T18:30:03.100228185Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-17T18:30:03.426694813Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-17T18:30:03.544096259Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-17T18:30:03.770849631Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-17T18:30:04.363525597Z Gathering data for ns/openshift-multus...
2026-09-17T18:30:05.701402803Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-17T18:30:06.967721157Z Gathering data for ns/openshift-host-network...
2026-09-17T18:30:07.297189729Z Gathering data for ns/openshift-network-diagnostics...
2026-09-17T18:30:07.847903221Z Gathering data for ns/openshift-network-node-identity...
2026-09-17T18:30:08.269238268Z Gathering data for ns/openshift-network-operator...
2026-09-17T18:30:08.553769189Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-09-17T18:30:08.686740227Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-17T18:30:08.975747300Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-17T18:30:09.563488293Z Gathering data for ns/openshift-apiserver-operator...
2026-09-17T18:30:09.864215002Z Collecting kubelet logs for node ip-10-0-131-182.ec2.internal
2026-09-17T18:30:09.866400108Z Collecting kubelet logs for node ip-10-0-135-40.ec2.internal
2026-09-17T18:30:09.868557116Z Collecting kubelet logs for node ip-10-0-139-237.ec2.internal
2026-09-17T18:30:09.962745678Z Gathering data for ns/openshift-apiserver...
2026-09-17T18:30:10.283682143Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-f44dh namespace
2026-09-17T18:30:10.289721989Z INFO: Node performance data collection complete.
2026-09-17T18:30:10.433446919Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-17T18:30:10.759672587Z Gathering data for ns/openshift-controller-manager...
2026-09-17T18:30:11.042068574Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-17T18:30:11.690786732Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-17T18:30:11.976979616Z Gathering data for ns/openshift-service-ca-operator...
2026-09-17T18:30:12.325826732Z Gathering data for ns/openshift-service-ca...
2026-09-17T18:30:12.679508117Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-17T18:30:13.522471093Z Wrote inspect data to must-gather.
2026-09-17T18:30:13.522518374Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T18:30:13.522518374Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-17T18:30:13.561696844Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-09-17T18:30:13.652217819Z error: the server doesn't have a resource type "clusters"
2026-09-17T18:30:13.801519735Z Caches written to disk