2026-09-17T19:56:01.616468698Z [disk usage checker] Started
2026-09-17T19:56:01.619757295Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-09-17T19:56:01.822944620Z Gathering data for ns/openshift-cluster-version...
2026-09-17T19:56:01.967260175Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T19:56:02.066958226Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T19:56:02.152122860Z Gathering data for ns/default...
2026-09-17T19:56:02.485172817Z Gathering data for ns/openshift...
2026-09-17T19:56:02.961776402Z Gathering data for ns/kube-system...
2026-09-17T19:56:03.691615983Z Gathering data for ns/openshift-etcd...
2026-09-17T19:56:04.058819908Z Wrote inspect data to must-gather.
2026-09-17T19:56:04.058853600Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T19:56:04.058853600Z     namespaces "assisted-installer" not found
2026-09-17T19:56:04.499400922Z Waiting on subprocesses to finish execution.
2026-09-17T19:56:04.505602889Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-17T19:56:04.506244710Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-17T19:56:04.511661637Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-17T19:56:04.514998884Z INFO: Gathering HAProxy config files
2026-09-17T19:56:04.528699868Z INFO: Collecting host service logs for crio
2026-09-17T19:56:04.528995551Z INFO: Collecting host service logs for kubelet
2026-09-17T19:56:04.529315449Z INFO: Collecting host service logs for rpm-ostreed
2026-09-17T19:56:04.529640957Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-17T19:56:04.529959612Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-17T19:56:04.530267164Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-17T19:56:04.530601660Z INFO: Collecting host service logs for NetworkManager
2026-09-17T19:56:04.530914169Z INFO: Collecting host service logs for openvswitch
2026-09-17T19:56:04.531302719Z INFO: Collecting host service logs for ovs-configuration
2026-09-17T19:56:04.531672239Z INFO: Collecting host service logs for ovsdb-server
2026-09-17T19:56:04.531986186Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-17T19:56:04.532352349Z INFO: Waiting for worker host service log collection to complete ...
2026-09-17T19:56:04.535777889Z Executing Istio gather script
2026-09-17T19:56:04.554896373Z INFO: Waiting for node performance related collection to complete ...
2026-09-17T19:56:05.448337540Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-17T19:56:05.662566554Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-17T19:56:05.674167038Z No resources found in openshift-etcd namespace.
2026-09-17T19:56:05.715623402Z INFO: Collecting Insights Archives from insights-operator-6f9c644dd9-mml6g
2026-09-17T19:56:05.715726580Z insights-runtime-extractor-6lp9m
2026-09-17T19:56:05.715757060Z insights-runtime-extractor-hlh59
2026-09-17T19:56:05.715786146Z insights-runtime-extractor-x4c96
2026-09-17T19:56:05.761061979Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-17T19:56:05.761160653Z INFO: on-disk MachineConfig config collection complete.
2026-09-17T19:56:05.879364055Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-17T19:56:05.908936843Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-17T19:56:05.958894090Z INFO: "metallb-operator" not detected. Skipping.
2026-09-17T19:56:05.967455726Z error: the server doesn't have a resource type "performanceprofile"
2026-09-17T19:56:06.009467057Z Wrote inspect data to must-gather.
2026-09-17T19:56:06.068485801Z INFO: Worker host service log collection to complete.
2026-09-17T19:56:06.071790533Z No resources found
2026-09-17T19:56:06.082363561Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-17T19:56:06.174542339Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-17T19:56:06.174542339Z See 'oc rsync -h' for help and examples
2026-09-17T19:56:06.313554260Z Wrote inspect data to must-gather.
2026-09-17T19:56:06.374841400Z ERROR: No running kube-apiserver pods found
2026-09-17T19:56:06.475510424Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-17T19:56:06.489722574Z INFO: 'previous-logs' folder not found on ip-10-0-128-177.ec2.internal, skipping...
2026-09-17T19:56:06.496616284Z Wrote inspect data to must-gather.
2026-09-17T19:56:06.661078779Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-09-17T19:56:06.895319613Z Gathering data for ns/openshift-monitoring...
2026-09-17T19:56:07.002017453Z No resources found
2026-09-17T19:56:07.165115882Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T19:56:07.247676430Z error: the server doesn't have a resource type "machineconfigs"
2026-09-17T19:56:07.253673154Z tar: Removing leading `/' from member names
2026-09-17T19:56:07.259792189Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-17T19:56:07.276316809Z INFO: HAProxy config collection complete.
2026-09-17T19:56:07.285007175Z Wrote inspect data to must-gather.
2026-09-17T19:56:07.287010622Z Wrote inspect data to must-gather.
2026-09-17T19:56:07.393622904Z Wrote inspect data to must-gather.
2026-09-17T19:56:07.427014066Z Wrote inspect data to must-gather.
2026-09-17T19:56:07.436960069Z INFO: Getting rules from prometheus-k8s-0
2026-09-17T19:56:07.548309395Z INFO: 'previous-logs' folder not found on ip-10-0-135-16.ec2.internal, skipping...
2026-09-17T19:56:07.549646399Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-17T19:56:07.691997340Z Wrote inspect data to must-gather.
2026-09-17T19:56:07.842994936Z Wrote inspect data to must-gather.
2026-09-17T19:56:07.879372240Z INFO: 'previous-logs' folder not found on ip-10-0-143-217.ec2.internal, skipping...
2026-09-17T19:56:07.879408553Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-17T19:56:07.879454471Z INFO: Machine Config Daemon termination log collection complete.
2026-09-17T19:56:07.928796476Z INFO: Getting status/config from prometheus-k8s-0
2026-09-17T19:56:08.010260417Z Wrote inspect data to must-gather.
2026-09-17T19:56:08.046322065Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-17T19:56:08.306228620Z Wrote inspect data to must-gather.
2026-09-17T19:56:08.320872648Z Wrote inspect data to must-gather.
2026-09-17T19:56:08.367189846Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-17T19:56:08.375065967Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-17T19:56:08.581384891Z Wrote inspect data to must-gather.
2026-09-17T19:56:08.632892632Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-17T19:56:08.671249626Z INFO: INTERCONNECT MODE
2026-09-17T19:56:08.671249626Z INFO: Gathering ovn-kubernetes DBs
2026-09-17T19:56:08.705566225Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T19:56:08.838717128Z Wrote inspect data to must-gather.
2026-09-17T19:56:08.857707338Z INFO: Gathering OVN_Northbound from ovnkube-node-9lk9z...
2026-09-17T19:56:08.857904764Z INFO: Gathering OVN_Northbound from ovnkube-node-jt5kn...
2026-09-17T19:56:08.858124798Z INFO: Gathering OVN_Northbound from ovnkube-node-m5854...
2026-09-17T19:56:08.858496802Z INFO: Gathering OVN_Southbound from ovnkube-node-9lk9z...
2026-09-17T19:56:08.858799744Z INFO: Gathering OVN_Southbound from ovnkube-node-jt5kn...
2026-09-17T19:56:08.859097264Z INFO: Gathering OVN_Southbound from ovnkube-node-m5854...
2026-09-17T19:56:08.913484204Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-17T19:56:09.200504407Z tar: Removing leading `/' from member names
2026-09-17T19:56:09.211714619Z tar: Removing leading `/' from member names
2026-09-17T19:56:09.238552518Z Wrote inspect data to must-gather.
2026-09-17T19:56:09.243293261Z tar: Removing leading `/' from member names
2026-09-17T19:56:09.247506291Z tar: Removing leading `/' from member names
2026-09-17T19:56:09.256763699Z tar: Removing leading `/' from member names
2026-09-17T19:56:09.297173613Z tar: Removing leading `/' from member names
2026-09-17T19:56:09.330170042Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-17T19:56:09.504364219Z W0917 19:56:09.504310    1385 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-09-17T19:56:09.510027086Z Wrote inspect data to must-gather.
2026-09-17T19:56:09.547959229Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T19:56:09.598146273Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-17T19:56:09.791961086Z Gathering data for ns/openshift-network-console...
2026-09-17T19:56:09.806392939Z INFO: Getting status from alertmanager-main-0
2026-09-17T19:56:09.850396025Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:56:09.855955945Z INFO: Waiting for network log collection to complete ...
2026-09-17T19:56:09.856029577Z INFO: Waiting for ovnk database copies to complete ...
2026-09-17T19:56:09.856404044Z INFO: Copying ovnk databases complete.
2026-09-17T19:56:09.859997095Z 3.9M	must-gather/network_logs/ovnk_database_store
2026-09-17T19:56:09.862866912Z ovnk_database_store/
2026-09-17T19:56:09.862866912Z ovnk_database_store/ovnkube-node-m5854_nbdb
2026-09-17T19:56:09.874431303Z ovnk_database_store/ovnkube-node-m5854_sbdb
2026-09-17T19:56:09.894567506Z Wrote inspect data to must-gather.
2026-09-17T19:56:09.901173783Z ovnk_database_store/ovnkube-node-9lk9z_sbdb
2026-09-17T19:56:09.932321607Z ovnk_database_store/ovnkube-node-jt5kn_nbdb
2026-09-17T19:56:09.943260001Z ovnk_database_store/ovnkube-node-jt5kn_sbdb
2026-09-17T19:56:09.967736178Z ovnk_database_store/ovnkube-node-9lk9z_nbdb
2026-09-17T19:56:09.980685866Z INFO: Network log collection complete.
2026-09-17T19:56:10.102549967Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:56:10.105622480Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-17T19:56:10.230350633Z Wrote inspect data to must-gather.
2026-09-17T19:56:10.327163720Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:56:10.344554355Z Gathering data for ns/openshift-console-operator...
2026-09-17T19:56:10.514372492Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-17T19:56:10.517354247Z INFO: Fallback to identify the container image from release info
2026-09-17T19:56:10.552759682Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:56:10.555390585Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-17T19:56:10.774297464Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:56:10.807159166Z Gathering data for ns/openshift-console...
2026-09-17T19:56:10.984421913Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:56:10.986797409Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-17T19:56:11.208216205Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:56:11.402329336Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-17T19:56:11.418247621Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:56:11.420389723Z Inspecting resource crd/inferencepools.inference.networking.k8s.io
2026-09-17T19:56:11.573336774Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea
2026-09-17T19:56:11.615252184Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:56:11.678505105Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-09-17T19:56:11.719105041Z daemonset.apps/perf-node-gather-daemonset created
2026-09-17T19:56:11.854397736Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:56:11.858335449Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io
2026-09-17T19:56:11.887456794Z Waiting for performance profile collector pods to become ready: 1
2026-09-17T19:56:12.037979850Z Gathering data for ns/openshift-dns-operator...
2026-09-17T19:56:12.053020618Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:56:12.273055887Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:56:12.276348934Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-17T19:56:12.378505652Z Gathering data for ns/openshift-dns...
2026-09-17T19:56:12.451935661Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:56:12.634224349Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:56:13.035389830Z Waiting for performance profile collector pods to become ready: 2
2026-09-17T19:56:13.075089397Z Gathering data for ns/openshift-image-registry...
2026-09-17T19:56:13.365166455Z Done executing Istio gather script
2026-09-17T19:56:13.593130444Z Gathering data for ns/openshift-ingress-operator...
2026-09-17T19:56:13.965840535Z Gathering data for ns/openshift-ingress...
2026-09-17T19:56:14.155953205Z Waiting for performance profile collector pods to become ready: 3
2026-09-17T19:56:14.320018373Z Gathering data for ns/openshift-ingress-canary...
2026-09-17T19:56:14.773983666Z Gathering data for ns/openshift-insights...
2026-09-17T19:56:15.290488583Z Waiting for performance profile collector pods to become ready: 4
2026-09-17T19:56:16.420996353Z Waiting for performance profile collector pods to become ready: 5
2026-09-17T19:56:16.683401482Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-09-17T19:56:17.327105341Z Gathering data for ns/kserve...
2026-09-17T19:56:17.551077101Z Waiting for performance profile collector pods to become ready: 6
2026-09-17T19:56:18.674209199Z Waiting for performance profile collector pods to become ready: 7
2026-09-17T19:56:18.973966315Z Gathering data for ns/openshift-config...
2026-09-17T19:56:19.302005716Z Gathering data for ns/openshift-config-managed...
2026-09-17T19:56:19.761194374Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-17T19:56:19.812291763Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-17T19:56:20.088852249Z Collecting performance related data for node ip-10-0-135-16.ec2.internal
2026-09-17T19:56:20.095977760Z Collecting performance related data for node ip-10-0-143-217.ec2.internal
2026-09-17T19:56:20.104464818Z Collecting performance related data for node ip-10-0-128-177.ec2.internal
2026-09-17T19:56:20.130847123Z Gathering data for ns/openshift-kube-apiserver...
2026-09-17T19:56:20.473894329Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-17T19:56:20.874235382Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-17T19:56:21.316098718Z Gathering data for ns/openshift-kube-scheduler...
2026-09-17T19:56:21.685796844Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-17T19:56:21.691294128Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-09-17T19:56:22.075696516Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-17T19:56:22.429550342Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-17T19:56:22.799771638Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-17T19:56:23.462365348Z Gathering data for ns/openshift-multus...
2026-09-17T19:56:24.926792287Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-17T19:56:26.191638019Z Gathering data for ns/openshift-host-network...
2026-09-17T19:56:26.518415360Z Gathering data for ns/openshift-network-diagnostics...
2026-09-17T19:56:26.697732386Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-09-17T19:56:27.136868104Z Gathering data for ns/openshift-network-node-identity...
2026-09-17T19:56:27.608401939Z Gathering data for ns/openshift-network-operator...
2026-09-17T19:56:28.078164965Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-17T19:56:28.374805565Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-17T19:56:28.722009187Z Collecting kubelet logs for node ip-10-0-135-16.ec2.internal
2026-09-17T19:56:28.723898977Z Collecting kubelet logs for node ip-10-0-143-217.ec2.internal
2026-09-17T19:56:28.726676679Z Collecting kubelet logs for node ip-10-0-128-177.ec2.internal
2026-09-17T19:56:28.931295880Z Gathering data for ns/openshift-apiserver-operator...
2026-09-17T19:56:29.135850918Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-9dgbs namespace
2026-09-17T19:56:29.140688960Z INFO: Node performance data collection complete.
2026-09-17T19:56:29.312268052Z Gathering data for ns/openshift-apiserver...
2026-09-17T19:56:29.755000683Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-17T19:56:30.049156499Z Gathering data for ns/openshift-controller-manager...
2026-09-17T19:56:30.369250581Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-17T19:56:31.067080753Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-17T19:56:31.378341507Z Gathering data for ns/openshift-service-ca-operator...
2026-09-17T19:56:31.703128266Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-09-17T19:56:31.729468275Z Gathering data for ns/openshift-service-ca...
2026-09-17T19:56:32.103655241Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-17T19:56:33.031614019Z Wrote inspect data to must-gather.
2026-09-17T19:56:33.031670531Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T19:56:33.031670531Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-17T19:56:33.167546752Z error: the server doesn't have a resource type "clusters"
2026-09-17T19:56:33.457003064Z Caches written to disk