2026-09-17T22:52:54.229849135Z [disk usage checker] Started
2026-09-17T22:52:54.233241048Z [disk usage checker] Volume usage percentage: current = 25 ; allowed = 70
2026-09-17T22:52:54.453010501Z Gathering data for ns/openshift-cluster-version...
2026-09-17T22:52:54.583996070Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T22:52:54.673385733Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T22:52:54.756473351Z Gathering data for ns/default...
2026-09-17T22:52:55.148359892Z Gathering data for ns/openshift...
2026-09-17T22:52:55.593945502Z Gathering data for ns/kube-system...
2026-09-17T22:52:56.303588372Z Gathering data for ns/openshift-etcd...
2026-09-17T22:52:56.631722749Z Wrote inspect data to must-gather.
2026-09-17T22:52:56.631821282Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T22:52:56.631821282Z     namespaces "assisted-installer" not found
2026-09-17T22:52:57.182692859Z Waiting on subprocesses to finish execution.
2026-09-17T22:52:57.194504742Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-17T22:52:57.197449340Z INFO: Gathering HAProxy config files
2026-09-17T22:52:57.200615211Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-17T22:52:57.203263648Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-17T22:52:57.205391497Z Executing Istio gather script
2026-09-17T22:52:57.234461644Z INFO: Collecting host service logs for crio
2026-09-17T22:52:57.234780141Z INFO: Collecting host service logs for kubelet
2026-09-17T22:52:57.235123346Z INFO: Collecting host service logs for rpm-ostreed
2026-09-17T22:52:57.235457393Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-17T22:52:57.235822159Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-17T22:52:57.236177934Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-17T22:52:57.236528661Z INFO: Collecting host service logs for NetworkManager
2026-09-17T22:52:57.236876837Z INFO: Collecting host service logs for openvswitch
2026-09-17T22:52:57.237226095Z INFO: Collecting host service logs for ovs-configuration
2026-09-17T22:52:57.237640719Z INFO: Collecting host service logs for ovsdb-server
2026-09-17T22:52:57.238155087Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-17T22:52:57.238642948Z INFO: Waiting for worker host service log collection to complete ...
2026-09-17T22:52:57.413526094Z INFO: Waiting for node performance related collection to complete ...
2026-09-17T22:52:57.684249727Z No resources found
2026-09-17T22:52:58.111465124Z No resources found in openshift-etcd namespace.
2026-09-17T22:52:58.456643398Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-17T22:52:58.491244984Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-17T22:52:58.491335601Z INFO: on-disk MachineConfig config collection complete.
2026-09-17T22:52:58.592742868Z INFO: "metallb-operator" not detected. Skipping.
2026-09-17T22:52:58.681359759Z INFO: Collecting Insights Archives from insights-operator-6f9c644dd9-n7g55
2026-09-17T22:52:58.681431180Z insights-runtime-extractor-clbj4
2026-09-17T22:52:58.681453722Z insights-runtime-extractor-l9x89
2026-09-17T22:52:58.681474226Z insights-runtime-extractor-wkfpl
2026-09-17T22:52:58.682787754Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-17T22:52:58.720134543Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-17T22:52:58.735236397Z Wrote inspect data to must-gather.
2026-09-17T22:52:58.770017432Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-17T22:52:59.085346964Z Wrote inspect data to must-gather.
2026-09-17T22:52:59.096096466Z INFO: Worker host service log collection to complete.
2026-09-17T22:52:59.106783538Z error: the server doesn't have a resource type "performanceprofile"
2026-09-17T22:52:59.129529308Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-17T22:52:59.318718469Z [disk usage checker] Volume usage percentage: current = 25 ; allowed = 70
2026-09-17T22:52:59.350090047Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T22:52:59.434093055Z ERROR: No running kube-apiserver pods found
2026-09-17T22:52:59.465231689Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-17T22:52:59.465231689Z See 'oc rsync -h' for help and examples
2026-09-17T22:52:59.591880708Z Wrote inspect data to must-gather.
2026-09-17T22:52:59.612261135Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-17T22:52:59.741857633Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-17T22:52:59.756608501Z No resources found
2026-09-17T22:52:59.798213937Z Wrote inspect data to must-gather.
2026-09-17T22:52:59.831088959Z Wrote inspect data to must-gather.
2026-09-17T22:52:59.877855869Z tar: Removing leading `/' from member names
2026-09-17T22:52:59.883088208Z INFO: HAProxy config collection complete.
2026-09-17T22:52:59.985879758Z INFO: 'previous-logs' folder not found on ip-10-0-136-9.ec2.internal, skipping...
2026-09-17T22:53:00.005344449Z Wrote inspect data to must-gather.
2026-09-17T22:53:00.032821436Z Gathering data for ns/openshift-monitoring...
2026-09-17T22:53:00.055450041Z Wrote inspect data to must-gather.
2026-09-17T22:53:00.198100503Z Wrote inspect data to must-gather.
2026-09-17T22:53:00.276514211Z error: the server doesn't have a resource type "machineconfigs"
2026-09-17T22:53:00.311665682Z INFO: Getting rules from prometheus-k8s-0
2026-09-17T22:53:00.324382117Z INFO: 'previous-logs' folder not found on ip-10-0-138-45.ec2.internal, skipping...
2026-09-17T22:53:00.519085863Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-17T22:53:00.550723020Z Wrote inspect data to must-gather.
2026-09-17T22:53:00.651127358Z INFO: 'previous-logs' folder not found on ip-10-0-139-13.ec2.internal, skipping...
2026-09-17T22:53:00.651256694Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-17T22:53:00.651329560Z INFO: Machine Config Daemon termination log collection complete.
2026-09-17T22:53:00.789325929Z Wrote inspect data to must-gather.
2026-09-17T22:53:00.839001216Z INFO: Getting status/config from prometheus-k8s-0
2026-09-17T22:53:00.862351255Z Wrote inspect data to must-gather.
2026-09-17T22:53:01.002299620Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-17T22:53:01.130036746Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-17T22:53:01.186341452Z INFO: INTERCONNECT MODE
2026-09-17T22:53:01.186386365Z INFO: Gathering ovn-kubernetes DBs
2026-09-17T22:53:01.253528286Z Wrote inspect data to must-gather.
2026-09-17T22:53:01.280063162Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-17T22:53:01.399277191Z INFO: Gathering OVN_Northbound from ovnkube-node-2z48z...
2026-09-17T22:53:01.399651616Z INFO: Gathering OVN_Northbound from ovnkube-node-5pjh7...
2026-09-17T22:53:01.399963486Z INFO: Gathering OVN_Northbound from ovnkube-node-nrkd5...
2026-09-17T22:53:01.400390085Z INFO: Gathering OVN_Southbound from ovnkube-node-2z48z...
2026-09-17T22:53:01.400724904Z INFO: Gathering OVN_Southbound from ovnkube-node-5pjh7...
2026-09-17T22:53:01.401005033Z INFO: Gathering OVN_Southbound from ovnkube-node-nrkd5...
2026-09-17T22:53:01.577924842Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T22:53:01.579738803Z Wrote inspect data to must-gather.
2026-09-17T22:53:01.683947411Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-17T22:53:01.747293572Z tar: Removing leading `/' from member names
2026-09-17T22:53:01.754302882Z tar: Removing leading `/' from member names
2026-09-17T22:53:01.776363268Z tar: Removing leading `/' from member names
2026-09-17T22:53:01.778740615Z tar: Removing leading `/' from member names
2026-09-17T22:53:01.780533607Z tar: Removing leading `/' from member names
2026-09-17T22:53:01.786974180Z tar: Removing leading `/' from member names
2026-09-17T22:53:01.966535526Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-17T22:53:01.976925111Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-17T22:53:01.980684630Z Wrote inspect data to must-gather.
2026-09-17T22:53:02.216842146Z Wrote inspect data to /must-gather/istio.
2026-09-17T22:53:02.250262871Z W0917 22:53:02.250210    1403 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-09-17T22:53:02.256244949Z Wrote inspect data to must-gather.
2026-09-17T22:53:02.267316218Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-17T22:53:02.334740121Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T22:53:02.445198710Z INFO: Waiting for network log collection to complete ...
2026-09-17T22:53:02.445242595Z INFO: Waiting for ovnk database copies to complete ...
2026-09-17T22:53:02.445771474Z INFO: Copying ovnk databases complete.
2026-09-17T22:53:02.447980837Z 4.7M	must-gather/network_logs/ovnk_database_store
2026-09-17T22:53:02.451399887Z ovnk_database_store/
2026-09-17T22:53:02.451399887Z ovnk_database_store/ovnkube-node-5pjh7_nbdb
2026-09-17T22:53:02.469146143Z ovnk_database_store/ovnkube-node-2z48z_nbdb
2026-09-17T22:53:02.477744447Z ovnk_database_store/ovnkube-node-nrkd5_sbdb
2026-09-17T22:53:02.492506773Z Wrote inspect data to /must-gather/istio.
2026-09-17T22:53:02.495188494Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-17T22:53:02.509017112Z ovnk_database_store/ovnkube-node-nrkd5_nbdb
2026-09-17T22:53:02.522210182Z ovnk_database_store/ovnkube-node-5pjh7_sbdb
2026-09-17T22:53:02.554651850Z ovnk_database_store/ovnkube-node-2z48z_sbdb
2026-09-17T22:53:02.576681434Z Gathering data for ns/openshift-network-console...
2026-09-17T22:53:02.583369711Z INFO: Network log collection complete.
2026-09-17T22:53:02.625923558Z Wrote inspect data to must-gather.
2026-09-17T22:53:02.751170809Z Wrote inspect data to /must-gather/istio.
2026-09-17T22:53:02.757063156Z INFO: Getting status from alertmanager-main-0
2026-09-17T22:53:03.000395210Z Wrote inspect data to /must-gather/istio.
2026-09-17T22:53:03.003119748Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-17T22:53:03.007160931Z Wrote inspect data to must-gather.
2026-09-17T22:53:03.093121166Z Gathering data for ns/openshift-console-operator...
2026-09-17T22:53:03.239075882Z Wrote inspect data to /must-gather/istio.
2026-09-17T22:53:03.324052569Z Wrote inspect data to must-gather.
2026-09-17T22:53:03.467032578Z Wrote inspect data to /must-gather/istio.
2026-09-17T22:53:03.470130083Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-17T22:53:03.537681114Z Gathering data for ns/openshift-console...
2026-09-17T22:53:03.632856830Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-17T22:53:03.635929642Z INFO: Fallback to identify the container image from release info
2026-09-17T22:53:03.729335129Z Wrote inspect data to /must-gather/istio.
2026-09-17T22:53:03.936099545Z Wrote inspect data to /must-gather/istio.
2026-09-17T22:53:03.938923764Z Inspecting resource crd/inferencepools.inference.networking.k8s.io
2026-09-17T22:53:04.099146322Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-17T22:53:04.126176766Z Wrote inspect data to /must-gather/istio.
2026-09-17T22:53:04.333764055Z [disk usage checker] Volume usage percentage: current = 25 ; allowed = 70
2026-09-17T22:53:04.346065320Z Wrote inspect data to /must-gather/istio.
2026-09-17T22:53:04.348721875Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io
2026-09-17T22:53:04.473509114Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea
2026-09-17T22:53:04.562241801Z Wrote inspect data to /must-gather/istio.
2026-09-17T22:53:04.631373330Z daemonset.apps/perf-node-gather-daemonset created
2026-09-17T22:53:04.680202534Z Gathering data for ns/openshift-dns-operator...
2026-09-17T22:53:04.799157688Z Waiting for performance profile collector pods to become ready: 1
2026-09-17T22:53:04.811215402Z Wrote inspect data to /must-gather/istio.
2026-09-17T22:53:04.813984911Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-17T22:53:05.009614096Z Wrote inspect data to /must-gather/istio.
2026-09-17T22:53:05.016046238Z Gathering data for ns/openshift-dns...
2026-09-17T22:53:05.212097933Z Wrote inspect data to /must-gather/istio.
2026-09-17T22:53:05.664285395Z Gathering data for ns/openshift-image-registry...
2026-09-17T22:53:05.950812206Z Waiting for performance profile collector pods to become ready: 2
2026-09-17T22:53:06.006943300Z Done executing Istio gather script
2026-09-17T22:53:06.172895562Z Gathering data for ns/openshift-ingress-operator...
2026-09-17T22:53:06.495983666Z Gathering data for ns/openshift-ingress...
2026-09-17T22:53:06.816216442Z Gathering data for ns/openshift-ingress-canary...
2026-09-17T22:53:07.085182260Z Waiting for performance profile collector pods to become ready: 3
2026-09-17T22:53:07.210213981Z Gathering data for ns/openshift-insights...
2026-09-17T22:53:08.220696141Z Waiting for performance profile collector pods to become ready: 4
2026-09-17T22:53:09.339979306Z [disk usage checker] Volume usage percentage: current = 25 ; allowed = 70
2026-09-17T22:53:09.372537828Z Waiting for performance profile collector pods to become ready: 5
2026-09-17T22:53:09.614331570Z Gathering data for ns/kserve...
2026-09-17T22:53:10.510103547Z Waiting for performance profile collector pods to become ready: 6
2026-09-17T22:53:11.638355593Z Waiting for performance profile collector pods to become ready: 7
2026-09-17T22:53:11.766313186Z Gathering data for ns/openshift-config...
2026-09-17T22:53:12.065097680Z Gathering data for ns/openshift-config-managed...
2026-09-17T22:53:12.489871052Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-17T22:53:12.772513509Z Gathering data for ns/openshift-kube-apiserver...
2026-09-17T22:53:12.786278782Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-17T22:53:13.066962201Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-17T22:53:13.078465710Z Collecting performance related data for node ip-10-0-138-45.ec2.internal
2026-09-17T22:53:13.087898704Z Collecting performance related data for node ip-10-0-139-13.ec2.internal
2026-09-17T22:53:13.106346641Z Collecting performance related data for node ip-10-0-136-9.ec2.internal
2026-09-17T22:53:13.401582216Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-17T22:53:13.784003304Z Gathering data for ns/openshift-kube-scheduler...
2026-09-17T22:53:14.095673764Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-17T22:53:14.349864487Z [disk usage checker] Volume usage percentage: current = 25 ; allowed = 70
2026-09-17T22:53:14.494697426Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-17T22:53:14.881306923Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-17T22:53:15.189737888Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-17T22:53:15.732172516Z Gathering data for ns/openshift-multus...
2026-09-17T22:53:17.215824995Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-17T22:53:18.493233308Z Gathering data for ns/openshift-host-network...
2026-09-17T22:53:18.813768091Z Gathering data for ns/openshift-network-diagnostics...
2026-09-17T22:53:19.351591216Z Gathering data for ns/openshift-network-node-identity...
2026-09-17T22:53:19.354904478Z [disk usage checker] Volume usage percentage: current = 25 ; allowed = 70
2026-09-17T22:53:19.777769993Z Gathering data for ns/openshift-network-operator...
2026-09-17T22:53:20.141714149Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-17T22:53:20.457053755Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-17T22:53:20.967718804Z Gathering data for ns/openshift-apiserver-operator...
2026-09-17T22:53:21.264419251Z Gathering data for ns/openshift-apiserver...
2026-09-17T22:53:21.340666713Z Collecting kubelet logs for node ip-10-0-138-45.ec2.internal
2026-09-17T22:53:21.342461417Z Collecting kubelet logs for node ip-10-0-139-13.ec2.internal
2026-09-17T22:53:21.344278872Z Collecting kubelet logs for node ip-10-0-136-9.ec2.internal
2026-09-17T22:53:21.759420908Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-17T22:53:21.792520279Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-kfvtg namespace
2026-09-17T22:53:21.799061590Z INFO: Node performance data collection complete.
2026-09-17T22:53:22.079289058Z Gathering data for ns/openshift-controller-manager...
2026-09-17T22:53:22.358074340Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-17T22:53:23.006338943Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-17T22:53:23.303106079Z Gathering data for ns/openshift-service-ca-operator...
2026-09-17T22:53:23.623759484Z Gathering data for ns/openshift-service-ca...
2026-09-17T22:53:23.972735446Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-17T22:53:24.360670765Z [disk usage checker] Volume usage percentage: current = 25 ; allowed = 70
2026-09-17T22:53:24.898241619Z Wrote inspect data to must-gather.
2026-09-17T22:53:24.898290150Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T22:53:24.898290150Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-17T22:53:25.037003666Z error: the server doesn't have a resource type "clusters"
2026-09-17T22:53:25.270768789Z Caches written to disk