2026-06-05T17:43:02.252634712Z [disk usage checker] Started
2026-06-05T17:43:02.258057923Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-06-05T17:43:02.473866719Z Gathering data for ns/openshift-cluster-version...
2026-06-05T17:43:02.603177710Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-05T17:43:02.691903935Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-05T17:43:02.774407597Z Gathering data for ns/default...
2026-06-05T17:43:03.077359889Z Gathering data for ns/openshift...
2026-06-05T17:43:03.502349990Z Gathering data for ns/kube-system...
2026-06-05T17:43:04.215949195Z Gathering data for ns/openshift-etcd...
2026-06-05T17:43:04.531895045Z Wrote inspect data to must-gather.
2026-06-05T17:43:04.531934748Z error: inspection completed with the errors occurred while gathering data:
2026-06-05T17:43:04.531934748Z     namespaces "assisted-installer" not found
2026-06-05T17:43:04.907885923Z Waiting on subprocesses to finish execution.
2026-06-05T17:43:04.918822306Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-05T17:43:04.919904681Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-05T17:43:04.925624778Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-05T17:43:04.940646385Z INFO: Collecting host service logs for crio
2026-06-05T17:43:04.941081589Z INFO: Collecting host service logs for kubelet
2026-06-05T17:43:04.941458082Z INFO: Collecting host service logs for rpm-ostreed
2026-06-05T17:43:04.941850319Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-05T17:43:04.942202849Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-05T17:43:04.942575420Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-05T17:43:04.942769016Z INFO: Gathering HAProxy config files
2026-06-05T17:43:04.943023545Z INFO: Collecting host service logs for NetworkManager
2026-06-05T17:43:04.943397244Z INFO: Collecting host service logs for openvswitch
2026-06-05T17:43:04.943805006Z INFO: Collecting host service logs for ovs-configuration
2026-06-05T17:43:04.944168563Z INFO: Collecting host service logs for ovsdb-server
2026-06-05T17:43:04.944530869Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-05T17:43:04.945001951Z INFO: Waiting for worker host service log collection to complete ...
2026-06-05T17:43:05.013827862Z INFO: Waiting for node performance related collection to complete ...
2026-06-05T17:43:05.015866038Z Executing Istio gather script
2026-06-05T17:43:05.490463529Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-05T17:43:05.490560513Z INFO: on-disk MachineConfig config collection complete.
2026-06-05T17:43:05.621461370Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-05T17:43:05.673358233Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-05T17:43:05.687620908Z error: the server doesn't have a resource type "performanceprofile"
2026-06-05T17:43:05.997692900Z INFO: "metallb-operator" not detected. Skipping.
2026-06-05T17:43:06.027521432Z Wrote inspect data to must-gather.
2026-06-05T17:43:06.092211485Z No resources found
2026-06-05T17:43:06.219307941Z INFO: Collecting Insights Archives from insights-operator-896549976-s4c2w
2026-06-05T17:43:06.219359322Z insights-runtime-extractor-5kdj8
2026-06-05T17:43:06.219391858Z insights-runtime-extractor-bxmkx
2026-06-05T17:43:06.219410873Z insights-runtime-extractor-bz2ht
2026-06-05T17:43:06.260386185Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-05T17:43:06.313581897Z Wrote inspect data to must-gather.
2026-06-05T17:43:06.448591907Z No resources found in openshift-etcd namespace.
2026-06-05T17:43:06.582115765Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-05T17:43:06.627467819Z INFO: Worker host service log collection to complete.
2026-06-05T17:43:06.629167136Z Wrote inspect data to must-gather.
2026-06-05T17:43:06.851137535Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-05T17:43:06.857996175Z ERROR: No running kube-apiserver pods found
2026-06-05T17:43:06.903997718Z Gathering data for ns/openshift-monitoring...
2026-06-05T17:43:07.039113876Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-05T17:43:07.039113876Z See 'oc rsync -h' for help and examples
2026-06-05T17:43:07.132227014Z tar: Removing leading `/' from member names
2026-06-05T17:43:07.139603987Z INFO: HAProxy config collection complete.
2026-06-05T17:43:07.258339522Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-05T17:43:07.274343435Z No resources found
2026-06-05T17:43:07.282020894Z INFO: 'previous-logs' folder not found on ip-10-0-133-183.ec2.internal, skipping...
2026-06-05T17:43:07.305249754Z Wrote inspect data to must-gather.
2026-06-05T17:43:07.318414643Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-06-05T17:43:07.343345334Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-05T17:43:07.348575139Z Wrote inspect data to must-gather.
2026-06-05T17:43:07.420376426Z Wrote inspect data to must-gather.
2026-06-05T17:43:07.457655133Z error: the server doesn't have a resource type "machineconfigs"
2026-06-05T17:43:07.505515452Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-05T17:43:07.556185175Z Wrote inspect data to must-gather.
2026-06-05T17:43:07.566952093Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-06-05T17:43:07.668116626Z error: the server doesn't have a resource type "machineconfigpools"
2026-06-05T17:43:07.696209739Z INFO: 'previous-logs' folder not found on ip-10-0-139-251.ec2.internal, skipping...
2026-06-05T17:43:07.711562580Z Wrote inspect data to must-gather.
2026-06-05T17:43:07.904577200Z Wrote inspect data to must-gather.
2026-06-05T17:43:07.958328094Z INFO: Getting rules from prometheus-k8s-0
2026-06-05T17:43:07.964495689Z INFO: 'previous-logs' folder not found on ip-10-0-141-243.ec2.internal, skipping...
2026-06-05T17:43:07.964531675Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-05T17:43:07.964557000Z INFO: Machine Config Daemon termination log collection complete.
2026-06-05T17:43:07.983711925Z Wrote inspect data to must-gather.
2026-06-05T17:43:08.060351003Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-05T17:43:08.232338001Z Wrote inspect data to must-gather.
2026-06-05T17:43:08.279365379Z Wrote inspect data to must-gather.
2026-06-05T17:43:08.364662443Z INFO: Getting status/config from prometheus-k8s-0
2026-06-05T17:43:08.513623375Z Wrote inspect data to must-gather.
2026-06-05T17:43:08.542817794Z INFO: INTERCONNECT MODE
2026-06-05T17:43:08.542897290Z INFO: Gathering ovn-kubernetes DBs
2026-06-05T17:43:08.569898885Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-06-05T17:43:08.645258576Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-05T17:43:08.714646644Z INFO: Gathering OVN_Northbound from ovnkube-node-6zj8s...
2026-06-05T17:43:08.714904073Z INFO: Gathering OVN_Northbound from ovnkube-node-r5gxm...
2026-06-05T17:43:08.715167537Z INFO: Gathering OVN_Northbound from ovnkube-node-wlq2s...
2026-06-05T17:43:08.715494202Z INFO: Gathering OVN_Southbound from ovnkube-node-6zj8s...
2026-06-05T17:43:08.716024938Z INFO: Gathering OVN_Southbound from ovnkube-node-r5gxm...
2026-06-05T17:43:08.716322172Z INFO: Gathering OVN_Southbound from ovnkube-node-wlq2s...
2026-06-05T17:43:08.719989508Z Wrote inspect data to must-gather.
2026-06-05T17:43:08.802054730Z Wrote inspect data to /must-gather/istio.
2026-06-05T17:43:08.945771554Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-05T17:43:09.010943461Z tar: Removing leading `/' from member names
2026-06-05T17:43:09.076524057Z tar: Removing leading `/' from member names
2026-06-05T17:43:09.105693082Z tar: Removing leading `/' from member names
2026-06-05T17:43:09.114922095Z tar: Removing leading `/' from member names
2026-06-05T17:43:09.120258480Z tar: Removing leading `/' from member names
2026-06-05T17:43:09.132152015Z Wrote inspect data to must-gather.
2026-06-05T17:43:09.138191081Z tar: Removing leading `/' from member names
2026-06-05T17:43:09.221907567Z Wrote inspect data to /must-gather/istio.
2026-06-05T17:43:09.225298334Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-06-05T17:43:09.274920250Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-05T17:43:09.396158644Z W0605 17:43:09.396096    1402 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-06-05T17:43:09.406160598Z Wrote inspect data to must-gather.
2026-06-05T17:43:09.470608476Z Wrote inspect data to /must-gather/istio.
2026-06-05T17:43:09.471455444Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-05T17:43:09.556144872Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-05T17:43:09.601514435Z INFO: Waiting for network log collection to complete ...
2026-06-05T17:43:09.601564717Z INFO: Waiting for ovnk database copies to complete ...
2026-06-05T17:43:09.602061093Z INFO: Copying ovnk databases complete.
2026-06-05T17:43:09.604254514Z 2.6M	must-gather/network_logs/ovnk_database_store
2026-06-05T17:43:09.609439554Z ovnk_database_store/
2026-06-05T17:43:09.609439554Z ovnk_database_store/ovnkube-node-6zj8s_nbdb
2026-06-05T17:43:09.621254947Z ovnk_database_store/ovnkube-node-r5gxm_sbdb
2026-06-05T17:43:09.640739130Z ovnk_database_store/ovnkube-node-wlq2s_sbdb
2026-06-05T17:43:09.659358924Z ovnk_database_store/ovnkube-node-r5gxm_nbdb
2026-06-05T17:43:09.667893626Z ovnk_database_store/ovnkube-node-wlq2s_nbdb
2026-06-05T17:43:09.675817529Z ovnk_database_store/ovnkube-node-6zj8s_sbdb
2026-06-05T17:43:09.690525703Z Gathering data for ns/openshift-network-console...
2026-06-05T17:43:09.699056899Z INFO: Network log collection complete.
2026-06-05T17:43:09.721698896Z Wrote inspect data to /must-gather/istio.
2026-06-05T17:43:09.724428665Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-06-05T17:43:09.737857478Z Wrote inspect data to must-gather.
2026-06-05T17:43:09.820049017Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-05T17:43:09.923183820Z Wrote inspect data to /must-gather/istio.
2026-06-05T17:43:10.041415539Z Wrote inspect data to must-gather.
2026-06-05T17:43:10.148099053Z Wrote inspect data to /must-gather/istio.
2026-06-05T17:43:10.151407572Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-06-05T17:43:10.201776966Z Gathering data for ns/openshift-console-operator...
2026-06-05T17:43:10.221710693Z INFO: Getting status from alertmanager-main-0
2026-06-05T17:43:10.346530956Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-05T17:43:10.350133430Z INFO: Fallback to identify the container image from release info
2026-06-05T17:43:10.392712553Z Wrote inspect data to /must-gather/istio.
2026-06-05T17:43:10.588707594Z Wrote inspect data to /must-gather/istio.
2026-06-05T17:43:10.591813761Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-06-05T17:43:10.639395752Z Gathering data for ns/openshift-console...
2026-06-05T17:43:10.758863984Z Wrote inspect data to /must-gather/istio.
2026-06-05T17:43:10.924026660Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:75a8fe9618bb81a42d565c535f20bf55d78662baa7f32548859596b4c5aa793e
2026-06-05T17:43:10.965221672Z Wrote inspect data to /must-gather/istio.
2026-06-05T17:43:11.080396115Z daemonset.apps/perf-node-gather-daemonset created
2026-06-05T17:43:11.221404118Z Waiting for performance profile collector pods to become ready: 1
2026-06-05T17:43:11.221463349Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-05T17:43:11.687094247Z Done executing Istio gather script
2026-06-05T17:43:11.773788176Z Gathering data for ns/openshift-dns-operator...
2026-06-05T17:43:12.103438295Z Gathering data for ns/openshift-dns...
2026-06-05T17:43:12.325051563Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-06-05T17:43:12.326666666Z Waiting for performance profile collector pods to become ready: 2
2026-06-05T17:43:12.715118141Z Gathering data for ns/openshift-image-registry...
2026-06-05T17:43:13.176447192Z Gathering data for ns/openshift-ingress-operator...
2026-06-05T17:43:13.463210582Z Waiting for performance profile collector pods to become ready: 3
2026-06-05T17:43:13.526223970Z Gathering data for ns/openshift-ingress...
2026-06-05T17:43:13.886502959Z Gathering data for ns/openshift-ingress-canary...
2026-06-05T17:43:14.316995843Z Gathering data for ns/openshift-insights...
2026-06-05T17:43:14.572680269Z Waiting for performance profile collector pods to become ready: 4
2026-06-05T17:43:15.685609780Z Waiting for performance profile collector pods to become ready: 5
2026-06-05T17:43:16.201021442Z Gathering data for ns/openshift-config...
2026-06-05T17:43:16.476940288Z Gathering data for ns/openshift-config-managed...
2026-06-05T17:43:16.812282935Z Waiting for performance profile collector pods to become ready: 6
2026-06-05T17:43:16.935372753Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-05T17:43:17.219823991Z Gathering data for ns/openshift-kube-apiserver...
2026-06-05T17:43:17.330112337Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-05T17:43:17.484418185Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-05T17:43:17.774883588Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-05T17:43:17.925351942Z Waiting for performance profile collector pods to become ready: 7
2026-06-05T17:43:18.076410764Z Gathering data for ns/openshift-kube-scheduler...
2026-06-05T17:43:18.389881548Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-05T17:43:18.678548278Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-05T17:43:19.030477695Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-05T17:43:19.049241978Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-05T17:43:19.295644344Z Collecting performance related data for node ip-10-0-139-251.ec2.internal
2026-06-05T17:43:19.305329238Z Collecting performance related data for node ip-10-0-141-243.ec2.internal
2026-06-05T17:43:19.317652170Z Collecting performance related data for node ip-10-0-133-183.ec2.internal
2026-06-05T17:43:19.417018671Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-05T17:43:20.014576333Z Gathering data for ns/openshift-multus...
2026-06-05T17:43:21.567302590Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-05T17:43:22.336675698Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-05T17:43:22.916558189Z Gathering data for ns/openshift-host-network...
2026-06-05T17:43:23.245702385Z Gathering data for ns/openshift-network-diagnostics...
2026-06-05T17:43:23.798258443Z Gathering data for ns/openshift-network-node-identity...
2026-06-05T17:43:24.262557423Z Gathering data for ns/openshift-network-operator...
2026-06-05T17:43:24.664852085Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-05T17:43:24.985548414Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-05T17:43:25.500047553Z Gathering data for ns/openshift-apiserver-operator...
2026-06-05T17:43:25.830326943Z Gathering data for ns/openshift-apiserver...
2026-06-05T17:43:26.289315506Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-05T17:43:26.654864568Z Gathering data for ns/openshift-controller-manager...
2026-06-05T17:43:26.949555828Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-05T17:43:27.084159135Z Collecting kubelet logs for node ip-10-0-139-251.ec2.internal
2026-06-05T17:43:27.086118656Z Collecting kubelet logs for node ip-10-0-141-243.ec2.internal
2026-06-05T17:43:27.087906198Z Collecting kubelet logs for node ip-10-0-133-183.ec2.internal
2026-06-05T17:43:27.344470620Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-05T17:43:27.413259413Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-tgmv8 namespace
2026-06-05T17:43:27.419523002Z INFO: Node performance data collection complete.
2026-06-05T17:43:27.670021896Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-05T17:43:27.959321492Z Gathering data for ns/openshift-service-ca-operator...
2026-06-05T17:43:28.273634843Z Gathering data for ns/openshift-service-ca...
2026-06-05T17:43:28.647893981Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-05T17:43:29.561250630Z Wrote inspect data to must-gather.
2026-06-05T17:43:29.561300846Z error: inspection completed with the errors occurred while gathering data:
2026-06-05T17:43:29.561300846Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-05T17:43:29.682253045Z error: the server doesn't have a resource type "clusters"
2026-06-05T17:43:29.807713301Z Caches written to disk