2026-06-08T12:10:53.114495676Z [disk usage checker] Started
2026-06-08T12:10:53.117823237Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-06-08T12:10:53.316470415Z Gathering data for ns/openshift-cluster-version...
2026-06-08T12:10:53.446670595Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-08T12:10:53.541556098Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-08T12:10:53.623458037Z Gathering data for ns/default...
2026-06-08T12:10:53.917747242Z Gathering data for ns/openshift...
2026-06-08T12:10:54.351412491Z Gathering data for ns/kube-system...
2026-06-08T12:10:55.022645834Z Gathering data for ns/openshift-etcd...
2026-06-08T12:10:55.310872061Z Wrote inspect data to must-gather.
2026-06-08T12:10:55.310904550Z error: inspection completed with the errors occurred while gathering data:
2026-06-08T12:10:55.310904550Z     namespaces "assisted-installer" not found
2026-06-08T12:10:55.649094379Z Waiting on subprocesses to finish execution.
2026-06-08T12:10:55.659407874Z Executing Istio gather script
2026-06-08T12:10:55.663129937Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-08T12:10:55.665647007Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-08T12:10:55.668263805Z INFO: Gathering HAProxy config files
2026-06-08T12:10:55.672305917Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-08T12:10:55.677486816Z INFO: Collecting host service logs for crio
2026-06-08T12:10:55.677938051Z INFO: Collecting host service logs for kubelet
2026-06-08T12:10:55.678307857Z INFO: Collecting host service logs for rpm-ostreed
2026-06-08T12:10:55.680759389Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-08T12:10:55.681115651Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-08T12:10:55.681471565Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-08T12:10:55.685150074Z INFO: Collecting host service logs for NetworkManager
2026-06-08T12:10:55.685507688Z INFO: Collecting host service logs for openvswitch
2026-06-08T12:10:55.685850767Z INFO: Collecting host service logs for ovs-configuration
2026-06-08T12:10:55.686204867Z INFO: Collecting host service logs for ovsdb-server
2026-06-08T12:10:55.686629869Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-08T12:10:55.687040676Z INFO: Waiting for worker host service log collection to complete ...
2026-06-08T12:10:55.784215521Z INFO: Waiting for node performance related collection to complete ...
2026-06-08T12:10:55.969611345Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-08T12:10:55.969686065Z INFO: on-disk MachineConfig config collection complete.
2026-06-08T12:10:56.006485045Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-08T12:10:56.276281462Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-08T12:10:56.318413801Z INFO: Collecting Insights Archives from insights-operator-896549976-n7mhp
2026-06-08T12:10:56.318473799Z insights-runtime-extractor-j8w9v
2026-06-08T12:10:56.318495595Z insights-runtime-extractor-rlbmh
2026-06-08T12:10:56.318515729Z insights-runtime-extractor-tsgj2
2026-06-08T12:10:56.349704053Z No resources found
2026-06-08T12:10:56.429414200Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-08T12:10:56.682863514Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-08T12:10:56.682863514Z See 'oc rsync -h' for help and examples
2026-06-08T12:10:56.696703620Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-08T12:10:56.708869352Z Wrote inspect data to must-gather.
2026-06-08T12:10:56.789959941Z No resources found in openshift-etcd namespace.
2026-06-08T12:10:57.015966267Z error: the server doesn't have a resource type "performanceprofile"
2026-06-08T12:10:57.062521807Z INFO: "metallb-operator" not detected. Skipping.
2026-06-08T12:10:57.086181679Z INFO: Worker host service log collection to complete.
2026-06-08T12:10:57.190447096Z ERROR: No running kube-apiserver pods found
2026-06-08T12:10:57.296439678Z Wrote inspect data to must-gather.
2026-06-08T12:10:57.457066022Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-08T12:10:57.671027024Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-08T12:10:57.784872442Z No resources found
2026-06-08T12:10:57.869194319Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-08T12:10:57.996283117Z Wrote inspect data to must-gather.
2026-06-08T12:10:58.033458432Z Gathering data for ns/openshift-monitoring...
2026-06-08T12:10:58.034178938Z Wrote inspect data to must-gather.
2026-06-08T12:10:58.043104554Z Wrote inspect data to must-gather.
2026-06-08T12:10:58.074573030Z INFO: 'previous-logs' folder not found on ip-10-0-129-165.ec2.internal, skipping...
2026-06-08T12:10:58.091502896Z Wrote inspect data to must-gather.
2026-06-08T12:10:58.093916799Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-08T12:10:58.138631624Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-06-08T12:10:58.143774634Z Wrote inspect data to must-gather.
2026-06-08T12:10:58.254190381Z error: the server doesn't have a resource type "machineconfigs"
2026-06-08T12:10:58.359736151Z tar: Removing leading `/' from member names
2026-06-08T12:10:58.365150404Z INFO: HAProxy config collection complete.
2026-06-08T12:10:58.430271711Z INFO: Getting rules from prometheus-k8s-0
2026-06-08T12:10:58.431258099Z Wrote inspect data to must-gather.
2026-06-08T12:10:58.436802787Z INFO: 'previous-logs' folder not found on ip-10-0-140-135.ec2.internal, skipping...
2026-06-08T12:10:58.467047863Z error: the server doesn't have a resource type "machineconfigpools"
2026-06-08T12:10:58.564614021Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-06-08T12:10:58.725468080Z Wrote inspect data to must-gather.
2026-06-08T12:10:58.725844088Z INFO: 'previous-logs' folder not found on ip-10-0-141-223.ec2.internal, skipping...
2026-06-08T12:10:58.725867470Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-08T12:10:58.725895669Z INFO: Machine Config Daemon termination log collection complete.
2026-06-08T12:10:58.731879981Z Wrote inspect data to must-gather.
2026-06-08T12:10:58.839527780Z INFO: Getting status/config from prometheus-k8s-0
2026-06-08T12:10:58.884476314Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-08T12:10:58.974103692Z Wrote inspect data to must-gather.
2026-06-08T12:10:59.094399227Z Wrote inspect data to must-gather.
2026-06-08T12:10:59.237884335Z INFO: INTERCONNECT MODE
2026-06-08T12:10:59.237929358Z INFO: Gathering ovn-kubernetes DBs
2026-06-08T12:10:59.245597243Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-08T12:10:59.311269957Z Wrote inspect data to must-gather.
2026-06-08T12:10:59.405389063Z INFO: Gathering OVN_Northbound from ovnkube-node-kx87z...
2026-06-08T12:10:59.405601812Z INFO: Gathering OVN_Northbound from ovnkube-node-qxf9r...
2026-06-08T12:10:59.405814339Z INFO: Gathering OVN_Northbound from ovnkube-node-w89bg...
2026-06-08T12:10:59.406068795Z INFO: Gathering OVN_Southbound from ovnkube-node-kx87z...
2026-06-08T12:10:59.406324608Z INFO: Gathering OVN_Southbound from ovnkube-node-qxf9r...
2026-06-08T12:10:59.406620473Z INFO: Gathering OVN_Southbound from ovnkube-node-w89bg...
2026-06-08T12:10:59.508634340Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-08T12:10:59.584963418Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-06-08T12:10:59.624422337Z Wrote inspect data to must-gather.
2026-06-08T12:10:59.702135042Z tar: Removing leading `/' from member names
2026-06-08T12:10:59.751551015Z tar: Removing leading `/' from member names
2026-06-08T12:10:59.767890040Z tar: Removing leading `/' from member names
2026-06-08T12:10:59.791000874Z tar: Removing leading `/' from member names
2026-06-08T12:10:59.795577763Z tar: Removing leading `/' from member names
2026-06-08T12:10:59.823946013Z tar: Removing leading `/' from member names
2026-06-08T12:10:59.832548533Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-08T12:10:59.877701264Z Wrote inspect data to /must-gather/istio.
2026-06-08T12:10:59.902751789Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-08T12:10:59.929601383Z Wrote inspect data to must-gather.
2026-06-08T12:11:00.151170760Z Wrote inspect data to /must-gather/istio.
2026-06-08T12:11:00.154286442Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-06-08T12:11:00.170258435Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-08T12:11:00.195371095Z Wrote inspect data to must-gather.
2026-06-08T12:11:00.272692339Z INFO: Waiting for network log collection to complete ...
2026-06-08T12:11:00.272830265Z INFO: Waiting for ovnk database copies to complete ...
2026-06-08T12:11:00.273277529Z INFO: Copying ovnk databases complete.
2026-06-08T12:11:00.274919903Z 2.8M	must-gather/network_logs/ovnk_database_store
2026-06-08T12:11:00.279784807Z ovnk_database_store/
2026-06-08T12:11:00.279833253Z ovnk_database_store/ovnkube-node-kx87z_sbdb
2026-06-08T12:11:00.306284670Z ovnk_database_store/ovnkube-node-qxf9r_sbdb
2026-06-08T12:11:00.324980857Z ovnk_database_store/ovnkube-node-w89bg_nbdb
2026-06-08T12:11:00.335021363Z ovnk_database_store/ovnkube-node-w89bg_sbdb
2026-06-08T12:11:00.357150063Z ovnk_database_store/ovnkube-node-qxf9r_nbdb
2026-06-08T12:11:00.365383564Z ovnk_database_store/ovnkube-node-kx87z_nbdb
2026-06-08T12:11:00.374873418Z Wrote inspect data to /must-gather/istio.
2026-06-08T12:11:00.377362295Z INFO: Network log collection complete.
2026-06-08T12:11:00.416390413Z W0608 12:11:00.416330    1489 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-06-08T12:11:00.421246608Z Wrote inspect data to must-gather.
2026-06-08T12:11:00.492620392Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-08T12:11:00.570523980Z INFO: Getting status from alertmanager-main-0
2026-06-08T12:11:00.590093824Z Wrote inspect data to /must-gather/istio.
2026-06-08T12:11:00.592828113Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-06-08T12:11:00.693803500Z Gathering data for ns/openshift-network-console...
2026-06-08T12:11:00.713522813Z Wrote inspect data to must-gather.
2026-06-08T12:11:00.813037016Z Wrote inspect data to /must-gather/istio.
2026-06-08T12:11:00.974796195Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-08T12:11:00.977896358Z INFO: Fallback to identify the container image from release info
2026-06-08T12:11:01.006019526Z Wrote inspect data to /must-gather/istio.
2026-06-08T12:11:01.009400239Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-06-08T12:11:01.135831411Z Gathering data for ns/openshift-console-operator...
2026-06-08T12:11:01.239262954Z Wrote inspect data to /must-gather/istio.
2026-06-08T12:11:01.421262703Z Wrote inspect data to /must-gather/istio.
2026-06-08T12:11:01.423531627Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-06-08T12:11:01.505254600Z Gathering data for ns/openshift-console...
2026-06-08T12:11:01.574602194Z Wrote inspect data to /must-gather/istio.
2026-06-08T12:11:01.693652140Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:75a8fe9618bb81a42d565c535f20bf55d78662baa7f32548859596b4c5aa793e
2026-06-08T12:11:01.788427226Z Wrote inspect data to /must-gather/istio.
2026-06-08T12:11:01.806826320Z daemonset.apps/perf-node-gather-daemonset created
2026-06-08T12:11:01.948998394Z Waiting for performance profile collector pods to become ready: 1
2026-06-08T12:11:02.079426008Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-08T12:11:02.507321687Z Done executing Istio gather script
2026-06-08T12:11:02.616231822Z Gathering data for ns/openshift-dns-operator...
2026-06-08T12:11:02.874493111Z Gathering data for ns/openshift-dns...
2026-06-08T12:11:03.052399763Z Waiting for performance profile collector pods to become ready: 2
2026-06-08T12:11:03.145907181Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-06-08T12:11:03.459199890Z Gathering data for ns/openshift-image-registry...
2026-06-08T12:11:03.898904334Z Gathering data for ns/openshift-ingress-operator...
2026-06-08T12:11:04.170412631Z Waiting for performance profile collector pods to become ready: 3
2026-06-08T12:11:04.224995045Z Gathering data for ns/openshift-ingress...
2026-06-08T12:11:04.552976798Z Gathering data for ns/openshift-ingress-canary...
2026-06-08T12:11:04.931669905Z Gathering data for ns/openshift-insights...
2026-06-08T12:11:05.289329489Z Waiting for performance profile collector pods to become ready: 4
2026-06-08T12:11:06.394411294Z Waiting for performance profile collector pods to become ready: 5
2026-06-08T12:11:06.817119424Z Gathering data for ns/openshift-jobset-operator...
2026-06-08T12:11:07.510438669Z Waiting for performance profile collector pods to become ready: 6
2026-06-08T12:11:07.597494738Z Gathering data for ns/openshift-config...
2026-06-08T12:11:07.841440425Z Gathering data for ns/openshift-config-managed...
2026-06-08T12:11:08.153631273Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-06-08T12:11:08.234573042Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-08T12:11:08.474278726Z Gathering data for ns/openshift-kube-apiserver...
2026-06-08T12:11:08.615408667Z Waiting for performance profile collector pods to become ready: 7
2026-06-08T12:11:08.728410830Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-08T12:11:08.994770136Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-08T12:11:09.259702292Z Gathering data for ns/openshift-kube-scheduler...
2026-06-08T12:11:09.520401208Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-08T12:11:09.721818844Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-08T12:11:09.855741094Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-08T12:11:09.963758467Z Collecting performance related data for node ip-10-0-129-165.ec2.internal
2026-06-08T12:11:09.973095308Z Collecting performance related data for node ip-10-0-140-135.ec2.internal
2026-06-08T12:11:09.980773635Z Collecting performance related data for node ip-10-0-141-223.ec2.internal
2026-06-08T12:11:10.257799739Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-08T12:11:10.656110193Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-08T12:11:11.303917453Z Gathering data for ns/openshift-multus...
2026-06-08T12:11:12.916766290Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-08T12:11:13.158083347Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-06-08T12:11:14.196986982Z Gathering data for ns/openshift-host-network...
2026-06-08T12:11:14.515833995Z Gathering data for ns/openshift-network-diagnostics...
2026-06-08T12:11:15.058269316Z Gathering data for ns/openshift-network-node-identity...
2026-06-08T12:11:15.459719752Z Gathering data for ns/openshift-network-operator...
2026-06-08T12:11:15.831460956Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-08T12:11:16.087685602Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-08T12:11:16.539033842Z Gathering data for ns/openshift-apiserver-operator...
2026-06-08T12:11:16.826327096Z Gathering data for ns/openshift-apiserver...
2026-06-08T12:11:17.218785072Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-08T12:11:17.486690978Z Gathering data for ns/openshift-controller-manager...
2026-06-08T12:11:17.759628049Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-08T12:11:17.842997291Z Collecting kubelet logs for node ip-10-0-129-165.ec2.internal
2026-06-08T12:11:17.844968083Z Collecting kubelet logs for node ip-10-0-140-135.ec2.internal
2026-06-08T12:11:17.847187589Z Collecting kubelet logs for node ip-10-0-141-223.ec2.internal
2026-06-08T12:11:18.162605511Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-08T12:11:18.197485522Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-5mz2z namespace
2026-06-08T12:11:18.202327100Z INFO: Node performance data collection complete.
2026-06-08T12:11:18.448535799Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-08T12:11:18.721924086Z Gathering data for ns/openshift-service-ca-operator...
2026-06-08T12:11:19.006831421Z Gathering data for ns/openshift-service-ca...
2026-06-08T12:11:19.339016804Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-08T12:11:20.248557439Z Wrote inspect data to must-gather.
2026-06-08T12:11:20.248600997Z error: inspection completed with the errors occurred while gathering data:
2026-06-08T12:11:20.248600997Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-08T12:11:20.369204828Z error: the server doesn't have a resource type "clusters"
2026-06-08T12:11:20.507217413Z Caches written to disk