2026-06-08T15:48:00.296402563Z [disk usage checker] Started
2026-06-08T15:48:00.300566907Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-08T15:48:00.498823637Z Gathering data for ns/openshift-cluster-version...
2026-06-08T15:48:00.638121875Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-08T15:48:00.734756582Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-08T15:48:00.847727055Z Gathering data for ns/default...
2026-06-08T15:48:01.188844273Z Gathering data for ns/openshift...
2026-06-08T15:48:01.655406057Z Gathering data for ns/kube-system...
2026-06-08T15:48:02.921670498Z Waiting on subprocesses to finish execution.
2026-06-08T15:48:02.928153404Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-08T15:48:02.930159493Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-08T15:48:02.930943463Z Gathering data for ns/openshift-etcd...
2026-06-08T15:48:02.933186281Z INFO: Gathering HAProxy config files
2026-06-08T15:48:02.942446400Z Executing Istio gather script
2026-06-08T15:48:02.943144970Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-08T15:48:02.944491773Z INFO: Collecting host service logs for crio
2026-06-08T15:48:02.944787655Z INFO: Collecting host service logs for kubelet
2026-06-08T15:48:02.945097473Z INFO: Collecting host service logs for rpm-ostreed
2026-06-08T15:48:02.945431932Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-08T15:48:02.945794000Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-08T15:48:02.946118928Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-08T15:48:02.946447117Z INFO: Collecting host service logs for NetworkManager
2026-06-08T15:48:02.946789607Z INFO: Collecting host service logs for openvswitch
2026-06-08T15:48:02.947128358Z INFO: Collecting host service logs for ovs-configuration
2026-06-08T15:48:02.947451337Z INFO: Collecting host service logs for ovsdb-server
2026-06-08T15:48:02.947789921Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-08T15:48:02.948192299Z INFO: Waiting for worker host service log collection to complete ...
2026-06-08T15:48:03.337683222Z No resources found
2026-06-08T15:48:03.374034265Z No resources found in openshift-etcd namespace.
2026-06-08T15:48:03.416718551Z INFO: Waiting for node performance related collection to complete ...
2026-06-08T15:48:03.471311706Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-08T15:48:03.836934469Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-08T15:48:03.838672396Z INFO: "metallb-operator" not detected. Skipping.
2026-06-08T15:48:03.861748618Z error: the server doesn't have a resource type "performanceprofile"
2026-06-08T15:48:03.906265550Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-08T15:48:03.906357143Z INFO: on-disk MachineConfig config collection complete.
2026-06-08T15:48:04.038021687Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-08T15:48:04.274319785Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-08T15:48:04.336523575Z Wrote inspect data to must-gather.
2026-06-08T15:48:04.336619472Z error: inspection completed with the errors occurred while gathering data:
2026-06-08T15:48:04.336619472Z     namespaces "assisted-installer" not found
2026-06-08T15:48:04.445022871Z INFO: Collecting Insights Archives from insights-operator-896549976-c7pfv
2026-06-08T15:48:04.445082395Z insights-runtime-extractor-7wxpj
2026-06-08T15:48:04.445103807Z insights-runtime-extractor-9sclq
2026-06-08T15:48:04.445125360Z insights-runtime-extractor-mj48q
2026-06-08T15:48:04.561804328Z ERROR: No running kube-apiserver pods found
2026-06-08T15:48:04.609922352Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-08T15:48:04.648286632Z Wrote inspect data to must-gather.
2026-06-08T15:48:04.707407715Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-08T15:48:04.719240763Z Wrote inspect data to must-gather.
2026-06-08T15:48:04.827264477Z No resources found
2026-06-08T15:48:05.067044980Z INFO: Worker host service log collection to complete.
2026-06-08T15:48:05.104097278Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-08T15:48:05.104097278Z See 'oc rsync -h' for help and examples
2026-06-08T15:48:05.138561916Z Wrote inspect data to must-gather.
2026-06-08T15:48:05.178156464Z Wrote inspect data to must-gather.
2026-06-08T15:48:05.258600575Z tar: Removing leading `/' from member names
2026-06-08T15:48:05.262534840Z INFO: HAProxy config collection complete.
2026-06-08T15:48:05.281969468Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-08T15:48:05.374112060Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-08T15:48:05.384854473Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-08T15:48:05.400190344Z INFO: 'previous-logs' folder not found on ip-10-0-128-38.ec2.internal, skipping...
2026-06-08T15:48:05.412167843Z Wrote inspect data to must-gather.
2026-06-08T15:48:05.424979404Z error: the server doesn't have a resource type "machineconfigs"
2026-06-08T15:48:05.476778364Z Wrote inspect data to must-gather.
2026-06-08T15:48:05.522791900Z Wrote inspect data to must-gather.
2026-06-08T15:48:05.553651154Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-06-08T15:48:05.645979992Z error: the server doesn't have a resource type "machineconfigpools"
2026-06-08T15:48:05.677379341Z Wrote inspect data to must-gather.
2026-06-08T15:48:05.757046121Z INFO: 'previous-logs' folder not found on ip-10-0-132-96.ec2.internal, skipping...
2026-06-08T15:48:05.760970841Z Gathering data for ns/openshift-monitoring...
2026-06-08T15:48:05.794834586Z INFO: Getting rules from prometheus-k8s-0
2026-06-08T15:48:05.912001849Z Wrote inspect data to must-gather.
2026-06-08T15:48:05.948867868Z Wrote inspect data to must-gather.
2026-06-08T15:48:06.022132787Z INFO: 'previous-logs' folder not found on ip-10-0-136-177.ec2.internal, skipping...
2026-06-08T15:48:06.022242924Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-08T15:48:06.022296316Z INFO: Machine Config Daemon termination log collection complete.
2026-06-08T15:48:06.070536730Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-08T15:48:06.189904565Z Wrote inspect data to must-gather.
2026-06-08T15:48:06.258424481Z Wrote inspect data to must-gather.
2026-06-08T15:48:06.470260590Z Wrote inspect data to must-gather.
2026-06-08T15:48:06.491646071Z INFO: INTERCONNECT MODE
2026-06-08T15:48:06.491646071Z INFO: Gathering ovn-kubernetes DBs
2026-06-08T15:48:06.518182734Z INFO: Getting status/config from prometheus-k8s-0
2026-06-08T15:48:06.647657155Z INFO: Gathering OVN_Northbound from ovnkube-node-4lff4...
2026-06-08T15:48:06.647994384Z INFO: Gathering OVN_Northbound from ovnkube-node-8qz2g...
2026-06-08T15:48:06.648288601Z INFO: Gathering OVN_Northbound from ovnkube-node-cjzn7...
2026-06-08T15:48:06.648614737Z INFO: Gathering OVN_Southbound from ovnkube-node-4lff4...
2026-06-08T15:48:06.648889393Z INFO: Gathering OVN_Southbound from ovnkube-node-8qz2g...
2026-06-08T15:48:06.649142822Z INFO: Gathering OVN_Southbound from ovnkube-node-cjzn7...
2026-06-08T15:48:06.732964469Z Wrote inspect data to must-gather.
2026-06-08T15:48:06.969105390Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-06-08T15:48:07.037839483Z Wrote inspect data to must-gather.
2026-06-08T15:48:07.154755319Z tar: Removing leading `/' from member names
2026-06-08T15:48:07.155882721Z tar: Removing leading `/' from member names
2026-06-08T15:48:07.156003111Z tar: Removing leading `/' from member names
2026-06-08T15:48:07.156045065Z tar: Removing leading `/' from member names
2026-06-08T15:48:07.179675849Z tar: Removing leading `/' from member names
2026-06-08T15:48:07.180181694Z tar: Removing leading `/' from member names
2026-06-08T15:48:07.201397136Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-08T15:48:07.203454162Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:48:07.301426214Z Wrote inspect data to must-gather.
2026-06-08T15:48:07.395454120Z INFO: Waiting for network log collection to complete ...
2026-06-08T15:48:07.395485037Z INFO: Waiting for ovnk database copies to complete ...
2026-06-08T15:48:07.395871496Z INFO: Copying ovnk databases complete.
2026-06-08T15:48:07.397476242Z 2.6M	must-gather/network_logs/ovnk_database_store
2026-06-08T15:48:07.399498209Z ovnk_database_store/
2026-06-08T15:48:07.399509387Z ovnk_database_store/ovnkube-node-cjzn7_nbdb
2026-06-08T15:48:07.407679059Z ovnk_database_store/ovnkube-node-4lff4_nbdb
2026-06-08T15:48:07.413885092Z ovnk_database_store/ovnkube-node-cjzn7_sbdb
2026-06-08T15:48:07.430141788Z ovnk_database_store/ovnkube-node-4lff4_sbdb
2026-06-08T15:48:07.439310381Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:48:07.441304259Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-06-08T15:48:07.445406884Z ovnk_database_store/ovnkube-node-8qz2g_nbdb
2026-06-08T15:48:07.450969685Z ovnk_database_store/ovnkube-node-8qz2g_sbdb
2026-06-08T15:48:07.468983722Z INFO: Network log collection complete.
2026-06-08T15:48:07.508972510Z Wrote inspect data to must-gather.
2026-06-08T15:48:07.510959340Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-08T15:48:07.628517067Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:48:07.717942675Z Wrote inspect data to must-gather.
2026-06-08T15:48:07.825337636Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:48:07.827640418Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-06-08T15:48:07.862508214Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-08T15:48:07.973027607Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-08T15:48:07.975156415Z INFO: Fallback to identify the container image from release info
2026-06-08T15:48:08.013888925Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:48:08.196377735Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:48:08.197604793Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-08T15:48:08.198663754Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-06-08T15:48:08.411905047Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:48:08.597092621Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:48:08.599329174Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-06-08T15:48:08.673973901Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:75a8fe9618bb81a42d565c535f20bf55d78662baa7f32548859596b4c5aa793e
2026-06-08T15:48:08.696053018Z INFO: Getting status from alertmanager-main-0
2026-06-08T15:48:08.771752816Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:48:08.819694439Z daemonset.apps/perf-node-gather-daemonset created
2026-06-08T15:48:08.966984349Z Waiting for performance profile collector pods to become ready: 1
2026-06-08T15:48:08.977926662Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:48:09.611286538Z Done executing Istio gather script
2026-06-08T15:48:09.736709712Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-08T15:48:10.072188599Z Waiting for performance profile collector pods to become ready: 2
2026-06-08T15:48:10.249238001Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-08T15:48:10.391579571Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-08T15:48:10.408487620Z Gathering data for ns/openshift-network-console...
2026-06-08T15:48:10.869038381Z Gathering data for ns/openshift-console-operator...
2026-06-08T15:48:11.174457940Z Waiting for performance profile collector pods to become ready: 3
2026-06-08T15:48:11.398262444Z Gathering data for ns/openshift-console...
2026-06-08T15:48:12.013396416Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-08T15:48:12.277853172Z Waiting for performance profile collector pods to become ready: 4
2026-06-08T15:48:12.602917912Z Gathering data for ns/openshift-dns-operator...
2026-06-08T15:48:12.961830672Z Gathering data for ns/openshift-dns...
2026-06-08T15:48:13.389821825Z Waiting for performance profile collector pods to become ready: 5
2026-06-08T15:48:14.142366656Z Gathering data for ns/openshift-image-registry...
2026-06-08T15:48:14.501613124Z Waiting for performance profile collector pods to become ready: 6
2026-06-08T15:48:14.812875771Z Gathering data for ns/openshift-ingress-operator...
2026-06-08T15:48:15.223428945Z Gathering data for ns/openshift-ingress...
2026-06-08T15:48:15.396550309Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-08T15:48:15.626331140Z Waiting for performance profile collector pods to become ready: 7
2026-06-08T15:48:15.656374862Z Gathering data for ns/openshift-ingress-canary...
2026-06-08T15:48:16.176235593Z Gathering data for ns/openshift-insights...
2026-06-08T15:48:16.751161878Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-08T15:48:17.004503304Z Collecting performance related data for node ip-10-0-128-38.ec2.internal
2026-06-08T15:48:17.012347370Z Collecting performance related data for node ip-10-0-132-96.ec2.internal
2026-06-08T15:48:17.022415473Z Collecting performance related data for node ip-10-0-136-177.ec2.internal
2026-06-08T15:48:18.891575029Z Gathering data for ns/openshift-config...
2026-06-08T15:48:19.265495274Z Gathering data for ns/openshift-config-managed...
2026-06-08T15:48:19.828934036Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-08T15:48:20.281665357Z Gathering data for ns/openshift-kube-apiserver...
2026-06-08T15:48:20.401235171Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-08T15:48:20.633600744Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-08T15:48:20.966469740Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-08T15:48:21.338411552Z Gathering data for ns/openshift-kube-scheduler...
2026-06-08T15:48:21.655202679Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-08T15:48:22.086138047Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-08T15:48:22.576608142Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-08T15:48:23.030880732Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-08T15:48:23.682206817Z Gathering data for ns/openshift-multus...
2026-06-08T15:48:25.405971741Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-08T15:48:25.443764288Z Collecting kubelet logs for node ip-10-0-128-38.ec2.internal
2026-06-08T15:48:25.445692622Z Collecting kubelet logs for node ip-10-0-132-96.ec2.internal
2026-06-08T15:48:25.447830496Z Collecting kubelet logs for node ip-10-0-136-177.ec2.internal
2026-06-08T15:48:25.817937483Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-kp7pn namespace
2026-06-08T15:48:25.823543179Z INFO: Node performance data collection complete.
2026-06-08T15:48:25.962847325Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-08T15:48:27.351541896Z Gathering data for ns/openshift-host-network...
2026-06-08T15:48:27.676094148Z Gathering data for ns/openshift-network-diagnostics...
2026-06-08T15:48:28.253337089Z Gathering data for ns/openshift-network-node-identity...
2026-06-08T15:48:28.769970118Z Gathering data for ns/openshift-network-operator...
2026-06-08T15:48:29.215921752Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-08T15:48:29.544186048Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-08T15:48:30.103206137Z Gathering data for ns/openshift-apiserver-operator...
2026-06-08T15:48:30.411335118Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-08T15:48:30.413367826Z Gathering data for ns/openshift-apiserver...
2026-06-08T15:48:30.808479955Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-08T15:48:31.112745008Z Gathering data for ns/openshift-controller-manager...
2026-06-08T15:48:31.435840847Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-08T15:48:32.131342803Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-08T15:48:32.412247693Z Gathering data for ns/openshift-service-ca-operator...
2026-06-08T15:48:32.748249160Z Gathering data for ns/openshift-service-ca...
2026-06-08T15:48:33.172340857Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-08T15:48:34.070536634Z Wrote inspect data to must-gather.
2026-06-08T15:48:34.070597485Z error: inspection completed with the errors occurred while gathering data:
2026-06-08T15:48:34.070597485Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-08T15:48:34.194489346Z error: the server doesn't have a resource type "clusters"
2026-06-08T15:48:34.289719474Z Caches written to disk