2026-09-07T03:04:34.252362589Z [disk usage checker] Started
2026-09-07T03:04:34.255851300Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-07T03:04:34.450090463Z Gathering data for ns/openshift-cluster-version...
2026-09-07T03:04:34.596778780Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-07T03:04:34.687064904Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-07T03:04:34.774008004Z Gathering data for ns/default...
2026-09-07T03:04:35.060317721Z Gathering data for ns/openshift...
2026-09-07T03:04:35.473986395Z Gathering data for ns/kube-system...
2026-09-07T03:04:36.279507852Z Gathering data for ns/openshift-etcd...
2026-09-07T03:04:36.603365920Z Wrote inspect data to must-gather.
2026-09-07T03:04:36.603399429Z error: inspection completed with the errors occurred while gathering data:
2026-09-07T03:04:36.603399429Z     namespaces "assisted-installer" not found
2026-09-07T03:04:36.790003313Z Waiting on subprocesses to finish execution.
2026-09-07T03:04:36.802474169Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-07T03:04:36.804318935Z INFO: Gathering HAProxy config files
2026-09-07T03:04:36.804563831Z Executing Istio gather script
2026-09-07T03:04:36.812778366Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-07T03:04:36.813894078Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-07T03:04:36.822211710Z INFO: Collecting host service logs for crio
2026-09-07T03:04:36.822557911Z INFO: Collecting host service logs for kubelet
2026-09-07T03:04:36.822963051Z INFO: Collecting host service logs for rpm-ostreed
2026-09-07T03:04:36.823302485Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-07T03:04:36.823650169Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-07T03:04:36.823992645Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-07T03:04:36.824333815Z INFO: Collecting host service logs for NetworkManager
2026-09-07T03:04:36.824667834Z INFO: Collecting host service logs for openvswitch
2026-09-07T03:04:36.825014442Z INFO: Collecting host service logs for ovs-configuration
2026-09-07T03:04:36.825368334Z INFO: Collecting host service logs for ovsdb-server
2026-09-07T03:04:36.825856060Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-07T03:04:36.826258586Z INFO: Waiting for worker host service log collection to complete ...
2026-09-07T03:04:36.849573444Z INFO: Waiting for node performance related collection to complete ...
2026-09-07T03:04:37.251459857Z No resources found in openshift-etcd namespace.
2026-09-07T03:04:37.477273021Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-07T03:04:37.679886907Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-07T03:04:37.788502374Z INFO: "metallb-operator" not detected. Skipping.
2026-09-07T03:04:37.937437090Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-07T03:04:37.937477476Z INFO: on-disk MachineConfig config collection complete.
2026-09-07T03:04:37.991428908Z No resources found
2026-09-07T03:04:38.028703268Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-07T03:04:38.039942476Z INFO: Collecting Insights Archives from insights-operator-76bcd6ccf5-dk4kr
2026-09-07T03:04:38.039981242Z insights-runtime-extractor-6d55d
2026-09-07T03:04:38.040012820Z insights-runtime-extractor-bbshg
2026-09-07T03:04:38.040031621Z insights-runtime-extractor-zhfrt
2026-09-07T03:04:38.108104820Z error: the server doesn't have a resource type "performanceprofile"
2026-09-07T03:04:38.117709333Z INFO: Worker host service log collection to complete.
2026-09-07T03:04:38.129741917Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-07T03:04:38.224715060Z Wrote inspect data to must-gather.
2026-09-07T03:04:38.546018679Z Wrote inspect data to must-gather.
2026-09-07T03:04:38.629728256Z ERROR: No running kube-apiserver pods found
2026-09-07T03:04:38.720845638Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-07T03:04:38.720845638Z See 'oc rsync -h' for help and examples
2026-09-07T03:04:38.780718832Z Wrote inspect data to must-gather.
2026-09-07T03:04:38.847644627Z Wrote inspect data to must-gather.
2026-09-07T03:04:38.896298611Z No resources found
2026-09-07T03:04:39.030755078Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-07T03:04:39.047693003Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-07T03:04:39.061959232Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-07T03:04:39.100640886Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-07T03:04:39.117066825Z INFO: 'previous-logs' folder not found on ip-10-0-131-69.ec2.internal, skipping...
2026-09-07T03:04:39.129816211Z Wrote inspect data to must-gather.
2026-09-07T03:04:39.144509746Z Wrote inspect data to must-gather.
2026-09-07T03:04:39.236573720Z Wrote inspect data to must-gather.
2026-09-07T03:04:39.267598499Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-07T03:04:39.354343101Z Gathering data for ns/openshift-monitoring...
2026-09-07T03:04:39.404133340Z error: the server doesn't have a resource type "machineconfigs"
2026-09-07T03:04:39.486643237Z tar: Removing leading `/' from member names
2026-09-07T03:04:39.492730323Z INFO: HAProxy config collection complete.
2026-09-07T03:04:39.503551219Z INFO: 'previous-logs' folder not found on ip-10-0-139-11.ec2.internal, skipping...
2026-09-07T03:04:39.511871136Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-07T03:04:39.585400996Z Wrote inspect data to must-gather.
2026-09-07T03:04:39.587276243Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-07T03:04:39.651819901Z INFO: Getting rules from prometheus-k8s-0
2026-09-07T03:04:39.770913333Z INFO: 'previous-logs' folder not found on ip-10-0-142-86.ec2.internal, skipping...
2026-09-07T03:04:39.770963673Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-07T03:04:39.771007904Z INFO: Machine Config Daemon termination log collection complete.
2026-09-07T03:04:39.818902451Z Wrote inspect data to must-gather.
2026-09-07T03:04:39.845040164Z Wrote inspect data to must-gather.
2026-09-07T03:04:39.966568040Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-07T03:04:40.069621630Z INFO: Getting status/config from prometheus-k8s-0
2026-09-07T03:04:40.106626666Z Wrote inspect data to must-gather.
2026-09-07T03:04:40.194797660Z Wrote inspect data to must-gather.
2026-09-07T03:04:40.379794253Z INFO: INTERCONNECT MODE
2026-09-07T03:04:40.379827540Z INFO: Gathering ovn-kubernetes DBs
2026-09-07T03:04:40.399340992Z Wrote inspect data to must-gather.
2026-09-07T03:04:40.529363613Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-07T03:04:40.540546098Z INFO: Gathering OVN_Northbound from ovnkube-node-4gpzk...
2026-09-07T03:04:40.540882955Z INFO: Gathering OVN_Northbound from ovnkube-node-h4gvj...
2026-09-07T03:04:40.541105764Z INFO: Gathering OVN_Northbound from ovnkube-node-j464t...
2026-09-07T03:04:40.541373212Z INFO: Gathering OVN_Southbound from ovnkube-node-4gpzk...
2026-09-07T03:04:40.541642820Z INFO: Gathering OVN_Southbound from ovnkube-node-h4gvj...
2026-09-07T03:04:40.541988378Z INFO: Gathering OVN_Southbound from ovnkube-node-j464t...
2026-09-07T03:04:40.659357411Z Wrote inspect data to must-gather.
2026-09-07T03:04:40.810843440Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-07T03:04:40.879060071Z tar: Removing leading `/' from member names
2026-09-07T03:04:40.924574313Z tar: Removing leading `/' from member names
2026-09-07T03:04:40.949239015Z tar: Removing leading `/' from member names
2026-09-07T03:04:40.959030020Z tar: Removing leading `/' from member names
2026-09-07T03:04:40.970544534Z Wrote inspect data to must-gather.
2026-09-07T03:04:40.978780546Z tar: Removing leading `/' from member names
2026-09-07T03:04:40.984909485Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-07T03:04:40.990843656Z tar: Removing leading `/' from member names
2026-09-07T03:04:41.005818886Z Wrote inspect data to /must-gather/istio.
2026-09-07T03:04:41.206404030Z Wrote inspect data to must-gather.
2026-09-07T03:04:41.234622312Z Wrote inspect data to /must-gather/istio.
2026-09-07T03:04:41.237562278Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-07T03:04:41.269800831Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-07T03:04:41.320674054Z INFO: Waiting for network log collection to complete ...
2026-09-07T03:04:41.320711391Z INFO: Waiting for ovnk database copies to complete ...
2026-09-07T03:04:41.322184493Z INFO: Copying ovnk databases complete.
2026-09-07T03:04:41.323826240Z 2.7M	must-gather/network_logs/ovnk_database_store
2026-09-07T03:04:41.326059400Z ovnk_database_store/
2026-09-07T03:04:41.326103397Z ovnk_database_store/ovnkube-node-j464t_sbdb
2026-09-07T03:04:41.342617465Z ovnk_database_store/ovnkube-node-h4gvj_nbdb
2026-09-07T03:04:41.349092686Z ovnk_database_store/ovnkube-node-h4gvj_sbdb
2026-09-07T03:04:41.367920978Z ovnk_database_store/ovnkube-node-4gpzk_nbdb
2026-09-07T03:04:41.373455219Z ovnk_database_store/ovnkube-node-j464t_nbdb
2026-09-07T03:04:41.382031700Z ovnk_database_store/ovnkube-node-4gpzk_sbdb
2026-09-07T03:04:41.400265287Z INFO: Network log collection complete.
2026-09-07T03:04:41.426081574Z Wrote inspect data to must-gather.
2026-09-07T03:04:41.441493413Z Wrote inspect data to /must-gather/istio.
2026-09-07T03:04:41.540595808Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-07T03:04:41.618396285Z Wrote inspect data to must-gather.
2026-09-07T03:04:41.637127871Z Wrote inspect data to /must-gather/istio.
2026-09-07T03:04:41.640419581Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-07T03:04:41.835061697Z Wrote inspect data to /must-gather/istio.
2026-09-07T03:04:41.867747897Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-07T03:04:41.871309814Z INFO: Fallback to identify the container image from release info
2026-09-07T03:04:42.003617107Z INFO: Getting status from alertmanager-main-0
2026-09-07T03:04:42.068199682Z Wrote inspect data to /must-gather/istio.
2026-09-07T03:04:42.072780196Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-07T03:04:42.166685520Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-07T03:04:42.284837303Z Wrote inspect data to /must-gather/istio.
2026-09-07T03:04:42.452515956Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f39c1daa89e19c5e987a3b759e646ffab6c1b2ab94a97ded81ddf13e73d0399
2026-09-07T03:04:42.486006021Z Wrote inspect data to /must-gather/istio.
2026-09-07T03:04:42.488114240Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-07T03:04:42.600243922Z daemonset.apps/perf-node-gather-daemonset created
2026-09-07T03:04:42.663196641Z Wrote inspect data to /must-gather/istio.
2026-09-07T03:04:42.733584262Z Waiting for performance profile collector pods to become ready: 1
2026-09-07T03:04:42.845508997Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-07T03:04:42.850536437Z Wrote inspect data to /must-gather/istio.
2026-09-07T03:04:43.045304004Z Gathering data for ns/openshift-network-console...
2026-09-07T03:04:43.516083341Z Done executing Istio gather script
2026-09-07T03:04:43.651540711Z Gathering data for ns/openshift-console-operator...
2026-09-07T03:04:43.836221206Z Waiting for performance profile collector pods to become ready: 2
2026-09-07T03:04:44.106655452Z Gathering data for ns/openshift-console...
2026-09-07T03:04:44.273370670Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-07T03:04:44.765133054Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-07T03:04:44.951077832Z Waiting for performance profile collector pods to become ready: 3
2026-09-07T03:04:45.354680935Z Gathering data for ns/openshift-dns-operator...
2026-09-07T03:04:45.682862628Z Gathering data for ns/openshift-dns...
2026-09-07T03:04:46.049633485Z Waiting for performance profile collector pods to become ready: 4
2026-09-07T03:04:46.536002976Z Gathering data for ns/openshift-image-registry...
2026-09-07T03:04:47.161064913Z Waiting for performance profile collector pods to become ready: 5
2026-09-07T03:04:47.179896153Z Gathering data for ns/openshift-ingress-operator...
2026-09-07T03:04:47.590122944Z Gathering data for ns/openshift-ingress...
2026-09-07T03:04:48.056778119Z Gathering data for ns/openshift-ingress-canary...
2026-09-07T03:04:48.273843071Z Waiting for performance profile collector pods to become ready: 6
2026-09-07T03:04:48.646860401Z Gathering data for ns/openshift-insights...
2026-09-07T03:04:49.278073084Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-07T03:04:49.373483150Z Waiting for performance profile collector pods to become ready: 7
2026-09-07T03:04:50.488365955Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-07T03:04:50.739360721Z Collecting performance related data for node ip-10-0-139-11.ec2.internal
2026-09-07T03:04:50.746020335Z Collecting performance related data for node ip-10-0-142-86.ec2.internal
2026-09-07T03:04:50.752962722Z Collecting performance related data for node ip-10-0-131-69.ec2.internal
2026-09-07T03:04:51.081860433Z Gathering data for ns/openshift-jobset-operator...
2026-09-07T03:04:52.146848408Z Gathering data for ns/openshift-config...
2026-09-07T03:04:52.605594892Z Gathering data for ns/openshift-config-managed...
2026-09-07T03:04:53.168168778Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-07T03:04:53.535514138Z Gathering data for ns/openshift-kube-apiserver...
2026-09-07T03:04:53.916023968Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-07T03:04:54.283429096Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-07T03:04:54.305806796Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-07T03:04:54.678021112Z Gathering data for ns/openshift-kube-scheduler...
2026-09-07T03:04:54.962834177Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-07T03:04:55.346739237Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-07T03:04:55.722719519Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-07T03:04:56.064974085Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-07T03:04:56.569322699Z Gathering data for ns/openshift-multus...
2026-09-07T03:04:58.303050865Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-07T03:04:58.898835558Z Collecting kubelet logs for node ip-10-0-139-11.ec2.internal
2026-09-07T03:04:58.900486126Z Collecting kubelet logs for node ip-10-0-142-86.ec2.internal
2026-09-07T03:04:58.902424497Z Collecting kubelet logs for node ip-10-0-131-69.ec2.internal
2026-09-07T03:04:59.231615431Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-jgfq8 namespace
2026-09-07T03:04:59.239410965Z INFO: Node performance data collection complete.
2026-09-07T03:04:59.289937292Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-07T03:04:59.595397528Z Gathering data for ns/openshift-host-network...
2026-09-07T03:04:59.898122239Z Gathering data for ns/openshift-network-diagnostics...
2026-09-07T03:05:00.455892904Z Gathering data for ns/openshift-network-node-identity...
2026-09-07T03:05:00.872675377Z Gathering data for ns/openshift-network-operator...
2026-09-07T03:05:01.284694433Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-07T03:05:01.652743922Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-07T03:05:02.202997804Z Gathering data for ns/openshift-apiserver-operator...
2026-09-07T03:05:02.521371800Z Gathering data for ns/openshift-apiserver...
2026-09-07T03:05:02.935673417Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-07T03:05:03.232054928Z Gathering data for ns/openshift-controller-manager...
2026-09-07T03:05:03.530321370Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-07T03:05:04.194587384Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-07T03:05:04.294856931Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-07T03:05:04.495190196Z Gathering data for ns/openshift-service-ca-operator...
2026-09-07T03:05:04.841488807Z Gathering data for ns/openshift-service-ca...
2026-09-07T03:05:05.262786709Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-07T03:05:06.209090643Z Wrote inspect data to must-gather.
2026-09-07T03:05:06.209134812Z error: inspection completed with the errors occurred while gathering data:
2026-09-07T03:05:06.209134812Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-07T03:05:06.328899592Z error: the server doesn't have a resource type "clusters"
2026-09-07T03:05:06.465752555Z Caches written to disk