2026-09-18T03:28:15.296041759Z [disk usage checker] Started
2026-09-18T03:28:15.299560914Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-18T03:28:15.495452397Z Gathering data for ns/openshift-cluster-version...
2026-09-18T03:28:15.632392854Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-18T03:28:15.742511957Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-18T03:28:15.841943016Z Gathering data for ns/default...
2026-09-18T03:28:16.153890671Z Gathering data for ns/openshift...
2026-09-18T03:28:16.549768157Z Gathering data for ns/kube-system...
2026-09-18T03:28:17.326953673Z Gathering data for ns/openshift-etcd...
2026-09-18T03:28:17.637947457Z Wrote inspect data to must-gather.
2026-09-18T03:28:17.637981063Z error: inspection completed with the errors occurred while gathering data:
2026-09-18T03:28:17.637981063Z     namespaces "assisted-installer" not found
2026-09-18T03:28:17.824655956Z Waiting on subprocesses to finish execution.
2026-09-18T03:28:17.835053973Z INFO: Collecting host service logs for crio
2026-09-18T03:28:17.835626744Z INFO: Collecting host service logs for kubelet
2026-09-18T03:28:17.835970670Z INFO: Collecting host service logs for rpm-ostreed
2026-09-18T03:28:17.836289435Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-18T03:28:17.836636808Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-18T03:28:17.836977562Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-18T03:28:17.837344467Z INFO: Collecting host service logs for NetworkManager
2026-09-18T03:28:17.837690747Z INFO: Collecting host service logs for openvswitch
2026-09-18T03:28:17.838020390Z INFO: Collecting host service logs for ovs-configuration
2026-09-18T03:28:17.838409428Z INFO: Collecting host service logs for ovsdb-server
2026-09-18T03:28:17.838755768Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-18T03:28:17.839145836Z INFO: Waiting for worker host service log collection to complete ...
2026-09-18T03:28:17.841503211Z INFO: Gathering HAProxy config files
2026-09-18T03:28:17.850031051Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-18T03:28:17.852193213Z Executing Istio gather script
2026-09-18T03:28:17.867232032Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-18T03:28:17.889523477Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-18T03:28:17.951770687Z INFO: Waiting for node performance related collection to complete ...
2026-09-18T03:28:18.320224700Z INFO: "metallb-operator" not detected. Skipping.
2026-09-18T03:28:18.459620285Z INFO: Collecting Insights Archives from insights-operator-6f9c644dd9-vkr82
2026-09-18T03:28:18.459676694Z insights-runtime-extractor-2hm5z
2026-09-18T03:28:18.459696708Z insights-runtime-extractor-xf5wm
2026-09-18T03:28:18.459716542Z insights-runtime-extractor-zkghc
2026-09-18T03:28:18.555562900Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-18T03:28:18.754909972Z error: the server doesn't have a resource type "performanceprofile"
2026-09-18T03:28:18.764752381Z No resources found
2026-09-18T03:28:18.789649051Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-18T03:28:18.789717482Z INFO: on-disk MachineConfig config collection complete.
2026-09-18T03:28:18.861169566Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-18T03:28:18.861169566Z See 'oc rsync -h' for help and examples
2026-09-18T03:28:18.957186514Z No resources found in openshift-etcd namespace.
2026-09-18T03:28:19.091592654Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-18T03:28:19.194778292Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-18T03:28:19.290251015Z INFO: Worker host service log collection to complete.
2026-09-18T03:28:19.382741361Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-18T03:28:19.481067372Z Wrote inspect data to must-gather.
2026-09-18T03:28:19.586500288Z Wrote inspect data to must-gather.
2026-09-18T03:28:19.728685786Z Gathering data for ns/openshift-monitoring...
2026-09-18T03:28:19.783538909Z ERROR: No running kube-apiserver pods found
2026-09-18T03:28:19.884164242Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-18T03:28:19.903908858Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-18T03:28:19.969556031Z Wrote inspect data to must-gather.
2026-09-18T03:28:20.085766927Z Wrote inspect data to must-gather.
2026-09-18T03:28:20.103335667Z error: the server doesn't have a resource type "machineconfigs"
2026-09-18T03:28:20.195473492Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-18T03:28:20.214858271Z No resources found
2026-09-18T03:28:20.235831649Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-18T03:28:20.305346621Z Wrote inspect data to must-gather.
2026-09-18T03:28:20.305952805Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-18T03:28:20.343456646Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-18T03:28:20.392359493Z Wrote inspect data to must-gather.
2026-09-18T03:28:20.411292786Z Wrote inspect data to must-gather.
2026-09-18T03:28:20.439239555Z INFO: 'previous-logs' folder not found on ip-10-0-129-90.ec2.internal, skipping...
2026-09-18T03:28:20.448957124Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-18T03:28:20.550064354Z INFO: HAProxy config collection complete.
2026-09-18T03:28:20.645660307Z INFO: Getting rules from prometheus-k8s-0
2026-09-18T03:28:20.689393125Z Wrote inspect data to must-gather.
2026-09-18T03:28:20.693994582Z Wrote inspect data to must-gather.
2026-09-18T03:28:20.702557807Z INFO: 'previous-logs' folder not found on ip-10-0-131-235.ec2.internal, skipping...
2026-09-18T03:28:20.843423300Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-18T03:28:20.952931594Z INFO: 'previous-logs' folder not found on ip-10-0-138-16.ec2.internal, skipping...
2026-09-18T03:28:20.952962754Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-18T03:28:20.952995487Z INFO: Machine Config Daemon termination log collection complete.
2026-09-18T03:28:20.953029811Z Wrote inspect data to must-gather.
2026-09-18T03:28:21.059603584Z Wrote inspect data to must-gather.
2026-09-18T03:28:21.081540488Z INFO: Getting status/config from prometheus-k8s-0
2026-09-18T03:28:21.209000481Z Wrote inspect data to must-gather.
2026-09-18T03:28:21.270294804Z Wrote inspect data to must-gather.
2026-09-18T03:28:21.502682998Z Wrote inspect data to must-gather.
2026-09-18T03:28:21.503736580Z INFO: INTERCONNECT MODE
2026-09-18T03:28:21.503760241Z INFO: Gathering ovn-kubernetes DBs
2026-09-18T03:28:21.513123517Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-18T03:28:21.565495824Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-18T03:28:21.684483705Z INFO: Gathering OVN_Northbound from ovnkube-node-knw42...
2026-09-18T03:28:21.684740966Z INFO: Gathering OVN_Northbound from ovnkube-node-r58vq...
2026-09-18T03:28:21.684958630Z INFO: Gathering OVN_Northbound from ovnkube-node-s8m7g...
2026-09-18T03:28:21.685451159Z INFO: Gathering OVN_Southbound from ovnkube-node-knw42...
2026-09-18T03:28:21.685745043Z INFO: Gathering OVN_Southbound from ovnkube-node-r58vq...
2026-09-18T03:28:21.686010709Z INFO: Gathering OVN_Southbound from ovnkube-node-s8m7g...
2026-09-18T03:28:21.716115951Z Wrote inspect data to must-gather.
2026-09-18T03:28:21.778447217Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-18T03:28:21.990856599Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-18T03:28:22.003793986Z tar: Removing leading `/' from member names
2026-09-18T03:28:22.024507744Z tar: Removing leading `/' from member names
2026-09-18T03:28:22.056672734Z tar: Removing leading `/' from member names
2026-09-18T03:28:22.071949039Z tar: Removing leading `/' from member names
2026-09-18T03:28:22.100511366Z tar: Removing leading `/' from member names
2026-09-18T03:28:22.126822567Z tar: Removing leading `/' from member names
2026-09-18T03:28:22.127693345Z Wrote inspect data to must-gather.
2026-09-18T03:28:22.187254806Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-18T03:28:22.218174171Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:28:22.358071206Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-18T03:28:22.459205306Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-18T03:28:22.475285499Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:28:22.480120585Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-18T03:28:22.493320443Z Wrote inspect data to must-gather.
2026-09-18T03:28:22.554847676Z INFO: Waiting for network log collection to complete ...
2026-09-18T03:28:22.554907580Z INFO: Waiting for ovnk database copies to complete ...
2026-09-18T03:28:22.555462071Z INFO: Copying ovnk databases complete.
2026-09-18T03:28:22.557791171Z 2.8M	must-gather/network_logs/ovnk_database_store
2026-09-18T03:28:22.564947113Z ovnk_database_store/
2026-09-18T03:28:22.564947113Z ovnk_database_store/ovnkube-node-r58vq_sbdb
2026-09-18T03:28:22.574477223Z Gathering data for ns/openshift-network-console...
2026-09-18T03:28:22.588902642Z ovnk_database_store/ovnkube-node-s8m7g_nbdb
2026-09-18T03:28:22.595552369Z ovnk_database_store/ovnkube-node-r58vq_nbdb
2026-09-18T03:28:22.602430037Z ovnk_database_store/ovnkube-node-knw42_nbdb
2026-09-18T03:28:22.609405739Z ovnk_database_store/ovnkube-node-s8m7g_sbdb
2026-09-18T03:28:22.629220308Z ovnk_database_store/ovnkube-node-knw42_sbdb
2026-09-18T03:28:22.650112792Z INFO: Network log collection complete.
2026-09-18T03:28:22.720107177Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:28:22.800659376Z Wrote inspect data to must-gather.
2026-09-18T03:28:22.838023769Z INFO: Getting status from alertmanager-main-0
2026-09-18T03:28:22.916558960Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:28:22.920553778Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-18T03:28:23.087445904Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-18T03:28:23.090009508Z INFO: Fallback to identify the container image from release info
2026-09-18T03:28:23.109993204Z Gathering data for ns/openshift-console-operator...
2026-09-18T03:28:23.138225309Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:28:23.331597313Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:28:23.334002651Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-18T03:28:23.507588750Z Gathering data for ns/openshift-console...
2026-09-18T03:28:23.534137938Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:28:23.716143008Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea
2026-09-18T03:28:23.732529645Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:28:23.734705652Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-18T03:28:23.831042547Z daemonset.apps/perf-node-gather-daemonset created
2026-09-18T03:28:23.898735844Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:28:23.970048646Z Waiting for performance profile collector pods to become ready: 1
2026-09-18T03:28:24.050245155Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-18T03:28:24.089912423Z Wrote inspect data to /must-gather/istio.
2026-09-18T03:28:24.596537791Z Gathering data for ns/openshift-dns-operator...
2026-09-18T03:28:24.773753916Z Done executing Istio gather script
2026-09-18T03:28:24.988828027Z Gathering data for ns/openshift-dns...
2026-09-18T03:28:25.074503951Z Waiting for performance profile collector pods to become ready: 2
2026-09-18T03:28:25.360792380Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-18T03:28:25.645241670Z Gathering data for ns/openshift-image-registry...
2026-09-18T03:28:26.195903494Z Waiting for performance profile collector pods to become ready: 3
2026-09-18T03:28:26.220118033Z Gathering data for ns/openshift-ingress-operator...
2026-09-18T03:28:26.597684406Z Gathering data for ns/openshift-ingress...
2026-09-18T03:28:26.957939016Z Gathering data for ns/openshift-ingress-canary...
2026-09-18T03:28:27.318183270Z Waiting for performance profile collector pods to become ready: 4
2026-09-18T03:28:27.380201421Z Gathering data for ns/openshift-insights...
2026-09-18T03:28:28.420820069Z Waiting for performance profile collector pods to become ready: 5
2026-09-18T03:28:29.271253983Z Gathering data for ns/openshift-jobset-operator...
2026-09-18T03:28:29.533975432Z Waiting for performance profile collector pods to become ready: 6
2026-09-18T03:28:30.080541344Z Gathering data for ns/openshift-config...
2026-09-18T03:28:30.366121985Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-18T03:28:30.400826226Z Gathering data for ns/openshift-config-managed...
2026-09-18T03:28:30.650171277Z Waiting for performance profile collector pods to become ready: 7
2026-09-18T03:28:30.868878632Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-18T03:28:31.186058529Z Gathering data for ns/openshift-kube-apiserver...
2026-09-18T03:28:31.558496489Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-18T03:28:31.742223842Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-18T03:28:31.935406239Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-18T03:28:32.002769071Z Collecting performance related data for node ip-10-0-129-90.ec2.internal
2026-09-18T03:28:32.013613703Z Collecting performance related data for node ip-10-0-138-16.ec2.internal
2026-09-18T03:28:32.021322613Z Collecting performance related data for node ip-10-0-131-235.ec2.internal
2026-09-18T03:28:32.282565831Z Gathering data for ns/openshift-kube-scheduler...
2026-09-18T03:28:32.616612137Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-18T03:28:33.012070063Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-18T03:28:33.426616538Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-18T03:28:33.749877198Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-18T03:28:34.223572182Z Gathering data for ns/openshift-multus...
2026-09-18T03:28:35.371167623Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-18T03:28:35.880741723Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-18T03:28:37.532650593Z Gathering data for ns/openshift-host-network...
2026-09-18T03:28:37.848488631Z Gathering data for ns/openshift-network-diagnostics...
2026-09-18T03:28:38.399675614Z Gathering data for ns/openshift-network-node-identity...
2026-09-18T03:28:38.823766735Z Gathering data for ns/openshift-network-operator...
2026-09-18T03:28:39.231265315Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-18T03:28:39.497145167Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-18T03:28:40.010689393Z Gathering data for ns/openshift-apiserver-operator...
2026-09-18T03:28:40.017599911Z Collecting kubelet logs for node ip-10-0-129-90.ec2.internal
2026-09-18T03:28:40.020339212Z Collecting kubelet logs for node ip-10-0-138-16.ec2.internal
2026-09-18T03:28:40.022711545Z Collecting kubelet logs for node ip-10-0-131-235.ec2.internal
2026-09-18T03:28:40.365670244Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-nwskp namespace
2026-09-18T03:28:40.370356964Z INFO: Node performance data collection complete.
2026-09-18T03:28:40.375827805Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-18T03:28:40.426662857Z Gathering data for ns/openshift-apiserver...
2026-09-18T03:28:40.841727309Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-18T03:28:41.115685770Z Gathering data for ns/openshift-controller-manager...
2026-09-18T03:28:41.438065986Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-18T03:28:42.107080291Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-18T03:28:42.465506420Z Gathering data for ns/openshift-service-ca-operator...
2026-09-18T03:28:42.829128434Z Gathering data for ns/openshift-service-ca...
2026-09-18T03:28:43.209632196Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-18T03:28:44.061015933Z Wrote inspect data to must-gather.
2026-09-18T03:28:44.061057015Z error: inspection completed with the errors occurred while gathering data:
2026-09-18T03:28:44.061057015Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-18T03:28:44.178145820Z error: the server doesn't have a resource type "clusters"
2026-09-18T03:28:44.303683207Z Caches written to disk