2026-05-25T14:10:13.929680148Z [disk usage checker] Started
2026-05-25T14:10:13.933674646Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-05-25T14:10:14.151333330Z Gathering data for ns/openshift-cluster-version...
2026-05-25T14:10:14.309805342Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-05-25T14:10:14.407101152Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-25T14:10:14.504786647Z Gathering data for ns/default...
2026-05-25T14:10:14.853204065Z Gathering data for ns/openshift...
2026-05-25T14:10:15.313373999Z Gathering data for ns/kube-system...
2026-05-25T14:10:16.050428327Z Gathering data for ns/openshift-etcd...
2026-05-25T14:10:16.407824325Z Wrote inspect data to must-gather.
2026-05-25T14:10:16.407864289Z error: inspection completed with the errors occurred while gathering data:
2026-05-25T14:10:16.407864289Z     namespaces "assisted-installer" not found
2026-05-25T14:10:16.654706449Z Waiting on subprocesses to finish execution.
2026-05-25T14:10:16.660475298Z INFO: Gathering machine config daemon's old logs from all nodes
2026-05-25T14:10:16.664071800Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-05-25T14:10:16.685117330Z INFO: Collecting host service logs for crio
2026-05-25T14:10:16.685476143Z INFO: Collecting host service logs for kubelet
2026-05-25T14:10:16.685872101Z INFO: Collecting host service logs for rpm-ostreed
2026-05-25T14:10:16.686223051Z INFO: Collecting host service logs for ostree-finalize-staged
2026-05-25T14:10:16.686600972Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-05-25T14:10:16.687078128Z INFO: Collecting host service logs for machine-config-daemon-host
2026-05-25T14:10:16.687469968Z INFO: Collecting host service logs for NetworkManager
2026-05-25T14:10:16.687792622Z INFO: Collecting host service logs for openvswitch
2026-05-25T14:10:16.688106119Z INFO: Collecting host service logs for ovs-configuration
2026-05-25T14:10:16.688434104Z INFO: Collecting host service logs for ovsdb-server
2026-05-25T14:10:16.688746789Z INFO: Collecting host service logs for ovs-vswitchd
2026-05-25T14:10:16.689176270Z INFO: Waiting for worker host service log collection to complete ...
2026-05-25T14:10:16.694237683Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-05-25T14:10:16.706136573Z INFO: Gathering HAProxy config files
2026-05-25T14:10:16.711896710Z INFO: Waiting for node performance related collection to complete ...
2026-05-25T14:10:17.421596162Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-05-25T14:10:17.478236782Z INFO: Collecting Insights Archives from insights-operator-78bdfb888c-sqk9d
2026-05-25T14:10:17.478292072Z insights-runtime-extractor-glgst
2026-05-25T14:10:17.478314218Z insights-runtime-extractor-hlx8q
2026-05-25T14:10:17.478335338Z insights-runtime-extractor-n7bht
2026-05-25T14:10:17.711252530Z INFO: "metallb-operator" not detected. Skipping.
2026-05-25T14:10:17.717035932Z Wrote inspect data to must-gather.
2026-05-25T14:10:17.895016254Z error: the server doesn't have a resource type "performanceprofile"
2026-05-25T14:10:18.008505279Z INFO: "sriov-network-operator" not detected. Skipping.
2026-05-25T14:10:18.054763179Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-05-25T14:10:18.054763179Z See 'oc rsync -h' for help and examples
2026-05-25T14:10:18.057106451Z INFO: Waiting for HAProxy config collection to complete ...
2026-05-25T14:10:18.207629407Z INFO: Found 1 replicas - prometheus-k8s-0
2026-05-25T14:10:18.243720274Z No resources found in openshift-etcd namespace.
2026-05-25T14:10:18.453000244Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-05-25T14:10:18.493383553Z INFO: Worker host service log collection to complete.
2026-05-25T14:10:18.501694476Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-05-25T14:10:18.501822229Z INFO: on-disk MachineConfig config collection complete.
2026-05-25T14:10:18.575827176Z No resources found
2026-05-25T14:10:18.906173317Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-05-25T14:10:19.014368471Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-05-25T14:10:19.081163150Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-05-25T14:10:19.147995860Z Wrote inspect data to must-gather.
2026-05-25T14:10:19.182287870Z ERROR: No running kube-apiserver pods found
2026-05-25T14:10:19.345789103Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-25T14:10:19.349236478Z tar: Removing leading `/' from member names
2026-05-25T14:10:19.357133928Z INFO: HAProxy config collection complete.
2026-05-25T14:10:19.367447734Z Wrote inspect data to must-gather.
2026-05-25T14:10:19.380202593Z Gathering data for ns/kuadrant-system...
2026-05-25T14:10:19.612689488Z INFO: 'previous-logs' folder not found on ip-10-0-129-151.ec2.internal, skipping...
2026-05-25T14:10:19.633188597Z No resources found
2026-05-25T14:10:19.695328654Z Wrote inspect data to must-gather.
2026-05-25T14:10:19.709544281Z Wrote inspect data to must-gather.
2026-05-25T14:10:19.736383785Z error: the server doesn't have a resource type "machineconfigs"
2026-05-25T14:10:19.813067843Z Wrote inspect data to must-gather.
2026-05-25T14:10:19.949584623Z INFO: Getting rules from prometheus-k8s-0
2026-05-25T14:10:20.085421208Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-05-25T14:10:20.103597388Z Wrote inspect data to must-gather.
2026-05-25T14:10:20.129417867Z INFO: 'previous-logs' folder not found on ip-10-0-135-71.ec2.internal, skipping...
2026-05-25T14:10:20.259987627Z Wrote inspect data to must-gather.
2026-05-25T14:10:20.445000355Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-25T14:10:20.523189088Z Wrote inspect data to must-gather.
2026-05-25T14:10:20.562593655Z INFO: Getting status/config from prometheus-k8s-0
2026-05-25T14:10:20.573055534Z INFO: 'previous-logs' folder not found on ip-10-0-143-235.ec2.internal, skipping...
2026-05-25T14:10:20.573174907Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-05-25T14:10:20.573231730Z INFO: Machine Config Daemon termination log collection complete.
2026-05-25T14:10:20.713660342Z Gathering data for ns/openshift-monitoring...
2026-05-25T14:10:20.740935165Z Wrote inspect data to must-gather.
2026-05-25T14:10:20.763693490Z error: the server doesn't have a resource type "kubeletconfigs"
2026-05-25T14:10:21.088624868Z Wrote inspect data to must-gather.
2026-05-25T14:10:21.091669310Z INFO: Getting status/flags from prometheus-k8s-0
2026-05-25T14:10:21.092382409Z Wrote inspect data to must-gather.
2026-05-25T14:10:21.378842920Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-05-25T14:10:21.437313998Z Wrote inspect data to must-gather.
2026-05-25T14:10:21.503074147Z INFO: INTERCONNECT MODE
2026-05-25T14:10:21.503154044Z INFO: Gathering ovn-kubernetes DBs
2026-05-25T14:10:21.661944582Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-05-25T14:10:21.735448658Z INFO: Gathering OVN_Northbound from ovnkube-node-684s7...
2026-05-25T14:10:21.735702321Z INFO: Gathering OVN_Northbound from ovnkube-node-vqnvc...
2026-05-25T14:10:21.736132580Z INFO: Gathering OVN_Northbound from ovnkube-node-x4vqs...
2026-05-25T14:10:21.736474447Z INFO: Gathering OVN_Southbound from ovnkube-node-684s7...
2026-05-25T14:10:21.736768432Z INFO: Gathering OVN_Southbound from ovnkube-node-vqnvc...
2026-05-25T14:10:21.737062226Z INFO: Gathering OVN_Southbound from ovnkube-node-x4vqs...
2026-05-25T14:10:21.819166406Z Wrote inspect data to must-gather.
2026-05-25T14:10:22.036814772Z tar: Removing leading `/' from member names
2026-05-25T14:10:22.083456559Z tar: Removing leading `/' from member names
2026-05-25T14:10:22.136871175Z tar: Removing leading `/' from member names
2026-05-25T14:10:22.141090232Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-05-25T14:10:22.205072035Z tar: Removing leading `/' from member names
2026-05-25T14:10:22.284410717Z tar: Removing leading `/' from member names
2026-05-25T14:10:22.284529606Z tar: Removing leading `/' from member names
2026-05-25T14:10:22.381777795Z Wrote inspect data to must-gather.
2026-05-25T14:10:22.736254499Z INFO: Getting status from alertmanager-main-0
2026-05-25T14:10:22.762136122Z Wrote inspect data to must-gather.
2026-05-25T14:10:22.871098348Z INFO: Waiting for network log collection to complete ...
2026-05-25T14:10:22.871148176Z INFO: Waiting for ovnk database copies to complete ...
2026-05-25T14:10:22.871752561Z INFO: Copying ovnk databases complete.
2026-05-25T14:10:22.873516088Z 5.0M	must-gather/network_logs/ovnk_database_store
2026-05-25T14:10:22.876014013Z ovnk_database_store/
2026-05-25T14:10:22.876085144Z ovnk_database_store/ovnkube-node-684s7_nbdb
2026-05-25T14:10:22.921165688Z ovnk_database_store/ovnkube-node-x4vqs_nbdb
2026-05-25T14:10:22.935601839Z ovnk_database_store/ovnkube-node-684s7_sbdb
2026-05-25T14:10:22.968079767Z ovnk_database_store/ovnkube-node-x4vqs_sbdb
2026-05-25T14:10:23.002703296Z ovnk_database_store/ovnkube-node-vqnvc_sbdb
2026-05-25T14:10:23.031937611Z ovnk_database_store/ovnkube-node-vqnvc_nbdb
2026-05-25T14:10:23.048656317Z INFO: Network log collection complete.
2026-05-25T14:10:23.077632452Z W0525 14:10:23.077565    1413 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-05-25T14:10:23.086590563Z Wrote inspect data to must-gather.
2026-05-25T14:10:23.344763130Z Gathering data for ns/openshift-network-console...
2026-05-25T14:10:23.427586500Z Wrote inspect data to must-gather.
2026-05-25T14:10:23.742541984Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-05-25T14:10:23.744974302Z INFO: Fallback to identify the container image from release info
2026-05-25T14:10:23.888224271Z Gathering data for ns/openshift-console-operator...
2026-05-25T14:10:24.070088983Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-05-25T14:10:24.371541094Z Gathering data for ns/openshift-console...
2026-05-25T14:10:24.393395358Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:934b226bb305ecfe687cdb9684d7d4cf04b130e6254c2817dd1a6112d4829bda
2026-05-25T14:10:24.548212610Z daemonset.apps/perf-node-gather-daemonset created
2026-05-25T14:10:24.659322830Z Wrote inspect data to must-gather.
2026-05-25T14:10:24.693922949Z Waiting for performance profile collector pods to become ready: 1
2026-05-25T14:10:24.889119789Z Gathering data for ns/openshift-cluster-storage-operator...
2026-05-25T14:10:25.302629818Z Gathering data for ns/openshift-dns-operator...
2026-05-25T14:10:25.622663625Z Gathering data for ns/openshift-dns...
2026-05-25T14:10:25.817449574Z Waiting for performance profile collector pods to become ready: 2
2026-05-25T14:10:26.303740504Z Gathering data for ns/openshift-image-registry...
2026-05-25T14:10:26.853512988Z Gathering data for ns/openshift-ingress-operator...
2026-05-25T14:10:26.965271449Z Waiting for performance profile collector pods to become ready: 3
2026-05-25T14:10:27.259193376Z Gathering data for ns/openshift-ingress...
2026-05-25T14:10:27.820069771Z Gathering data for ns/openshift-ingress-canary...
2026-05-25T14:10:28.099123024Z Waiting for performance profile collector pods to become ready: 4
2026-05-25T14:10:28.315078833Z Gathering data for ns/openshift-insights...
2026-05-25T14:10:29.074754279Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-05-25T14:10:29.229101485Z Waiting for performance profile collector pods to become ready: 5
2026-05-25T14:10:30.358241052Z Waiting for performance profile collector pods to become ready: 6
2026-05-25T14:10:31.174218134Z Gathering data for ns/openshift-lws-operator...
2026-05-25T14:10:31.519120868Z Waiting for performance profile collector pods to become ready: 7
2026-05-25T14:10:31.786259463Z Gathering data for ns/kserve...
2026-05-25T14:10:32.660970907Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-05-25T14:10:32.960924713Z Collecting performance related data for node ip-10-0-135-71.ec2.internal
2026-05-25T14:10:32.968112901Z Collecting performance related data for node ip-10-0-129-151.ec2.internal
2026-05-25T14:10:32.976176853Z Collecting performance related data for node ip-10-0-143-235.ec2.internal
2026-05-25T14:10:33.762305921Z Gathering data for ns/openshift-config...
2026-05-25T14:10:34.082934933Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-05-25T14:10:34.209665615Z Gathering data for ns/openshift-config-managed...
2026-05-25T14:10:34.780990431Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-05-25T14:10:35.104450874Z Gathering data for ns/openshift-kube-apiserver...
2026-05-25T14:10:35.451005273Z Gathering data for ns/openshift-kube-controller-manager...
2026-05-25T14:10:35.842629316Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-05-25T14:10:36.219775172Z Gathering data for ns/openshift-kube-scheduler...
2026-05-25T14:10:36.533743805Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-05-25T14:10:36.900844421Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-05-25T14:10:37.282523669Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-05-25T14:10:37.665302653Z Gathering data for ns/openshift-user-workload-monitoring...
2026-05-25T14:10:38.363207903Z Gathering data for ns/openshift-multus...
2026-05-25T14:10:39.088107883Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-05-25T14:10:39.939248155Z Gathering data for ns/openshift-ovn-kubernetes...
2026-05-25T14:10:41.606429784Z Gathering data for ns/openshift-host-network...
2026-05-25T14:10:41.766412462Z Collecting kubelet logs for node ip-10-0-135-71.ec2.internal
2026-05-25T14:10:41.768236943Z Collecting kubelet logs for node ip-10-0-129-151.ec2.internal
2026-05-25T14:10:41.770450334Z Collecting kubelet logs for node ip-10-0-143-235.ec2.internal
2026-05-25T14:10:42.077531943Z Gathering data for ns/openshift-network-diagnostics...
2026-05-25T14:10:42.174300332Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-05-25T14:10:42.179251939Z INFO: Node performance data collection complete.
2026-05-25T14:10:42.695693764Z Gathering data for ns/openshift-network-node-identity...
2026-05-25T14:10:43.186132906Z Gathering data for ns/openshift-network-operator...
2026-05-25T14:10:43.595146668Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-05-25T14:10:43.888162904Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-05-25T14:10:44.092606465Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-05-25T14:10:44.371312665Z Gathering data for ns/openshift-apiserver-operator...
2026-05-25T14:10:44.727512826Z Gathering data for ns/openshift-apiserver...
2026-05-25T14:10:45.192799347Z Gathering data for ns/openshift-controller-manager-operator...
2026-05-25T14:10:45.493992218Z Gathering data for ns/openshift-controller-manager...
2026-05-25T14:10:45.816895764Z Gathering data for ns/openshift-cluster-samples-operator...
2026-05-25T14:10:46.522976530Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-05-25T14:10:46.874104417Z Gathering data for ns/openshift-service-ca-operator...
2026-05-25T14:10:47.247711785Z Gathering data for ns/openshift-service-ca...
2026-05-25T14:10:47.752526629Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-05-25T14:10:48.729781893Z Wrote inspect data to must-gather.
2026-05-25T14:10:48.729826818Z error: inspection completed with the errors occurred while gathering data:
2026-05-25T14:10:48.729826818Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-05-25T14:10:48.880771384Z error: the server doesn't have a resource type "clusters"
2026-05-25T14:10:49.033539992Z Caches written to disk