2026-06-02T15:30:04.025377674Z [disk usage checker] Started
2026-06-02T15:30:04.029005495Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-06-02T15:30:04.244547949Z Gathering data for ns/openshift-cluster-version...
2026-06-02T15:30:04.455969721Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T15:30:04.563388354Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T15:30:04.666772116Z Gathering data for ns/default...
2026-06-02T15:30:05.164306627Z Gathering data for ns/openshift...
2026-06-02T15:30:05.752775019Z Gathering data for ns/kube-system...
2026-06-02T15:30:06.557459517Z Gathering data for ns/openshift-etcd...
2026-06-02T15:30:06.625801689Z Waiting on subprocesses to finish execution.
2026-06-02T15:30:06.632366052Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-02T15:30:06.634659117Z INFO: Gathering HAProxy config files
2026-06-02T15:30:06.647074953Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-02T15:30:06.656257011Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-02T15:30:06.670567157Z INFO: Collecting host service logs for crio
2026-06-02T15:30:06.671047238Z INFO: Collecting host service logs for kubelet
2026-06-02T15:30:06.671520120Z INFO: Collecting host service logs for rpm-ostreed
2026-06-02T15:30:06.671918936Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-02T15:30:06.672250556Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-02T15:30:06.672572567Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-02T15:30:06.672909258Z INFO: Collecting host service logs for NetworkManager
2026-06-02T15:30:06.673245631Z INFO: Collecting host service logs for openvswitch
2026-06-02T15:30:06.673573281Z INFO: Collecting host service logs for ovs-configuration
2026-06-02T15:30:06.673908460Z INFO: Collecting host service logs for ovsdb-server
2026-06-02T15:30:06.674245975Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-02T15:30:06.674633733Z INFO: Waiting for worker host service log collection to complete ...
2026-06-02T15:30:06.689228678Z INFO: Waiting for node performance related collection to complete ...
2026-06-02T15:30:07.266410019Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-02T15:30:07.358534201Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-02T15:30:07.380838674Z error: the server doesn't have a resource type "performanceprofile"
2026-06-02T15:30:07.581097409Z No resources found in openshift-etcd namespace.
2026-06-02T15:30:07.799722606Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-02T15:30:07.842463428Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-02T15:30:07.842543530Z INFO: on-disk MachineConfig config collection complete.
2026-06-02T15:30:07.885586329Z No resources found
2026-06-02T15:30:08.095701657Z Wrote inspect data to must-gather.
2026-06-02T15:30:08.192953202Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-s9rmk
2026-06-02T15:30:08.192953202Z insights-runtime-extractor-64n4g
2026-06-02T15:30:08.192953202Z insights-runtime-extractor-l94c4
2026-06-02T15:30:08.192953202Z insights-runtime-extractor-w7tjj
2026-06-02T15:30:08.382621488Z Wrote inspect data to must-gather.
2026-06-02T15:30:08.382751713Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T15:30:08.382751713Z     namespaces "assisted-installer" not found
2026-06-02T15:30:08.511641623Z INFO: "metallb-operator" not detected. Skipping.
2026-06-02T15:30:08.519700709Z INFO: Worker host service log collection to complete.
2026-06-02T15:30:08.569497638Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-02T15:30:08.609295447Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-02T15:30:08.801538338Z ERROR: No running kube-apiserver pods found
2026-06-02T15:30:08.829488816Z No resources found
2026-06-02T15:30:09.044088079Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-02T15:30:09.221468970Z Wrote inspect data to must-gather.
2026-06-02T15:30:09.277190890Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-06-02T15:30:09.314966833Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T15:30:09.428969270Z Wrote inspect data to must-gather.
2026-06-02T15:30:09.449405211Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-02T15:30:09.449405211Z See 'oc rsync -h' for help and examples
2026-06-02T15:30:09.467019868Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-02T15:30:09.480350770Z Wrote inspect data to must-gather.
2026-06-02T15:30:09.633358089Z Wrote inspect data to must-gather.
2026-06-02T15:30:09.769476247Z tar: Removing leading `/' from member names
2026-06-02T15:30:09.776091993Z INFO: HAProxy config collection complete.
2026-06-02T15:30:09.778813180Z Wrote inspect data to must-gather.
2026-06-02T15:30:09.787825839Z error: the server doesn't have a resource type "machineconfigs"
2026-06-02T15:30:09.813790875Z INFO: 'previous-logs' folder not found on ip-10-0-130-221.ec2.internal, skipping...
2026-06-02T15:30:09.916641438Z INFO: Getting rules from prometheus-k8s-0
2026-06-02T15:30:10.039083320Z Gathering data for ns/kuadrant-system...
2026-06-02T15:30:10.156267805Z Wrote inspect data to must-gather.
2026-06-02T15:30:10.190842576Z INFO: 'previous-logs' folder not found on ip-10-0-131-33.ec2.internal, skipping...
2026-06-02T15:30:10.231627048Z Wrote inspect data to must-gather.
2026-06-02T15:30:10.520423857Z INFO: Getting status/config from prometheus-k8s-0
2026-06-02T15:30:10.543169112Z INFO: 'previous-logs' folder not found on ip-10-0-136-77.ec2.internal, skipping...
2026-06-02T15:30:10.543270188Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-02T15:30:10.543322052Z INFO: Machine Config Daemon termination log collection complete.
2026-06-02T15:30:10.624955677Z Wrote inspect data to must-gather.
2026-06-02T15:30:10.691255353Z Wrote inspect data to must-gather.
2026-06-02T15:30:10.919647372Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-02T15:30:11.028771037Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T15:30:11.074256752Z Wrote inspect data to must-gather.
2026-06-02T15:30:11.101797850Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-02T15:30:11.323172184Z Wrote inspect data to must-gather.
2026-06-02T15:30:11.396094508Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-02T15:30:11.561766021Z INFO: INTERCONNECT MODE
2026-06-02T15:30:11.561800144Z INFO: Gathering ovn-kubernetes DBs
2026-06-02T15:30:11.674424786Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T15:30:11.740571831Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-02T15:30:11.831083374Z Wrote inspect data to must-gather.
2026-06-02T15:30:11.838825447Z INFO: Gathering OVN_Northbound from ovnkube-node-6xmhn...
2026-06-02T15:30:11.839168757Z INFO: Gathering OVN_Northbound from ovnkube-node-cmkkg...
2026-06-02T15:30:11.839465991Z INFO: Gathering OVN_Northbound from ovnkube-node-q62qb...
2026-06-02T15:30:11.839777618Z INFO: Gathering OVN_Southbound from ovnkube-node-6xmhn...
2026-06-02T15:30:11.840103467Z INFO: Gathering OVN_Southbound from ovnkube-node-cmkkg...
2026-06-02T15:30:11.840374772Z INFO: Gathering OVN_Southbound from ovnkube-node-q62qb...
2026-06-02T15:30:11.996639687Z Gathering data for ns/openshift-monitoring...
2026-06-02T15:30:12.131955977Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-02T15:30:12.142826236Z tar: Removing leading `/' from member names
2026-06-02T15:30:12.180064332Z tar: Removing leading `/' from member names
2026-06-02T15:30:12.208644666Z tar: Removing leading `/' from member names
2026-06-02T15:30:12.303018309Z tar: Removing leading `/' from member names
2026-06-02T15:30:12.333640909Z tar: Removing leading `/' from member names
2026-06-02T15:30:12.335199393Z tar: Removing leading `/' from member names
2026-06-02T15:30:12.576220585Z Wrote inspect data to must-gather.
2026-06-02T15:30:12.719841901Z INFO: Getting status from alertmanager-main-0
2026-06-02T15:30:12.830261108Z INFO: Waiting for network log collection to complete ...
2026-06-02T15:30:12.830393699Z INFO: Waiting for ovnk database copies to complete ...
2026-06-02T15:30:12.830936807Z INFO: Copying ovnk databases complete.
2026-06-02T15:30:12.833106597Z 4.3M	must-gather/network_logs/ovnk_database_store
2026-06-02T15:30:12.836018705Z ovnk_database_store/
2026-06-02T15:30:12.836018705Z ovnk_database_store/ovnkube-node-cmkkg_sbdb
2026-06-02T15:30:12.868278634Z ovnk_database_store/ovnkube-node-q62qb_sbdb
2026-06-02T15:30:12.905824842Z ovnk_database_store/ovnkube-node-6xmhn_sbdb
2026-06-02T15:30:12.927734801Z ovnk_database_store/ovnkube-node-6xmhn_nbdb
2026-06-02T15:30:12.937444475Z ovnk_database_store/ovnkube-node-cmkkg_nbdb
2026-06-02T15:30:12.948594069Z ovnk_database_store/ovnkube-node-q62qb_nbdb
2026-06-02T15:30:12.961249088Z INFO: Network log collection complete.
2026-06-02T15:30:13.026497460Z Wrote inspect data to must-gather.
2026-06-02T15:30:13.455655307Z Wrote inspect data to must-gather.
2026-06-02T15:30:13.823523187Z Wrote inspect data to must-gather.
2026-06-02T15:30:14.297309935Z Gathering data for ns/openshift-network-console...
2026-06-02T15:30:14.310410156Z Wrote inspect data to must-gather.
2026-06-02T15:30:14.346310734Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-06-02T15:30:14.613430805Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-02T15:30:14.615738198Z INFO: Fallback to identify the container image from release info
2026-06-02T15:30:14.889986003Z Gathering data for ns/openshift-console-operator...
2026-06-02T15:30:15.363038041Z Gathering data for ns/openshift-console...
2026-06-02T15:30:15.425218101Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-02T15:30:15.573960846Z daemonset.apps/perf-node-gather-daemonset created
2026-06-02T15:30:15.712327432Z Waiting for performance profile collector pods to become ready: 1
2026-06-02T15:30:15.979788543Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-02T15:30:16.263108045Z Wrote inspect data to must-gather.
2026-06-02T15:30:16.432893901Z Gathering data for ns/openshift-dns-operator...
2026-06-02T15:30:16.755631599Z Gathering data for ns/openshift-dns...
2026-06-02T15:30:16.843139143Z Waiting for performance profile collector pods to become ready: 2
2026-06-02T15:30:17.395449945Z Gathering data for ns/openshift-image-registry...
2026-06-02T15:30:17.910307689Z Gathering data for ns/openshift-ingress-operator...
2026-06-02T15:30:17.982771348Z Waiting for performance profile collector pods to become ready: 3
2026-06-02T15:30:18.321673529Z Gathering data for ns/openshift-ingress...
2026-06-02T15:30:19.124514756Z Waiting for performance profile collector pods to become ready: 4
2026-06-02T15:30:19.147441061Z Gathering data for ns/openshift-ingress-canary...
2026-06-02T15:30:19.353409088Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-06-02T15:30:19.688141278Z Gathering data for ns/openshift-insights...
2026-06-02T15:30:20.229188809Z Waiting for performance profile collector pods to become ready: 5
2026-06-02T15:30:21.358507252Z Waiting for performance profile collector pods to become ready: 6
2026-06-02T15:30:22.028545916Z Gathering data for ns/opendatahub...
2026-06-02T15:30:22.469906715Z Waiting for performance profile collector pods to become ready: 7
2026-06-02T15:30:23.588774879Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-02T15:30:23.841194539Z Collecting performance related data for node ip-10-0-136-77.ec2.internal
2026-06-02T15:30:23.848529770Z Collecting performance related data for node ip-10-0-130-221.ec2.internal
2026-06-02T15:30:23.856564936Z Collecting performance related data for node ip-10-0-131-33.ec2.internal
2026-06-02T15:30:23.925827458Z Gathering data for ns/openshift-lws-operator...
2026-06-02T15:30:24.360168117Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-06-02T15:30:25.747737315Z Gathering data for ns/openshift-config...
2026-06-02T15:30:26.081587499Z Gathering data for ns/openshift-config-managed...
2026-06-02T15:30:26.635719066Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-02T15:30:27.006376359Z Gathering data for ns/openshift-kube-apiserver...
2026-06-02T15:30:27.372815328Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-02T15:30:27.735742588Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-02T15:30:28.107803704Z Gathering data for ns/openshift-kube-scheduler...
2026-06-02T15:30:28.511584996Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-02T15:30:28.893159948Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-02T15:30:29.371043440Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-06-02T15:30:29.382488779Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-02T15:30:29.818616573Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-02T15:30:30.434665348Z Gathering data for ns/openshift-multus...
2026-06-02T15:30:31.968262246Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-02T15:30:32.490568365Z Collecting kubelet logs for node ip-10-0-136-77.ec2.internal
2026-06-02T15:30:32.492618473Z Collecting kubelet logs for node ip-10-0-130-221.ec2.internal
2026-06-02T15:30:32.494520015Z Collecting kubelet logs for node ip-10-0-131-33.ec2.internal
2026-06-02T15:30:32.874828515Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-02T15:30:32.882474971Z INFO: Node performance data collection complete.
2026-06-02T15:30:33.876893331Z Gathering data for ns/openshift-host-network...
2026-06-02T15:30:34.317054175Z Gathering data for ns/openshift-network-diagnostics...
2026-06-02T15:30:34.376280913Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-06-02T15:30:34.882374789Z Gathering data for ns/openshift-network-node-identity...
2026-06-02T15:30:35.369630419Z Gathering data for ns/openshift-network-operator...
2026-06-02T15:30:35.773713027Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-02T15:30:36.096100950Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-02T15:30:36.593753178Z Gathering data for ns/openshift-apiserver-operator...
2026-06-02T15:30:36.951079306Z Gathering data for ns/openshift-apiserver...
2026-06-02T15:30:37.415137454Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-02T15:30:37.755080239Z Gathering data for ns/openshift-controller-manager...
2026-06-02T15:30:38.109259590Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-02T15:30:38.863005125Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-02T15:30:39.244507583Z Gathering data for ns/openshift-service-ca-operator...
2026-06-02T15:30:39.381198930Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-06-02T15:30:39.689373838Z Gathering data for ns/openshift-service-ca...
2026-06-02T15:30:40.103647639Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-02T15:30:41.181730106Z Wrote inspect data to must-gather.
2026-06-02T15:30:41.181779333Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T15:30:41.181779333Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-02T15:30:41.317137784Z error: the server doesn't have a resource type "clusters"
2026-06-02T15:30:41.494781956Z Caches written to disk