2026-04-22T18:24:25.900968318Z [disk usage checker] Started
2026-04-22T18:24:25.929894562Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-04-22T18:24:26.114146873Z Gathering data for ns/openshift-cluster-version...
2026-04-22T18:24:26.232906276Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-22T18:24:26.317417611Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-22T18:24:26.402687099Z Gathering data for ns/default...
2026-04-22T18:24:26.699748534Z Gathering data for ns/openshift...
2026-04-22T18:24:27.089789880Z Gathering data for ns/kube-system...
2026-04-22T18:24:27.783819786Z Gathering data for ns/openshift-etcd...
2026-04-22T18:24:28.136163323Z Wrote inspect data to must-gather.
2026-04-22T18:24:28.136199945Z error: inspection completed with the errors occurred while gathering data:
2026-04-22T18:24:28.136199945Z     namespaces "assisted-installer" not found
2026-04-22T18:24:28.142247826Z Waiting on subprocesses to finish execution.
2026-04-22T18:24:28.148861809Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-04-22T18:24:28.149220622Z INFO: Gathering HAProxy config files
2026-04-22T18:24:28.149920719Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-04-22T18:24:28.178709339Z INFO: Gathering machine config daemon's old logs from all nodes
2026-04-22T18:24:28.180383763Z INFO: Collecting host service logs for crio
2026-04-22T18:24:28.180705865Z INFO: Collecting host service logs for kubelet
2026-04-22T18:24:28.181000298Z INFO: Collecting host service logs for rpm-ostreed
2026-04-22T18:24:28.181283572Z INFO: Collecting host service logs for ostree-finalize-staged
2026-04-22T18:24:28.181664600Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-04-22T18:24:28.181988538Z INFO: Collecting host service logs for machine-config-daemon-host
2026-04-22T18:24:28.182321673Z INFO: Collecting host service logs for NetworkManager
2026-04-22T18:24:28.182643431Z INFO: Collecting host service logs for openvswitch
2026-04-22T18:24:28.182985900Z INFO: Collecting host service logs for ovs-configuration
2026-04-22T18:24:28.183311547Z INFO: Collecting host service logs for ovsdb-server
2026-04-22T18:24:28.183658205Z INFO: Collecting host service logs for ovs-vswitchd
2026-04-22T18:24:28.184044486Z INFO: Waiting for worker host service log collection to complete ...
2026-04-22T18:24:28.193043689Z INFO: Waiting for node performance related collection to complete ...
2026-04-22T18:24:28.673364938Z Wrote inspect data to must-gather.
2026-04-22T18:24:28.689323775Z No resources found
2026-04-22T18:24:28.697186863Z INFO: "metallb-operator" not detected. Skipping.
2026-04-22T18:24:28.706450740Z INFO: Collecting Insights Archives from insights-operator-585dfdc468-2sbhl
2026-04-22T18:24:28.706450740Z insights-runtime-extractor-8gbsn
2026-04-22T18:24:28.706450740Z insights-runtime-extractor-sh9jw
2026-04-22T18:24:28.706450740Z insights-runtime-extractor-tlr4j
2026-04-22T18:24:28.712291652Z No resources found in openshift-etcd namespace.
2026-04-22T18:24:29.008270929Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-04-22T18:24:29.008270929Z See 'oc rsync -h' for help and examples
2026-04-22T18:24:29.018803156Z INFO: Found 1 replicas - prometheus-k8s-0
2026-04-22T18:24:29.294241735Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-04-22T18:24:29.298993656Z Wrote inspect data to must-gather.
2026-04-22T18:24:29.367774659Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-04-22T18:24:29.367817692Z INFO: on-disk MachineConfig config collection complete.
2026-04-22T18:24:29.559219465Z error: the server doesn't have a resource type "performanceprofile"
2026-04-22T18:24:29.730802983Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-04-22T18:24:29.785019743Z No resources found
2026-04-22T18:24:29.829873216Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-04-22T18:24:29.875146073Z Wrote inspect data to must-gather.
2026-04-22T18:24:29.905983567Z Wrote inspect data to must-gather.
2026-04-22T18:24:29.920832302Z INFO: Worker host service log collection to complete.
2026-04-22T18:24:29.941045604Z INFO: "sriov-network-operator" not detected. Skipping.
2026-04-22T18:24:30.087534947Z Wrote inspect data to must-gather.
2026-04-22T18:24:30.112937053Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-22T18:24:30.112996014Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-04-22T18:24:30.140929364Z INFO: Waiting for HAProxy config collection to complete ...
2026-04-22T18:24:30.169171825Z ERROR: No running kube-apiserver pods found
2026-04-22T18:24:30.197899688Z Wrote inspect data to must-gather.
2026-04-22T18:24:30.297724445Z INFO: 'previous-logs' folder not found on ip-10-0-141-172.ec2.internal, skipping...
2026-04-22T18:24:30.340976416Z Wrote inspect data to must-gather.
2026-04-22T18:24:30.384099704Z Wrote inspect data to must-gather.
2026-04-22T18:24:30.384396318Z tar: Removing leading `/' from member names
2026-04-22T18:24:30.390109066Z INFO: HAProxy config collection complete.
2026-04-22T18:24:30.509463006Z error: the server doesn't have a resource type "machineconfigs"
2026-04-22T18:24:30.568164747Z Gathering data for ns/openshift-monitoring...
2026-04-22T18:24:30.584876900Z INFO: 'previous-logs' folder not found on ip-10-0-143-88.ec2.internal, skipping...
2026-04-22T18:24:30.596340481Z INFO: Getting rules from prometheus-k8s-0
2026-04-22T18:24:30.654896694Z Wrote inspect data to must-gather.
2026-04-22T18:24:30.737526953Z Wrote inspect data to must-gather.
2026-04-22T18:24:30.832144825Z INFO: 'previous-logs' folder not found on ip-10-0-143-95.ec2.internal, skipping...
2026-04-22T18:24:30.832190863Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-04-22T18:24:30.832201622Z INFO: Machine Config Daemon termination log collection complete.
2026-04-22T18:24:30.883210460Z Wrote inspect data to must-gather.
2026-04-22T18:24:30.932684157Z Wrote inspect data to must-gather.
2026-04-22T18:24:30.937125369Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-04-22T18:24:30.994629792Z INFO: Getting status/config from prometheus-k8s-0
2026-04-22T18:24:31.097218323Z error: the server doesn't have a resource type "kubeletconfigs"
2026-04-22T18:24:31.167090266Z INFO: INTERCONNECT MODE
2026-04-22T18:24:31.167118274Z INFO: Gathering ovn-kubernetes DBs
2026-04-22T18:24:31.288267542Z Wrote inspect data to must-gather.
2026-04-22T18:24:31.312916250Z INFO: Gathering OVN_Northbound from ovnkube-node-44fqr...
2026-04-22T18:24:31.313188314Z INFO: Gathering OVN_Northbound from ovnkube-node-gz6xk...
2026-04-22T18:24:31.313498927Z INFO: Gathering OVN_Northbound from ovnkube-node-tp5cv...
2026-04-22T18:24:31.313851539Z INFO: Gathering OVN_Southbound from ovnkube-node-44fqr...
2026-04-22T18:24:31.314196984Z INFO: Gathering OVN_Southbound from ovnkube-node-gz6xk...
2026-04-22T18:24:31.314483141Z INFO: Gathering OVN_Southbound from ovnkube-node-tp5cv...
2026-04-22T18:24:31.454241047Z INFO: Getting status/flags from prometheus-k8s-0
2026-04-22T18:24:31.591913824Z Wrote inspect data to must-gather.
2026-04-22T18:24:31.602797987Z tar: Removing leading `/' from member names
2026-04-22T18:24:31.617811698Z tar: Removing leading `/' from member names
2026-04-22T18:24:31.620369852Z tar: Removing leading `/' from member names
2026-04-22T18:24:31.633783805Z tar: Removing leading `/' from member names
2026-04-22T18:24:31.641290958Z tar: Removing leading `/' from member names
2026-04-22T18:24:31.646357096Z tar: Removing leading `/' from member names
2026-04-22T18:24:31.757622835Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-04-22T18:24:31.814487636Z Wrote inspect data to must-gather.
2026-04-22T18:24:32.015650265Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-04-22T18:24:32.032786161Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-22T18:24:32.045456647Z Wrote inspect data to must-gather.
2026-04-22T18:24:32.088347431Z INFO: Waiting for network log collection to complete ...
2026-04-22T18:24:32.088465011Z INFO: Waiting for ovnk database copies to complete ...
2026-04-22T18:24:32.088987891Z INFO: Copying ovnk databases complete.
2026-04-22T18:24:32.091301396Z 2.5M	must-gather/network_logs/ovnk_database_store
2026-04-22T18:24:32.093900333Z ovnk_database_store/
2026-04-22T18:24:32.093900333Z ovnk_database_store/ovnkube-node-tp5cv_nbdb
2026-04-22T18:24:32.102247674Z ovnk_database_store/ovnkube-node-gz6xk_sbdb
2026-04-22T18:24:32.118005537Z ovnk_database_store/ovnkube-node-tp5cv_sbdb
2026-04-22T18:24:32.136745637Z ovnk_database_store/ovnkube-node-44fqr_nbdb
2026-04-22T18:24:32.143847113Z ovnk_database_store/ovnkube-node-44fqr_sbdb
2026-04-22T18:24:32.157353149Z ovnk_database_store/ovnkube-node-gz6xk_nbdb
2026-04-22T18:24:32.166504154Z INFO: Network log collection complete.
2026-04-22T18:24:32.249970422Z Wrote inspect data to must-gather.
2026-04-22T18:24:32.251459652Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-04-22T18:24:32.443732048Z Wrote inspect data to must-gather.
2026-04-22T18:24:32.596627650Z INFO: Getting status from alertmanager-main-0
2026-04-22T18:24:32.600314251Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-22T18:24:32.710474340Z Wrote inspect data to must-gather.
2026-04-22T18:24:32.759046454Z Gathering data for ns/openshift-network-console...
2026-04-22T18:24:32.940243798Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-04-22T18:24:32.942050109Z INFO: Fallback to identify the container image from release info
2026-04-22T18:24:33.158038688Z Gathering data for ns/openshift-console-operator...
2026-04-22T18:24:33.510624343Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f2123db9953f98da0e43c266e6a8a070bf221533b995f87b7e358cc7498ca6d
2026-04-22T18:24:33.513398470Z Gathering data for ns/openshift-console...
2026-04-22T18:24:33.622869623Z daemonset.apps/perf-node-gather-daemonset created
2026-04-22T18:24:33.732937546Z Waiting for performance profile collector pods to become ready: 1
2026-04-22T18:24:33.931030887Z Gathering data for ns/openshift-cluster-storage-operator...
2026-04-22T18:24:34.290503332Z Gathering data for ns/openshift-dns-operator...
2026-04-22T18:24:34.551533977Z Gathering data for ns/openshift-dns...
2026-04-22T18:24:34.855370560Z Waiting for performance profile collector pods to become ready: 2
2026-04-22T18:24:35.170701758Z Gathering data for ns/openshift-image-registry...
2026-04-22T18:24:35.683631024Z Gathering data for ns/openshift-ingress-operator...
2026-04-22T18:24:35.944628706Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-04-22T18:24:35.980623440Z Waiting for performance profile collector pods to become ready: 3
2026-04-22T18:24:36.022875824Z Gathering data for ns/openshift-ingress...
2026-04-22T18:24:36.367476424Z Gathering data for ns/openshift-ingress-canary...
2026-04-22T18:24:36.794072546Z Gathering data for ns/openshift-insights...
2026-04-22T18:24:37.084030009Z Waiting for performance profile collector pods to become ready: 4
2026-04-22T18:24:38.201584202Z Waiting for performance profile collector pods to become ready: 5
2026-04-22T18:24:38.741649215Z Gathering data for ns/openshift-config...
2026-04-22T18:24:39.059718017Z Gathering data for ns/openshift-config-managed...
2026-04-22T18:24:39.308840080Z Waiting for performance profile collector pods to become ready: 6
2026-04-22T18:24:39.481136512Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-04-22T18:24:39.760573118Z Gathering data for ns/openshift-kube-apiserver...
2026-04-22T18:24:40.080946421Z Gathering data for ns/openshift-kube-controller-manager...
2026-04-22T18:24:40.372997783Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-04-22T18:24:40.434308396Z Waiting for performance profile collector pods to become ready: 7
2026-04-22T18:24:40.683152221Z Gathering data for ns/openshift-kube-scheduler...
2026-04-22T18:24:40.932691900Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-04-22T18:24:40.952043838Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-04-22T18:24:41.213199014Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-04-22T18:24:41.554950146Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-04-22T18:24:41.577187677Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-04-22T18:24:41.794945613Z Collecting performance related data for node ip-10-0-143-88.ec2.internal
2026-04-22T18:24:41.803579597Z Collecting performance related data for node ip-10-0-141-172.ec2.internal
2026-04-22T18:24:41.812594926Z Collecting performance related data for node ip-10-0-143-95.ec2.internal
2026-04-22T18:24:41.946831660Z Gathering data for ns/openshift-user-workload-monitoring...
2026-04-22T18:24:42.589038687Z Gathering data for ns/openshift-multus...
2026-04-22T18:24:44.145775651Z Gathering data for ns/openshift-ovn-kubernetes...
2026-04-22T18:24:45.585195567Z Gathering data for ns/openshift-host-network...
2026-04-22T18:24:45.957257680Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-04-22T18:24:46.000268097Z Gathering data for ns/openshift-network-diagnostics...
2026-04-22T18:24:46.597275215Z Gathering data for ns/openshift-network-node-identity...
2026-04-22T18:24:47.107241948Z Gathering data for ns/openshift-network-operator...
2026-04-22T18:24:47.663871421Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-04-22T18:24:47.940154937Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-04-22T18:24:48.370264991Z Gathering data for ns/openshift-apiserver-operator...
2026-04-22T18:24:48.652705811Z Gathering data for ns/openshift-apiserver...
2026-04-22T18:24:49.048637993Z Gathering data for ns/openshift-controller-manager-operator...
2026-04-22T18:24:49.328912536Z Gathering data for ns/openshift-controller-manager...
2026-04-22T18:24:49.582510354Z Gathering data for ns/openshift-cluster-samples-operator...
2026-04-22T18:24:49.688971194Z Collecting kubelet logs for node ip-10-0-143-88.ec2.internal
2026-04-22T18:24:49.691319867Z Collecting kubelet logs for node ip-10-0-141-172.ec2.internal
2026-04-22T18:24:49.693152901Z Collecting kubelet logs for node ip-10-0-143-95.ec2.internal
2026-04-22T18:24:50.017884749Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-04-22T18:24:50.024849160Z INFO: Node performance data collection complete.
2026-04-22T18:24:50.267633489Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-04-22T18:24:50.548341115Z Gathering data for ns/openshift-service-ca-operator...
2026-04-22T18:24:50.861469856Z Gathering data for ns/openshift-service-ca...
2026-04-22T18:24:50.961891552Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-04-22T18:24:51.330340222Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-04-22T18:24:52.216047107Z Wrote inspect data to must-gather.
2026-04-22T18:24:52.216088858Z error: inspection completed with the errors occurred while gathering data:
2026-04-22T18:24:52.216088858Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-04-22T18:24:52.341360884Z error: the server doesn't have a resource type "clusters"
2026-04-22T18:24:52.449734952Z Caches written to disk