2026-05-20T14:58:51.914108600Z [disk usage checker] Started
2026-05-20T14:58:51.917721167Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-05-20T14:58:52.126499372Z Gathering data for ns/openshift-cluster-version...
2026-05-20T14:58:52.282175210Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-05-20T14:58:52.375537116Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-20T14:58:52.462484644Z Gathering data for ns/default...
2026-05-20T14:58:52.806236305Z Gathering data for ns/openshift...
2026-05-20T14:58:53.253253542Z Gathering data for ns/kube-system...
2026-05-20T14:58:54.018477425Z Gathering data for ns/openshift-etcd...
2026-05-20T14:58:54.347683613Z Waiting on subprocesses to finish execution.
2026-05-20T14:58:54.352604920Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-05-20T14:58:54.360540582Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-05-20T14:58:54.364769294Z Wrote inspect data to must-gather.
2026-05-20T14:58:54.364799836Z error: inspection completed with the errors occurred while gathering data:
2026-05-20T14:58:54.364799836Z     namespaces "assisted-installer" not found
2026-05-20T14:58:54.367563487Z INFO: Gathering machine config daemon's old logs from all nodes
2026-05-20T14:58:54.368410841Z INFO: Collecting host service logs for crio
2026-05-20T14:58:54.368628724Z INFO: Collecting host service logs for kubelet
2026-05-20T14:58:54.368920367Z INFO: Collecting host service logs for rpm-ostreed
2026-05-20T14:58:54.369218111Z INFO: Collecting host service logs for ostree-finalize-staged
2026-05-20T14:58:54.369591051Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-05-20T14:58:54.369931203Z INFO: Collecting host service logs for machine-config-daemon-host
2026-05-20T14:58:54.370240219Z INFO: Collecting host service logs for NetworkManager
2026-05-20T14:58:54.370663756Z INFO: Collecting host service logs for openvswitch
2026-05-20T14:58:54.371131823Z INFO: Collecting host service logs for ovs-configuration
2026-05-20T14:58:54.371622438Z INFO: Collecting host service logs for ovsdb-server
2026-05-20T14:58:54.371942592Z INFO: Collecting host service logs for ovs-vswitchd
2026-05-20T14:58:54.372523812Z INFO: Waiting for worker host service log collection to complete ...
2026-05-20T14:58:54.375301265Z INFO: Gathering HAProxy config files
2026-05-20T14:58:54.526104108Z INFO: Waiting for node performance related collection to complete ...
2026-05-20T14:58:55.230961826Z No resources found
2026-05-20T14:58:55.275129040Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-05-20T14:58:55.284499145Z INFO: Found 1 replicas - prometheus-k8s-0
2026-05-20T14:58:55.295717275Z INFO: "sriov-network-operator" not detected. Skipping.
2026-05-20T14:58:55.298925361Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-05-20T14:58:55.385422847Z INFO: "metallb-operator" not detected. Skipping.
2026-05-20T14:58:55.394965623Z INFO: Collecting Insights Archives from insights-operator-78bdfb888c-ppgpb
2026-05-20T14:58:55.394965623Z insights-runtime-extractor-dr6lw
2026-05-20T14:58:55.394965623Z insights-runtime-extractor-l65x8
2026-05-20T14:58:55.394965623Z insights-runtime-extractor-sh9dr
2026-05-20T14:58:55.466297486Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-05-20T14:58:55.466347669Z INFO: on-disk MachineConfig config collection complete.
2026-05-20T14:58:55.559138320Z INFO: Worker host service log collection to complete.
2026-05-20T14:58:55.629243867Z Wrote inspect data to must-gather.
2026-05-20T14:58:55.691353070Z error: the server doesn't have a resource type "performanceprofile"
2026-05-20T14:58:55.695881701Z No resources found in openshift-etcd namespace.
2026-05-20T14:58:55.779156287Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-05-20T14:58:55.779156287Z See 'oc rsync -h' for help and examples
2026-05-20T14:58:55.834400977Z Wrote inspect data to must-gather.
2026-05-20T14:58:55.936054855Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-05-20T14:58:55.950732268Z INFO: Waiting for HAProxy config collection to complete ...
2026-05-20T14:58:56.139239563Z ERROR: No running kube-apiserver pods found
2026-05-20T14:58:56.196170832Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-20T14:58:56.232836585Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-05-20T14:58:56.537255831Z No resources found
2026-05-20T14:58:56.554109806Z Wrote inspect data to must-gather.
2026-05-20T14:58:56.614061705Z INFO: 'previous-logs' folder not found on ip-10-0-130-144.ec2.internal, skipping...
2026-05-20T14:58:56.625108165Z Wrote inspect data to must-gather.
2026-05-20T14:58:56.639820528Z Wrote inspect data to must-gather.
2026-05-20T14:58:56.681974516Z Gathering data for ns/openshift-monitoring...
2026-05-20T14:58:56.686214425Z Wrote inspect data to must-gather.
2026-05-20T14:58:56.698706946Z Wrote inspect data to must-gather.
2026-05-20T14:58:56.735487526Z tar: Removing leading `/' from member names
2026-05-20T14:58:56.742705737Z INFO: HAProxy config collection complete.
2026-05-20T14:58:56.794605499Z INFO: Getting rules from prometheus-k8s-0
2026-05-20T14:58:56.862467894Z error: the server doesn't have a resource type "machineconfigs"
2026-05-20T14:58:56.926520506Z Wrote inspect data to must-gather.
2026-05-20T14:58:56.928266198Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-05-20T14:58:56.933386414Z INFO: 'previous-logs' folder not found on ip-10-0-132-181.ec2.internal, skipping...
2026-05-20T14:58:57.090447689Z Wrote inspect data to must-gather.
2026-05-20T14:58:57.180141172Z Wrote inspect data to must-gather.
2026-05-20T14:58:57.189514555Z INFO: 'previous-logs' folder not found on ip-10-0-139-248.ec2.internal, skipping...
2026-05-20T14:58:57.189566182Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-05-20T14:58:57.189578757Z INFO: Machine Config Daemon termination log collection complete.
2026-05-20T14:58:57.256169341Z INFO: Getting status/config from prometheus-k8s-0
2026-05-20T14:58:57.310513684Z Wrote inspect data to must-gather.
2026-05-20T14:58:57.417617179Z Wrote inspect data to must-gather.
2026-05-20T14:58:57.459930438Z error: the server doesn't have a resource type "kubeletconfigs"
2026-05-20T14:58:57.663112638Z INFO: Getting status/flags from prometheus-k8s-0
2026-05-20T14:58:57.678068234Z Wrote inspect data to must-gather.
2026-05-20T14:58:57.703097151Z INFO: INTERCONNECT MODE
2026-05-20T14:58:57.703125139Z INFO: Gathering ovn-kubernetes DBs
2026-05-20T14:58:57.867887845Z INFO: Gathering OVN_Northbound from ovnkube-node-crztq...
2026-05-20T14:58:57.868200462Z INFO: Gathering OVN_Northbound from ovnkube-node-gv7zm...
2026-05-20T14:58:57.868496651Z INFO: Gathering OVN_Northbound from ovnkube-node-wqvdd...
2026-05-20T14:58:57.868789613Z INFO: Gathering OVN_Southbound from ovnkube-node-crztq...
2026-05-20T14:58:57.869045214Z INFO: Gathering OVN_Southbound from ovnkube-node-gv7zm...
2026-05-20T14:58:57.869630684Z INFO: Gathering OVN_Southbound from ovnkube-node-wqvdd...
2026-05-20T14:58:57.884294452Z Wrote inspect data to must-gather.
2026-05-20T14:58:57.904407081Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-05-20T14:58:58.187051085Z tar: Removing leading `/' from member names
2026-05-20T14:58:58.207050705Z tar: Removing leading `/' from member names
2026-05-20T14:58:58.211007716Z tar: Removing leading `/' from member names
2026-05-20T14:58:58.213193170Z tar: Removing leading `/' from member names
2026-05-20T14:58:58.241071366Z tar: Removing leading `/' from member names
2026-05-20T14:58:58.241206222Z tar: Removing leading `/' from member names
2026-05-20T14:58:58.241466885Z Wrote inspect data to must-gather.
2026-05-20T14:58:58.297643610Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-05-20T14:58:58.311959510Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-05-20T14:58:58.485043338Z Wrote inspect data to must-gather.
2026-05-20T14:58:58.556054106Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-05-20T14:58:58.681664729Z INFO: Waiting for network log collection to complete ...
2026-05-20T14:58:58.681716403Z INFO: Waiting for ovnk database copies to complete ...
2026-05-20T14:58:58.682240935Z INFO: Copying ovnk databases complete.
2026-05-20T14:58:58.684218004Z 4.4M	must-gather/network_logs/ovnk_database_store
2026-05-20T14:58:58.686926128Z ovnk_database_store/
2026-05-20T14:58:58.686973760Z ovnk_database_store/ovnkube-node-gv7zm_sbdb
2026-05-20T14:58:58.718191873Z ovnk_database_store/ovnkube-node-gv7zm_nbdb
2026-05-20T14:58:58.728229277Z Wrote inspect data to must-gather.
2026-05-20T14:58:58.732679305Z ovnk_database_store/ovnkube-node-wqvdd_nbdb
2026-05-20T14:58:58.743709328Z ovnk_database_store/ovnkube-node-wqvdd_sbdb
2026-05-20T14:58:58.765280316Z ovnk_database_store/ovnkube-node-crztq_sbdb
2026-05-20T14:58:58.794078469Z ovnk_database_store/ovnkube-node-crztq_nbdb
2026-05-20T14:58:58.806661534Z INFO: Network log collection complete.
2026-05-20T14:58:58.927926646Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-20T14:58:58.938098236Z INFO: Getting status from alertmanager-main-0
2026-05-20T14:58:59.019477578Z Wrote inspect data to must-gather.
2026-05-20T14:58:59.103299699Z Gathering data for ns/openshift-network-console...
2026-05-20T14:58:59.290739018Z Wrote inspect data to must-gather.
2026-05-20T14:58:59.510614061Z Gathering data for ns/openshift-console-operator...
2026-05-20T14:58:59.571692848Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-05-20T14:58:59.574197936Z INFO: Fallback to identify the container image from release info
2026-05-20T14:58:59.863610733Z Gathering data for ns/openshift-console...
2026-05-20T14:59:00.163235486Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:934b226bb305ecfe687cdb9684d7d4cf04b130e6254c2817dd1a6112d4829bda
2026-05-20T14:59:00.316696020Z daemonset.apps/perf-node-gather-daemonset created
2026-05-20T14:59:00.345151005Z Gathering data for ns/openshift-cluster-storage-operator...
2026-05-20T14:59:00.445159115Z Waiting for performance profile collector pods to become ready: 1
2026-05-20T14:59:00.726485050Z Gathering data for ns/openshift-dns-operator...
2026-05-20T14:59:01.054856202Z Gathering data for ns/openshift-dns...
2026-05-20T14:59:01.576815074Z Waiting for performance profile collector pods to become ready: 2
2026-05-20T14:59:01.702284310Z Gathering data for ns/openshift-image-registry...
2026-05-20T14:59:01.933137327Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-05-20T14:59:02.196030289Z Gathering data for ns/openshift-ingress-operator...
2026-05-20T14:59:02.515817892Z Gathering data for ns/openshift-ingress...
2026-05-20T14:59:02.704543378Z Waiting for performance profile collector pods to become ready: 3
2026-05-20T14:59:02.881004257Z Gathering data for ns/openshift-ingress-canary...
2026-05-20T14:59:03.304998019Z Gathering data for ns/openshift-insights...
2026-05-20T14:59:03.842707819Z Waiting for performance profile collector pods to become ready: 4
2026-05-20T14:59:04.964041606Z Waiting for performance profile collector pods to become ready: 5
2026-05-20T14:59:05.424909515Z Gathering data for ns/kserve...
2026-05-20T14:59:06.079154556Z Waiting for performance profile collector pods to become ready: 6
2026-05-20T14:59:06.938077780Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-05-20T14:59:07.215224151Z Waiting for performance profile collector pods to become ready: 7
2026-05-20T14:59:07.455416599Z Gathering data for ns/openshift-config...
2026-05-20T14:59:07.769336985Z Gathering data for ns/openshift-config-managed...
2026-05-20T14:59:08.199626215Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-05-20T14:59:08.347415526Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-05-20T14:59:08.505720701Z Gathering data for ns/openshift-kube-apiserver...
2026-05-20T14:59:08.636719763Z Collecting performance related data for node ip-10-0-132-181.ec2.internal
2026-05-20T14:59:08.648383838Z Collecting performance related data for node ip-10-0-130-144.ec2.internal
2026-05-20T14:59:08.661252870Z Collecting performance related data for node ip-10-0-139-248.ec2.internal
2026-05-20T14:59:08.918969074Z Gathering data for ns/openshift-kube-controller-manager...
2026-05-20T14:59:09.317380820Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-05-20T14:59:09.765419870Z Gathering data for ns/openshift-kube-scheduler...
2026-05-20T14:59:10.114128965Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-05-20T14:59:10.476135799Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-05-20T14:59:10.809215389Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-05-20T14:59:11.157945399Z Gathering data for ns/openshift-user-workload-monitoring...
2026-05-20T14:59:11.748248897Z Gathering data for ns/openshift-multus...
2026-05-20T14:59:11.943406971Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-05-20T14:59:13.265451504Z Gathering data for ns/openshift-ovn-kubernetes...
2026-05-20T14:59:14.897081574Z Gathering data for ns/openshift-host-network...
2026-05-20T14:59:15.259386325Z Gathering data for ns/openshift-network-diagnostics...
2026-05-20T14:59:15.805286641Z Gathering data for ns/openshift-network-node-identity...
2026-05-20T14:59:16.234293154Z Gathering data for ns/openshift-network-operator...
2026-05-20T14:59:16.714199073Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-05-20T14:59:16.948330714Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-05-20T14:59:17.007212096Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-05-20T14:59:17.223042283Z Collecting kubelet logs for node ip-10-0-132-181.ec2.internal
2026-05-20T14:59:17.224892494Z Collecting kubelet logs for node ip-10-0-130-144.ec2.internal
2026-05-20T14:59:17.226832432Z Collecting kubelet logs for node ip-10-0-139-248.ec2.internal
2026-05-20T14:59:17.545524235Z Gathering data for ns/openshift-apiserver-operator...
2026-05-20T14:59:17.652747509Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-05-20T14:59:17.657399195Z INFO: Node performance data collection complete.
2026-05-20T14:59:17.876211296Z Gathering data for ns/openshift-apiserver...
2026-05-20T14:59:18.330125511Z Gathering data for ns/openshift-controller-manager-operator...
2026-05-20T14:59:18.597381293Z Gathering data for ns/openshift-controller-manager...
2026-05-20T14:59:18.879984222Z Gathering data for ns/openshift-cluster-samples-operator...
2026-05-20T14:59:19.526826310Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-05-20T14:59:19.844978196Z Gathering data for ns/openshift-service-ca-operator...
2026-05-20T14:59:20.152545083Z Gathering data for ns/openshift-service-ca...
2026-05-20T14:59:20.501266686Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-05-20T14:59:21.418100887Z Wrote inspect data to must-gather.
2026-05-20T14:59:21.418149198Z error: inspection completed with the errors occurred while gathering data:
2026-05-20T14:59:21.418149198Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-05-20T14:59:21.556552380Z error: the server doesn't have a resource type "clusters"
2026-05-20T14:59:21.704850477Z Caches written to disk