2026-06-02T02:11:57.561602522Z [disk usage checker] Started
2026-06-02T02:11:57.565516419Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-06-02T02:11:57.809313359Z Gathering data for ns/openshift-cluster-version...
2026-06-02T02:11:57.977923786Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T02:11:58.086542882Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T02:11:58.201916285Z Gathering data for ns/default...
2026-06-02T02:11:58.710159495Z Gathering data for ns/openshift...
2026-06-02T02:11:59.242393807Z Gathering data for ns/kube-system...
2026-06-02T02:11:59.994723507Z Waiting on subprocesses to finish execution.
2026-06-02T02:11:59.996088671Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-02T02:12:00.003510560Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-02T02:12:00.009711639Z INFO: Collecting host service logs for crio
2026-06-02T02:12:00.010021702Z INFO: Collecting host service logs for kubelet
2026-06-02T02:12:00.010021702Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-02T02:12:00.010349263Z INFO: Collecting host service logs for rpm-ostreed
2026-06-02T02:12:00.010735508Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-02T02:12:00.011085515Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-02T02:12:00.011445600Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-02T02:12:00.011796056Z INFO: Collecting host service logs for NetworkManager
2026-06-02T02:12:00.012120371Z INFO: Collecting host service logs for openvswitch
2026-06-02T02:12:00.012506080Z INFO: Collecting host service logs for ovs-configuration
2026-06-02T02:12:00.012856704Z INFO: Collecting host service logs for ovsdb-server
2026-06-02T02:12:00.013193949Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-02T02:12:00.013610988Z INFO: Waiting for worker host service log collection to complete ...
2026-06-02T02:12:00.030072556Z INFO: Gathering HAProxy config files
2026-06-02T02:12:00.149515869Z INFO: Waiting for node performance related collection to complete ...
2026-06-02T02:12:00.400690643Z Gathering data for ns/openshift-etcd...
2026-06-02T02:12:00.742687177Z No resources found in openshift-etcd namespace.
2026-06-02T02:12:00.742885910Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-02T02:12:01.072469434Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-dwswb
2026-06-02T02:12:01.072469434Z insights-runtime-extractor-mjjbr
2026-06-02T02:12:01.072469434Z insights-runtime-extractor-sdgnm
2026-06-02T02:12:01.072469434Z insights-runtime-extractor-zgqkn
2026-06-02T02:12:01.164063064Z No resources found
2026-06-02T02:12:01.230030448Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-02T02:12:01.346019054Z ERROR: No running kube-apiserver pods found
2026-06-02T02:12:01.396685008Z Wrote inspect data to must-gather.
2026-06-02T02:12:01.506745390Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-02T02:12:01.729190645Z INFO: "metallb-operator" not detected. Skipping.
2026-06-02T02:12:01.803778703Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-02T02:12:01.803778703Z See 'oc rsync -h' for help and examples
2026-06-02T02:12:01.840815447Z error: the server doesn't have a resource type "performanceprofile"
2026-06-02T02:12:01.968583224Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-02T02:12:02.003929849Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-02T02:12:02.127613643Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-02T02:12:02.127647927Z INFO: on-disk MachineConfig config collection complete.
2026-06-02T02:12:02.154447975Z INFO: Worker host service log collection to complete.
2026-06-02T02:12:02.186496139Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T02:12:02.381619579Z No resources found
2026-06-02T02:12:02.544458834Z Wrote inspect data to must-gather.
2026-06-02T02:12:02.544497765Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T02:12:02.544497765Z     namespaces "assisted-installer" not found
2026-06-02T02:12:02.575103847Z Gathering data for ns/kuadrant-system...
2026-06-02T02:12:02.678499378Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-06-02T02:12:02.704953475Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-02T02:12:02.860723368Z Wrote inspect data to must-gather.
2026-06-02T02:12:02.914054925Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-02T02:12:02.944088218Z Wrote inspect data to must-gather.
2026-06-02T02:12:02.973186517Z Wrote inspect data to must-gather.
2026-06-02T02:12:03.017215148Z INFO: 'previous-logs' folder not found on ip-10-0-135-96.ec2.internal, skipping...
2026-06-02T02:12:03.042188891Z Wrote inspect data to must-gather.
2026-06-02T02:12:03.056908423Z tar: Removing leading `/' from member names
2026-06-02T02:12:03.062449127Z INFO: HAProxy config collection complete.
2026-06-02T02:12:03.109438206Z Wrote inspect data to must-gather.
2026-06-02T02:12:03.169267495Z error: the server doesn't have a resource type "machineconfigs"
2026-06-02T02:12:03.342996371Z INFO: 'previous-logs' folder not found on ip-10-0-138-87.ec2.internal, skipping...
2026-06-02T02:12:03.465606431Z INFO: Getting rules from prometheus-k8s-0
2026-06-02T02:12:03.583994239Z Wrote inspect data to must-gather.
2026-06-02T02:12:03.586603471Z Wrote inspect data to must-gather.
2026-06-02T02:12:03.739606984Z INFO: 'previous-logs' folder not found on ip-10-0-142-223.ec2.internal, skipping...
2026-06-02T02:12:03.739745156Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-02T02:12:03.739812480Z INFO: Machine Config Daemon termination log collection complete.
2026-06-02T02:12:03.847267037Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T02:12:03.995994943Z INFO: Getting status/config from prometheus-k8s-0
2026-06-02T02:12:04.008290078Z Wrote inspect data to must-gather.
2026-06-02T02:12:04.057879202Z Wrote inspect data to must-gather.
2026-06-02T02:12:04.237939955Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-02T02:12:04.447979072Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T02:12:04.511455051Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-02T02:12:04.581163348Z Wrote inspect data to must-gather.
2026-06-02T02:12:04.744565312Z Gathering data for ns/openshift-monitoring...
2026-06-02T02:12:04.747547047Z Wrote inspect data to must-gather.
2026-06-02T02:12:04.839174382Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-02T02:12:04.972985277Z INFO: INTERCONNECT MODE
2026-06-02T02:12:04.973054225Z INFO: Gathering ovn-kubernetes DBs
2026-06-02T02:12:05.118444389Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-02T02:12:05.187241569Z INFO: Gathering OVN_Northbound from ovnkube-node-pxgw2...
2026-06-02T02:12:05.187592659Z INFO: Gathering OVN_Northbound from ovnkube-node-qzsbw...
2026-06-02T02:12:05.187857865Z INFO: Gathering OVN_Northbound from ovnkube-node-rfpnc...
2026-06-02T02:12:05.188143640Z INFO: Gathering OVN_Southbound from ovnkube-node-pxgw2...
2026-06-02T02:12:05.188447032Z INFO: Gathering OVN_Southbound from ovnkube-node-qzsbw...
2026-06-02T02:12:05.188907765Z INFO: Gathering OVN_Southbound from ovnkube-node-rfpnc...
2026-06-02T02:12:05.218754574Z Wrote inspect data to must-gather.
2026-06-02T02:12:05.552989197Z tar: Removing leading `/' from member names
2026-06-02T02:12:05.572263079Z tar: Removing leading `/' from member names
2026-06-02T02:12:05.578853343Z tar: Removing leading `/' from member names
2026-06-02T02:12:05.632084750Z tar: Removing leading `/' from member names
2026-06-02T02:12:05.632317773Z tar: Removing leading `/' from member names
2026-06-02T02:12:05.679243109Z tar: Removing leading `/' from member names
2026-06-02T02:12:05.707519087Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-02T02:12:05.879322519Z Wrote inspect data to must-gather.
2026-06-02T02:12:06.208975848Z INFO: Getting status from alertmanager-main-0
2026-06-02T02:12:06.224624777Z INFO: Waiting for network log collection to complete ...
2026-06-02T02:12:06.224688135Z INFO: Waiting for ovnk database copies to complete ...
2026-06-02T02:12:06.225182885Z INFO: Copying ovnk databases complete.
2026-06-02T02:12:06.227559101Z 4.3M	must-gather/network_logs/ovnk_database_store
2026-06-02T02:12:06.230336323Z ovnk_database_store/
2026-06-02T02:12:06.230667897Z ovnk_database_store/ovnkube-node-pxgw2_nbdb
2026-06-02T02:12:06.242703625Z ovnk_database_store/ovnkube-node-pxgw2_sbdb
2026-06-02T02:12:06.279119241Z ovnk_database_store/ovnkube-node-rfpnc_nbdb
2026-06-02T02:12:06.293206168Z ovnk_database_store/ovnkube-node-qzsbw_nbdb
2026-06-02T02:12:06.304981121Z ovnk_database_store/ovnkube-node-qzsbw_sbdb
2026-06-02T02:12:06.328713014Z ovnk_database_store/ovnkube-node-rfpnc_sbdb
2026-06-02T02:12:06.362585766Z INFO: Network log collection complete.
2026-06-02T02:12:06.364899277Z Wrote inspect data to must-gather.
2026-06-02T02:12:06.804077749Z Wrote inspect data to must-gather.
2026-06-02T02:12:07.170639570Z Wrote inspect data to must-gather.
2026-06-02T02:12:07.517741303Z Gathering data for ns/openshift-network-console...
2026-06-02T02:12:07.615875904Z Wrote inspect data to must-gather.
2026-06-02T02:12:07.702124895Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-06-02T02:12:07.905267894Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-02T02:12:07.908746748Z INFO: Fallback to identify the container image from release info
2026-06-02T02:12:08.126267221Z Gathering data for ns/openshift-console-operator...
2026-06-02T02:12:08.651538661Z Gathering data for ns/openshift-console...
2026-06-02T02:12:08.720213067Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-02T02:12:08.881358545Z daemonset.apps/perf-node-gather-daemonset created
2026-06-02T02:12:09.036292216Z Waiting for performance profile collector pods to become ready: 1
2026-06-02T02:12:09.283991871Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-02T02:12:09.782715035Z Gathering data for ns/openshift-dns-operator...
2026-06-02T02:12:09.883512228Z Wrote inspect data to must-gather.
2026-06-02T02:12:10.149298510Z Gathering data for ns/openshift-dns...
2026-06-02T02:12:10.166568449Z Waiting for performance profile collector pods to become ready: 2
2026-06-02T02:12:10.849354590Z Gathering data for ns/openshift-image-registry...
2026-06-02T02:12:11.300431712Z Waiting for performance profile collector pods to become ready: 3
2026-06-02T02:12:11.423805054Z Gathering data for ns/openshift-ingress-operator...
2026-06-02T02:12:11.824025976Z Gathering data for ns/openshift-ingress...
2026-06-02T02:12:12.429288068Z Waiting for performance profile collector pods to become ready: 4
2026-06-02T02:12:12.633807473Z Gathering data for ns/openshift-ingress-canary...
2026-06-02T02:12:12.707013298Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-06-02T02:12:13.186678668Z Gathering data for ns/openshift-insights...
2026-06-02T02:12:13.559323706Z Waiting for performance profile collector pods to become ready: 5
2026-06-02T02:12:14.671300674Z Waiting for performance profile collector pods to become ready: 6
2026-06-02T02:12:15.585619272Z Gathering data for ns/opendatahub...
2026-06-02T02:12:15.790470354Z Waiting for performance profile collector pods to become ready: 7
2026-06-02T02:12:16.909467877Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-02T02:12:17.169128286Z Collecting performance related data for node ip-10-0-135-96.ec2.internal
2026-06-02T02:12:17.176480400Z Collecting performance related data for node ip-10-0-142-223.ec2.internal
2026-06-02T02:12:17.183545354Z Collecting performance related data for node ip-10-0-138-87.ec2.internal
2026-06-02T02:12:17.480085880Z Gathering data for ns/openshift-lws-operator...
2026-06-02T02:12:17.724458744Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-06-02T02:12:19.310762037Z Gathering data for ns/openshift-config...
2026-06-02T02:12:19.681761753Z Gathering data for ns/openshift-config-managed...
2026-06-02T02:12:20.315124255Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-02T02:12:20.689924559Z Gathering data for ns/openshift-kube-apiserver...
2026-06-02T02:12:21.076530754Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-02T02:12:21.464452692Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-02T02:12:21.847489818Z Gathering data for ns/openshift-kube-scheduler...
2026-06-02T02:12:22.204876408Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-02T02:12:22.602504114Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-02T02:12:22.730589004Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-06-02T02:12:22.999165616Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-02T02:12:23.392084638Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-02T02:12:24.007559197Z Gathering data for ns/openshift-multus...
2026-06-02T02:12:25.552076010Z Collecting kubelet logs for node ip-10-0-135-96.ec2.internal
2026-06-02T02:12:25.554545999Z Collecting kubelet logs for node ip-10-0-142-223.ec2.internal
2026-06-02T02:12:25.557576613Z Collecting kubelet logs for node ip-10-0-138-87.ec2.internal
2026-06-02T02:12:25.814961979Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-02T02:12:25.926323210Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-02T02:12:25.931441537Z INFO: Node performance data collection complete.
2026-06-02T02:12:27.506329929Z Gathering data for ns/openshift-host-network...
2026-06-02T02:12:27.735330412Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-06-02T02:12:27.954959161Z Gathering data for ns/openshift-network-diagnostics...
2026-06-02T02:12:28.572912890Z Gathering data for ns/openshift-network-node-identity...
2026-06-02T02:12:29.050445744Z Gathering data for ns/openshift-network-operator...
2026-06-02T02:12:29.492021137Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-02T02:12:29.846827244Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-02T02:12:30.381741745Z Gathering data for ns/openshift-apiserver-operator...
2026-06-02T02:12:30.784084781Z Gathering data for ns/openshift-apiserver...
2026-06-02T02:12:31.259501170Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-02T02:12:31.596086390Z Gathering data for ns/openshift-controller-manager...
2026-06-02T02:12:31.957182398Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-02T02:12:32.678785279Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-02T02:12:32.741620493Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-02T02:12:33.116566613Z Gathering data for ns/openshift-service-ca-operator...
2026-06-02T02:12:33.504863555Z Gathering data for ns/openshift-service-ca...
2026-06-02T02:12:33.955678440Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-02T02:12:35.198974550Z Wrote inspect data to must-gather.
2026-06-02T02:12:35.199157442Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T02:12:35.199157442Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-02T02:12:35.337641570Z error: the server doesn't have a resource type "clusters"
2026-06-02T02:12:35.525518840Z Caches written to disk