2026-06-02T01:29:26.610965643Z [disk usage checker] Started
2026-06-02T01:29:26.614520070Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-06-02T01:29:26.849522401Z Gathering data for ns/openshift-cluster-version...
2026-06-02T01:29:27.012688908Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T01:29:27.106890528Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T01:29:27.212672526Z Gathering data for ns/default...
2026-06-02T01:29:27.687245138Z Gathering data for ns/openshift...
2026-06-02T01:29:28.165514859Z Gathering data for ns/kube-system...
2026-06-02T01:29:28.960871190Z Gathering data for ns/openshift-etcd...
2026-06-02T01:29:29.183901756Z Waiting on subprocesses to finish execution.
2026-06-02T01:29:29.193936877Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-02T01:29:29.198987426Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-02T01:29:29.203039796Z INFO: Collecting host service logs for crio
2026-06-02T01:29:29.203494648Z INFO: Collecting host service logs for kubelet
2026-06-02T01:29:29.203842892Z INFO: Collecting host service logs for rpm-ostreed
2026-06-02T01:29:29.204182704Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-02T01:29:29.204555141Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-02T01:29:29.204887330Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-02T01:29:29.205214461Z INFO: Collecting host service logs for NetworkManager
2026-06-02T01:29:29.205593482Z INFO: Collecting host service logs for openvswitch
2026-06-02T01:29:29.205954620Z INFO: Collecting host service logs for ovs-configuration
2026-06-02T01:29:29.206428109Z INFO: Collecting host service logs for ovsdb-server
2026-06-02T01:29:29.206759990Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-02T01:29:29.207154804Z INFO: Waiting for worker host service log collection to complete ...
2026-06-02T01:29:29.215580211Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-02T01:29:29.237659515Z INFO: Waiting for node performance related collection to complete ...
2026-06-02T01:29:29.322967032Z INFO: Gathering HAProxy config files
2026-06-02T01:29:29.883847529Z No resources found in openshift-etcd namespace.
2026-06-02T01:29:30.269073890Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-02T01:29:30.269178150Z INFO: on-disk MachineConfig config collection complete.
2026-06-02T01:29:30.397235616Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-02T01:29:30.404207470Z error: the server doesn't have a resource type "performanceprofile"
2026-06-02T01:29:30.464813063Z No resources found
2026-06-02T01:29:30.515436749Z INFO: "metallb-operator" not detected. Skipping.
2026-06-02T01:29:30.519042621Z Wrote inspect data to must-gather.
2026-06-02T01:29:30.519128378Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T01:29:30.519128378Z     namespaces "assisted-installer" not found
2026-06-02T01:29:30.693243302Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-tl6jd
2026-06-02T01:29:30.693289698Z insights-runtime-extractor-7x5mq
2026-06-02T01:29:30.693309805Z insights-runtime-extractor-f8p5c
2026-06-02T01:29:30.693329713Z insights-runtime-extractor-zmng2
2026-06-02T01:29:30.740703093Z INFO: Worker host service log collection to complete.
2026-06-02T01:29:30.754609034Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-02T01:29:30.804492336Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-02T01:29:30.905662965Z ERROR: No running kube-apiserver pods found
2026-06-02T01:29:30.928257868Z Wrote inspect data to must-gather.
2026-06-02T01:29:31.303145317Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-02T01:29:31.303145317Z See 'oc rsync -h' for help and examples
2026-06-02T01:29:31.427048895Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-02T01:29:31.583840167Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-02T01:29:31.638324169Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T01:29:31.732564458Z Wrote inspect data to must-gather.
2026-06-02T01:29:31.746097528Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-02T01:29:31.777278185Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-06-02T01:29:31.789423321Z Wrote inspect data to must-gather.
2026-06-02T01:29:31.802669362Z Wrote inspect data to must-gather.
2026-06-02T01:29:31.811518319Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-02T01:29:31.989440988Z Wrote inspect data to must-gather.
2026-06-02T01:29:32.057047115Z No resources found
2026-06-02T01:29:32.150570603Z INFO: 'previous-logs' folder not found on ip-10-0-135-17.ec2.internal, skipping...
2026-06-02T01:29:32.173007587Z Gathering data for ns/kuadrant-system...
2026-06-02T01:29:32.302693095Z Wrote inspect data to must-gather.
2026-06-02T01:29:32.321805564Z error: the server doesn't have a resource type "machineconfigs"
2026-06-02T01:29:32.327623031Z tar: Removing leading `/' from member names
2026-06-02T01:29:32.333649995Z INFO: HAProxy config collection complete.
2026-06-02T01:29:32.524590566Z INFO: Getting rules from prometheus-k8s-0
2026-06-02T01:29:32.557296025Z Wrote inspect data to must-gather.
2026-06-02T01:29:32.572917130Z INFO: 'previous-logs' folder not found on ip-10-0-138-192.ec2.internal, skipping...
2026-06-02T01:29:32.741716429Z Wrote inspect data to must-gather.
2026-06-02T01:29:32.909104368Z INFO: 'previous-logs' folder not found on ip-10-0-139-243.ec2.internal, skipping...
2026-06-02T01:29:32.909242435Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-02T01:29:32.909314015Z INFO: Machine Config Daemon termination log collection complete.
2026-06-02T01:29:33.063763200Z Wrote inspect data to must-gather.
2026-06-02T01:29:33.079990362Z INFO: Getting status/config from prometheus-k8s-0
2026-06-02T01:29:33.102319088Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T01:29:33.169693433Z Wrote inspect data to must-gather.
2026-06-02T01:29:33.396428278Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-02T01:29:33.533421250Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-02T01:29:33.533880356Z Wrote inspect data to must-gather.
2026-06-02T01:29:33.747584186Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T01:29:33.813759867Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-02T01:29:33.865909656Z Wrote inspect data to must-gather.
2026-06-02T01:29:33.944232617Z INFO: INTERCONNECT MODE
2026-06-02T01:29:33.944289324Z INFO: Gathering ovn-kubernetes DBs
2026-06-02T01:29:33.989143133Z Gathering data for ns/openshift-monitoring...
2026-06-02T01:29:34.094888752Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-02T01:29:34.137791735Z INFO: Gathering OVN_Northbound from ovnkube-node-5h6vx...
2026-06-02T01:29:34.138108169Z INFO: Gathering OVN_Northbound from ovnkube-node-lkf95...
2026-06-02T01:29:34.138411162Z INFO: Gathering OVN_Northbound from ovnkube-node-p7rbj...
2026-06-02T01:29:34.138728727Z INFO: Gathering OVN_Southbound from ovnkube-node-5h6vx...
2026-06-02T01:29:34.139081868Z INFO: Gathering OVN_Southbound from ovnkube-node-lkf95...
2026-06-02T01:29:34.139388984Z INFO: Gathering OVN_Southbound from ovnkube-node-p7rbj...
2026-06-02T01:29:34.378177025Z Wrote inspect data to must-gather.
2026-06-02T01:29:34.425361519Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-02T01:29:34.466146824Z tar: Removing leading `/' from member names
2026-06-02T01:29:34.485115008Z tar: Removing leading `/' from member names
2026-06-02T01:29:34.501123362Z tar: Removing leading `/' from member names
2026-06-02T01:29:34.558745144Z tar: Removing leading `/' from member names
2026-06-02T01:29:34.566562750Z tar: Removing leading `/' from member names
2026-06-02T01:29:34.626830377Z tar: Removing leading `/' from member names
2026-06-02T01:29:34.949790621Z Wrote inspect data to must-gather.
2026-06-02T01:29:34.993731693Z INFO: Getting status from alertmanager-main-0
2026-06-02T01:29:35.195072197Z INFO: Waiting for network log collection to complete ...
2026-06-02T01:29:35.195134167Z INFO: Waiting for ovnk database copies to complete ...
2026-06-02T01:29:35.195740955Z INFO: Copying ovnk databases complete.
2026-06-02T01:29:35.197401762Z 4.1M	must-gather/network_logs/ovnk_database_store
2026-06-02T01:29:35.200592888Z ovnk_database_store/
2026-06-02T01:29:35.200636941Z ovnk_database_store/ovnkube-node-lkf95_nbdb
2026-06-02T01:29:35.214890469Z ovnk_database_store/ovnkube-node-p7rbj_nbdb
2026-06-02T01:29:35.227645027Z ovnk_database_store/ovnkube-node-5h6vx_nbdb
2026-06-02T01:29:35.241031673Z ovnk_database_store/ovnkube-node-lkf95_sbdb
2026-06-02T01:29:35.266632133Z ovnk_database_store/ovnkube-node-5h6vx_sbdb
2026-06-02T01:29:35.296841040Z ovnk_database_store/ovnkube-node-p7rbj_sbdb
2026-06-02T01:29:35.327525564Z INFO: Network log collection complete.
2026-06-02T01:29:35.420188586Z Wrote inspect data to must-gather.
2026-06-02T01:29:35.793738744Z Wrote inspect data to must-gather.
2026-06-02T01:29:36.219257634Z Wrote inspect data to must-gather.
2026-06-02T01:29:36.238506347Z Gathering data for ns/openshift-network-console...
2026-06-02T01:29:36.685730090Z Wrote inspect data to must-gather.
2026-06-02T01:29:36.797652129Z Gathering data for ns/openshift-console-operator...
2026-06-02T01:29:36.828666368Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-06-02T01:29:36.999604545Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-02T01:29:37.002084228Z INFO: Fallback to identify the container image from release info
2026-06-02T01:29:37.277948559Z Gathering data for ns/openshift-console...
2026-06-02T01:29:37.684534931Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-02T01:29:37.823664006Z daemonset.apps/perf-node-gather-daemonset created
2026-06-02T01:29:37.854426378Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-02T01:29:37.982468961Z Waiting for performance profile collector pods to become ready: 1
2026-06-02T01:29:38.346400691Z Gathering data for ns/openshift-dns-operator...
2026-06-02T01:29:38.729404296Z Gathering data for ns/openshift-dns...
2026-06-02T01:29:39.086666432Z Wrote inspect data to must-gather.
2026-06-02T01:29:39.123815419Z Waiting for performance profile collector pods to become ready: 2
2026-06-02T01:29:39.402340439Z Gathering data for ns/openshift-image-registry...
2026-06-02T01:29:39.913163328Z Gathering data for ns/openshift-ingress-operator...
2026-06-02T01:29:40.263457136Z Waiting for performance profile collector pods to become ready: 3
2026-06-02T01:29:40.314276544Z Gathering data for ns/openshift-ingress...
2026-06-02T01:29:41.035071152Z Gathering data for ns/openshift-ingress-canary...
2026-06-02T01:29:41.397676058Z Waiting for performance profile collector pods to become ready: 4
2026-06-02T01:29:41.506760394Z Gathering data for ns/openshift-insights...
2026-06-02T01:29:41.833490159Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-06-02T01:29:42.512566870Z Waiting for performance profile collector pods to become ready: 5
2026-06-02T01:29:43.615652144Z Gathering data for ns/opendatahub...
2026-06-02T01:29:43.630917960Z Waiting for performance profile collector pods to become ready: 6
2026-06-02T01:29:44.740255470Z Waiting for performance profile collector pods to become ready: 7
2026-06-02T01:29:45.386836000Z Gathering data for ns/openshift-lws-operator...
2026-06-02T01:29:45.880171942Z Waiting for performance profile collector pods to become ready: 8
2026-06-02T01:29:46.838117691Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-06-02T01:29:46.933204376Z Gathering data for ns/openshift-config...
2026-06-02T01:29:47.017014465Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-02T01:29:47.286230765Z Gathering data for ns/openshift-config-managed...
2026-06-02T01:29:47.302765904Z Collecting performance related data for node ip-10-0-139-243.ec2.internal
2026-06-02T01:29:47.310428524Z Collecting performance related data for node ip-10-0-135-17.ec2.internal
2026-06-02T01:29:47.328530943Z Collecting performance related data for node ip-10-0-138-192.ec2.internal
2026-06-02T01:29:47.840577097Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-02T01:29:48.241934132Z Gathering data for ns/openshift-kube-apiserver...
2026-06-02T01:29:48.671642341Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-02T01:29:49.073599723Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-02T01:29:49.408468460Z Gathering data for ns/openshift-kube-scheduler...
2026-06-02T01:29:49.765607665Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-02T01:29:50.166981816Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-02T01:29:50.567934960Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-02T01:29:50.925253483Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-02T01:29:51.503772205Z Gathering data for ns/openshift-multus...
2026-06-02T01:29:51.843707882Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-06-02T01:29:52.999771282Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-02T01:29:54.590839073Z Gathering data for ns/openshift-host-network...
2026-06-02T01:29:54.976546533Z Gathering data for ns/openshift-network-diagnostics...
2026-06-02T01:29:55.626506106Z Gathering data for ns/openshift-network-node-identity...
2026-06-02T01:29:55.941254757Z Collecting kubelet logs for node ip-10-0-139-243.ec2.internal
2026-06-02T01:29:55.943146643Z Collecting kubelet logs for node ip-10-0-135-17.ec2.internal
2026-06-02T01:29:55.944770575Z Collecting kubelet logs for node ip-10-0-138-192.ec2.internal
2026-06-02T01:29:56.178544619Z Gathering data for ns/openshift-network-operator...
2026-06-02T01:29:56.312619954Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-02T01:29:56.322238695Z INFO: Node performance data collection complete.
2026-06-02T01:29:56.647714060Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-02T01:29:56.850135169Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-06-02T01:29:56.961528451Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-02T01:29:57.443777180Z Gathering data for ns/openshift-apiserver-operator...
2026-06-02T01:29:57.800898766Z Gathering data for ns/openshift-apiserver...
2026-06-02T01:29:58.248494253Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-02T01:29:58.567309722Z Gathering data for ns/openshift-controller-manager...
2026-06-02T01:29:58.908106709Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-02T01:29:59.585079223Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-02T01:29:59.905079672Z Gathering data for ns/openshift-service-ca-operator...
2026-06-02T01:30:00.288692817Z Gathering data for ns/openshift-service-ca...
2026-06-02T01:30:00.680477533Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-02T01:30:01.729569880Z Wrote inspect data to must-gather.
2026-06-02T01:30:01.729618391Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T01:30:01.729618391Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-02T01:30:01.855356270Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-06-02T01:30:01.864192539Z error: the server doesn't have a resource type "clusters"
2026-06-02T01:30:02.043036587Z Caches written to disk