2026-06-02T17:02:10.821677231Z [disk usage checker] Started
2026-06-02T17:02:10.825895539Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T17:02:11.110979524Z Gathering data for ns/openshift-cluster-version...
2026-06-02T17:02:11.300620724Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T17:02:11.442306188Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T17:02:11.591808445Z Gathering data for ns/default...
2026-06-02T17:02:12.226500054Z Gathering data for ns/openshift...
2026-06-02T17:02:12.880545652Z Gathering data for ns/kube-system...
2026-06-02T17:02:13.820688011Z Gathering data for ns/openshift-etcd...
2026-06-02T17:02:14.116903417Z Waiting on subprocesses to finish execution.
2026-06-02T17:02:14.128335171Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-02T17:02:14.133953595Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-02T17:02:14.137324694Z INFO: Gathering HAProxy config files
2026-06-02T17:02:14.156474993Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-02T17:02:14.186941184Z INFO: Collecting host service logs for crio
2026-06-02T17:02:14.187433596Z INFO: Collecting host service logs for kubelet
2026-06-02T17:02:14.187908301Z INFO: Collecting host service logs for rpm-ostreed
2026-06-02T17:02:14.188226824Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-02T17:02:14.188590310Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-02T17:02:14.188955474Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-02T17:02:14.189350724Z INFO: Collecting host service logs for NetworkManager
2026-06-02T17:02:14.190010216Z INFO: Collecting host service logs for openvswitch
2026-06-02T17:02:14.190328203Z INFO: Collecting host service logs for ovs-configuration
2026-06-02T17:02:14.190626776Z INFO: Collecting host service logs for ovsdb-server
2026-06-02T17:02:14.190943362Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-02T17:02:14.191304765Z INFO: Waiting for worker host service log collection to complete ...
2026-06-02T17:02:14.314664801Z INFO: Waiting for node performance related collection to complete ...
2026-06-02T17:02:14.639803562Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-02T17:02:14.758240868Z Wrote inspect data to must-gather.
2026-06-02T17:02:14.758382667Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T17:02:14.758382667Z     namespaces "assisted-installer" not found
2026-06-02T17:02:14.921422932Z No resources found in openshift-etcd namespace.
2026-06-02T17:02:14.954380205Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-02T17:02:15.141058812Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-8lvd5
2026-06-02T17:02:15.141058812Z insights-runtime-extractor-ncs5x
2026-06-02T17:02:15.141058812Z insights-runtime-extractor-twsrw
2026-06-02T17:02:15.141058812Z insights-runtime-extractor-v48xh
2026-06-02T17:02:15.198423005Z INFO: "metallb-operator" not detected. Skipping.
2026-06-02T17:02:15.315622458Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-02T17:02:15.361846365Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-02T17:02:15.506880513Z ERROR: No running kube-apiserver pods found
2026-06-02T17:02:15.656228136Z No resources found
2026-06-02T17:02:15.709299863Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-02T17:02:15.855618441Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T17:02:16.301719137Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-02T17:02:16.301829888Z INFO: on-disk MachineConfig config collection complete.
2026-06-02T17:02:16.311590608Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T17:02:16.365274074Z error: the server doesn't have a resource type "performanceprofile"
2026-06-02T17:02:16.386991677Z Wrote inspect data to must-gather.
2026-06-02T17:02:16.607735164Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-02T17:02:16.607735164Z See 'oc rsync -h' for help and examples
2026-06-02T17:02:16.610630372Z INFO: Worker host service log collection to complete.
2026-06-02T17:02:16.616335325Z No resources found
2026-06-02T17:02:16.672010303Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-02T17:02:16.718485180Z Wrote inspect data to must-gather.
2026-06-02T17:02:16.731888944Z INFO: 'previous-logs' folder not found on ip-10-0-130-253.ec2.internal, skipping...
2026-06-02T17:02:16.809273275Z Wrote inspect data to must-gather.
2026-06-02T17:02:16.862335555Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-02T17:02:17.149659180Z Wrote inspect data to must-gather.
2026-06-02T17:02:17.187642791Z tar: Removing leading `/' from member names
2026-06-02T17:02:17.193082271Z INFO: HAProxy config collection complete.
2026-06-02T17:02:17.205474063Z Wrote inspect data to must-gather.
2026-06-02T17:02:17.234018539Z Wrote inspect data to must-gather.
2026-06-02T17:02:17.319646000Z Wrote inspect data to must-gather.
2026-06-02T17:02:17.325950924Z Gathering data for ns/kuadrant-system...
2026-06-02T17:02:17.348511251Z INFO: 'previous-logs' folder not found on ip-10-0-131-40.ec2.internal, skipping...
2026-06-02T17:02:17.472065597Z error: the server doesn't have a resource type "machineconfigs"
2026-06-02T17:02:17.503132316Z INFO: Getting rules from prometheus-k8s-0
2026-06-02T17:02:17.722457328Z INFO: 'previous-logs' folder not found on ip-10-0-132-45.ec2.internal, skipping...
2026-06-02T17:02:17.722500895Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-02T17:02:17.722531471Z INFO: Machine Config Daemon termination log collection complete.
2026-06-02T17:02:17.779496912Z Wrote inspect data to must-gather.
2026-06-02T17:02:17.906718666Z Wrote inspect data to must-gather.
2026-06-02T17:02:18.030530831Z INFO: Getting status/config from prometheus-k8s-0
2026-06-02T17:02:18.133356931Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T17:02:18.240228189Z Wrote inspect data to must-gather.
2026-06-02T17:02:18.313292935Z Wrote inspect data to must-gather.
2026-06-02T17:02:18.529740802Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-02T17:02:18.536462800Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-02T17:02:18.618096582Z INFO: INTERCONNECT MODE
2026-06-02T17:02:18.618150576Z INFO: Gathering ovn-kubernetes DBs
2026-06-02T17:02:18.731414628Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T17:02:18.814021706Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-02T17:02:18.852623215Z INFO: Gathering OVN_Northbound from ovnkube-node-2dmbr...
2026-06-02T17:02:18.853153863Z INFO: Gathering OVN_Northbound from ovnkube-node-7sjt8...
2026-06-02T17:02:18.853449939Z INFO: Gathering OVN_Northbound from ovnkube-node-l7zkw...
2026-06-02T17:02:18.853737031Z INFO: Gathering OVN_Southbound from ovnkube-node-2dmbr...
2026-06-02T17:02:18.854021907Z INFO: Gathering OVN_Southbound from ovnkube-node-7sjt8...
2026-06-02T17:02:18.854286454Z INFO: Gathering OVN_Southbound from ovnkube-node-l7zkw...
2026-06-02T17:02:19.013665289Z Gathering data for ns/openshift-monitoring...
2026-06-02T17:02:19.157413630Z Wrote inspect data to must-gather.
2026-06-02T17:02:19.199214621Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-02T17:02:19.264763720Z tar: Removing leading `/' from member names
2026-06-02T17:02:19.291847034Z tar: Removing leading `/' from member names
2026-06-02T17:02:19.385849100Z tar: Removing leading `/' from member names
2026-06-02T17:02:19.397469129Z tar: Removing leading `/' from member names
2026-06-02T17:02:19.415893213Z tar: Removing leading `/' from member names
2026-06-02T17:02:19.450648701Z tar: Removing leading `/' from member names
2026-06-02T17:02:19.585057752Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-02T17:02:19.713642332Z Wrote inspect data to must-gather.
2026-06-02T17:02:19.935590831Z INFO: Waiting for network log collection to complete ...
2026-06-02T17:02:19.935731494Z INFO: Waiting for ovnk database copies to complete ...
2026-06-02T17:02:19.936733721Z INFO: Copying ovnk databases complete.
2026-06-02T17:02:19.938791146Z 4.3M	must-gather/network_logs/ovnk_database_store
2026-06-02T17:02:19.941527034Z ovnk_database_store/
2026-06-02T17:02:19.941527034Z ovnk_database_store/ovnkube-node-7sjt8_sbdb
2026-06-02T17:02:19.969895689Z ovnk_database_store/ovnkube-node-l7zkw_sbdb
2026-06-02T17:02:19.992016523Z ovnk_database_store/ovnkube-node-2dmbr_nbdb
2026-06-02T17:02:20.003003803Z ovnk_database_store/ovnkube-node-2dmbr_sbdb
2026-06-02T17:02:20.033037101Z ovnk_database_store/ovnkube-node-7sjt8_nbdb
2026-06-02T17:02:20.046473584Z ovnk_database_store/ovnkube-node-l7zkw_nbdb
2026-06-02T17:02:20.062637295Z INFO: Network log collection complete.
2026-06-02T17:02:20.067193196Z INFO: Getting status from alertmanager-main-0
2026-06-02T17:02:20.132357198Z Wrote inspect data to must-gather.
2026-06-02T17:02:20.521693736Z Wrote inspect data to must-gather.
2026-06-02T17:02:20.855673951Z Wrote inspect data to must-gather.
2026-06-02T17:02:20.861855245Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T17:02:21.274710789Z Wrote inspect data to must-gather.
2026-06-02T17:02:21.340060689Z Gathering data for ns/openshift-network-console...
2026-06-02T17:02:21.766564433Z Wrote inspect data to must-gather.
2026-06-02T17:02:21.861432422Z Gathering data for ns/openshift-console-operator...
2026-06-02T17:02:22.063899274Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-02T17:02:22.066128853Z INFO: Fallback to identify the container image from release info
2026-06-02T17:02:22.335126679Z Gathering data for ns/openshift-console...
2026-06-02T17:02:22.762103333Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-02T17:02:22.863764371Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-02T17:02:22.910930244Z daemonset.apps/perf-node-gather-daemonset created
2026-06-02T17:02:23.073335157Z Waiting for performance profile collector pods to become ready: 1
2026-06-02T17:02:23.373996916Z Gathering data for ns/openshift-dns-operator...
2026-06-02T17:02:23.723681655Z Wrote inspect data to must-gather.
2026-06-02T17:02:23.741872510Z Gathering data for ns/openshift-dns...
2026-06-02T17:02:24.194466560Z Waiting for performance profile collector pods to become ready: 2
2026-06-02T17:02:24.345567528Z Gathering data for ns/openshift-image-registry...
2026-06-02T17:02:24.835002675Z Gathering data for ns/openshift-ingress-operator...
2026-06-02T17:02:25.174018508Z Gathering data for ns/openshift-ingress...
2026-06-02T17:02:25.304778732Z Waiting for performance profile collector pods to become ready: 3
2026-06-02T17:02:25.857869213Z Gathering data for ns/openshift-ingress-canary...
2026-06-02T17:02:25.866998146Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T17:02:26.306734642Z Gathering data for ns/openshift-insights...
2026-06-02T17:02:26.420888469Z Waiting for performance profile collector pods to become ready: 4
2026-06-02T17:02:27.530243965Z Waiting for performance profile collector pods to become ready: 5
2026-06-02T17:02:28.531511521Z Gathering data for ns/opendatahub...
2026-06-02T17:02:28.645058787Z Waiting for performance profile collector pods to become ready: 6
2026-06-02T17:02:29.760871261Z Waiting for performance profile collector pods to become ready: 7
2026-06-02T17:02:30.319933402Z Gathering data for ns/openshift-lws-operator...
2026-06-02T17:02:30.872792354Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T17:02:30.883423195Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-02T17:02:31.140492402Z Collecting performance related data for node ip-10-0-132-45.ec2.internal
2026-06-02T17:02:31.157441016Z Collecting performance related data for node ip-10-0-131-40.ec2.internal
2026-06-02T17:02:31.162462708Z Collecting performance related data for node ip-10-0-130-253.ec2.internal
2026-06-02T17:02:32.043395269Z Gathering data for ns/openshift-config...
2026-06-02T17:02:32.418935198Z Gathering data for ns/openshift-config-managed...
2026-06-02T17:02:32.946522635Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-02T17:02:33.272014184Z Gathering data for ns/openshift-kube-apiserver...
2026-06-02T17:02:33.604829379Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-02T17:02:34.019947719Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-02T17:02:34.375146423Z Gathering data for ns/openshift-kube-scheduler...
2026-06-02T17:02:34.691480674Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-02T17:02:35.015107576Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-02T17:02:35.362460150Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-02T17:02:35.727901448Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-02T17:02:35.877708267Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T17:02:36.405565871Z Gathering data for ns/openshift-multus...
2026-06-02T17:02:37.805807601Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-02T17:02:39.386368320Z Gathering data for ns/openshift-host-network...
2026-06-02T17:02:39.725872162Z Gathering data for ns/openshift-network-diagnostics...
2026-06-02T17:02:39.767925781Z Collecting kubelet logs for node ip-10-0-132-45.ec2.internal
2026-06-02T17:02:39.769780960Z Collecting kubelet logs for node ip-10-0-131-40.ec2.internal
2026-06-02T17:02:39.771695715Z Collecting kubelet logs for node ip-10-0-130-253.ec2.internal
2026-06-02T17:02:40.137829304Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-02T17:02:40.145543104Z INFO: Node performance data collection complete.
2026-06-02T17:02:40.390610081Z Gathering data for ns/openshift-network-node-identity...
2026-06-02T17:02:40.869522322Z Gathering data for ns/openshift-network-operator...
2026-06-02T17:02:40.882506721Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T17:02:41.288999897Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-02T17:02:41.591567604Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-02T17:02:42.104061954Z Gathering data for ns/openshift-apiserver-operator...
2026-06-02T17:02:42.448228351Z Gathering data for ns/openshift-apiserver...
2026-06-02T17:02:42.877499131Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-02T17:02:43.224615462Z Gathering data for ns/openshift-controller-manager...
2026-06-02T17:02:43.577338787Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-02T17:02:44.285697129Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-02T17:02:44.623555117Z Gathering data for ns/openshift-service-ca-operator...
2026-06-02T17:02:44.957642077Z Gathering data for ns/openshift-service-ca...
2026-06-02T17:02:45.349404125Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-02T17:02:45.888279182Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-02T17:02:46.376783092Z Wrote inspect data to must-gather.
2026-06-02T17:02:46.376824717Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T17:02:46.376824717Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-02T17:02:46.512643871Z error: the server doesn't have a resource type "clusters"
2026-06-02T17:02:46.692581757Z Caches written to disk