[must-gather ] OUT 2026-07-30T16:03:52.35680697Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 826604b3-8561-431a-8522-d1ddb0122820 ClientVersion: 4.22.5 ClusterVersion: Stable at "4.21.26" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-07-30T16:03:52.416826744Z namespace/openshift-must-gather-sl5cr created [must-gather ] OUT 2026-07-30T16:03:52.426747837Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-5njnd created [must-gather ] OUT 2026-07-30T16:03:52.450101013Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-fblbh] OUT 2026-07-30T16:04:47.661514055Z waiting for gather to complete [must-gather-fblbh] OUT 2026-07-30T16:04:47.665372333Z downloading gather output [must-gather-fblbh] OUT 2026-07-30T16:04:47.969266656Z receiving incremental file list [must-gather-fblbh] OUT 2026-07-30T16:04:47.9813065Z ./ [must-gather-fblbh] OUT 2026-07-30T16:04:47.981503374Z aggregated-discovery-api.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.982044385Z aggregated-discovery-apis.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.982877802Z event-filter.html [must-gather-fblbh] OUT 2026-07-30T16:04:47.982989844Z timestamp [must-gather-fblbh] OUT 2026-07-30T16:04:47.983097356Z version [must-gather-fblbh] OUT 2026-07-30T16:04:47.985433164Z namespaces/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.985452284Z namespaces/opendatahub/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.985476525Z namespaces/opendatahub/opendatahub.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.985569896Z namespaces/opendatahub/apps.openshift.io/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.985629708Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.985667538Z namespaces/opendatahub/apps/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.9857296Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.985828522Z namespaces/opendatahub/apps/deployments.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.986084587Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.986189359Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.98623542Z namespaces/opendatahub/autoscaling/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.986274021Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.986323632Z namespaces/opendatahub/batch/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.986368193Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.986470005Z namespaces/opendatahub/batch/jobs.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.986516096Z namespaces/opendatahub/build.openshift.io/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.986554527Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.986649729Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.986693409Z namespaces/opendatahub/core/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.98673415Z namespaces/opendatahub/core/configmaps.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.986857863Z namespaces/opendatahub/core/endpoints.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.986941694Z namespaces/opendatahub/core/events.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.987053477Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.987130728Z namespaces/opendatahub/core/pods.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.98724557Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.987361823Z namespaces/opendatahub/core/secrets.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.987555087Z namespaces/opendatahub/core/services.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.987613488Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.987665439Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.98771922Z namespaces/opendatahub/image.openshift.io/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.987762191Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.987849903Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.987887483Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.987968355Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.988005606Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.988049267Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.988095588Z namespaces/opendatahub/networking.k8s.io/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.988133659Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.988179689Z namespaces/opendatahub/pods/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.98818676Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-qgxc9/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.988228421Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-qgxc9/kubeflow-trainer-controller-manager-7b4fcbc79d-qgxc9.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.988305092Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-qgxc9/manager/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.988312712Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-qgxc9/manager/manager/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.988318582Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-qgxc9/manager/manager/logs/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.988348093Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-qgxc9/manager/manager/logs/current.log [must-gather-fblbh] OUT 2026-07-30T16:04:47.988548517Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-qgxc9/manager/manager/logs/previous.insecure.log [must-gather-fblbh] OUT 2026-07-30T16:04:47.988622269Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-qgxc9/manager/manager/logs/previous.log [must-gather-fblbh] OUT 2026-07-30T16:04:47.988648869Z namespaces/opendatahub/policy/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.98868169Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.988737571Z namespaces/opendatahub/route.openshift.io/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.988770441Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.988816522Z namespaces/openshift/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.988852803Z namespaces/openshift/openshift.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.988908004Z namespaces/openshift/apps.openshift.io/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.988951595Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.989000286Z namespaces/openshift/apps/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.989026587Z namespaces/openshift/apps/daemonsets.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.989113419Z namespaces/openshift/apps/deployments.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.98919112Z namespaces/openshift/apps/replicasets.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.989270032Z namespaces/openshift/apps/statefulsets.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.989318093Z namespaces/openshift/autoscaling/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.989360153Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.989410074Z namespaces/openshift/batch/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.989479226Z namespaces/openshift/batch/cronjobs.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.989546997Z namespaces/openshift/batch/jobs.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.989594708Z namespaces/openshift/build.openshift.io/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.989625439Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.989713691Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.989755172Z namespaces/openshift/core/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.989784202Z namespaces/openshift/core/configmaps.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.989888104Z namespaces/openshift/core/endpoints.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.989964676Z namespaces/openshift/core/events.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.990042967Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.990121479Z namespaces/openshift/core/pods.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.990204821Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.990332353Z namespaces/openshift/core/secrets.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.990513597Z namespaces/openshift/core/services.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.990563948Z namespaces/openshift/discovery.k8s.io/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.990606279Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.99066935Z namespaces/openshift/image.openshift.io/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.990693171Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.9921705Z namespaces/openshift/k8s.ovn.org/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.992197251Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.992289293Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.992332584Z namespaces/openshift/monitoring.coreos.com/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.992363264Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.992421746Z namespaces/openshift/networking.k8s.io/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.992474056Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.992516357Z namespaces/openshift/policy/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.992559468Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:47.992604709Z namespaces/openshift/route.openshift.io/ [must-gather-fblbh] OUT 2026-07-30T16:04:47.99264882Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-fblbh] OUT 2026-07-30T16:04:48.000217434Z [must-gather-fblbh] OUT 2026-07-30T16:04:48.000234914Z sent 1,372 bytes received 71,001 bytes 144,746.00 bytes/sec [must-gather-fblbh] OUT 2026-07-30T16:04:48.000240794Z total size is 843,417 speedup is 11.65 [must-gather ] OUT 2026-07-30T16:04:48.032424457Z namespace/openshift-must-gather-sl5cr deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 826604b3-8561-431a-8522-d1ddb0122820 ClientVersion: 4.22.5 ClusterVersion: Stable at "4.21.26" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing