[must-gather ] OUT 2026-04-21T07:16:22.363817848Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: c0560c47-2324-4c49-97fc-67a08e772b8c ClientVersion: 4.21.4 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-04-21T07:16:22.425415558Z namespace/openshift-must-gather-n589c created [must-gather ] OUT 2026-04-21T07:16:22.43339268Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-4fqhc created [must-gather ] OUT 2026-04-21T07:16:22.45817495Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-cfsjp] OUT 2026-04-21T07:17:15.804928191Z waiting for gather to complete [must-gather-cfsjp] OUT 2026-04-21T07:17:15.808771365Z downloading gather output [must-gather-cfsjp] OUT 2026-04-21T07:17:16.107842942Z receiving incremental file list [must-gather-cfsjp] OUT 2026-04-21T07:17:16.12256248Z ./ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.122643153Z aggregated-discovery-api.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.12290754Z aggregated-discovery-apis.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.123548497Z event-filter.html [must-gather-cfsjp] OUT 2026-04-21T07:17:16.12365186Z timestamp [must-gather-cfsjp] OUT 2026-04-21T07:17:16.123765653Z version [must-gather-cfsjp] OUT 2026-04-21T07:17:16.127321359Z namespaces/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.12735887Z namespaces/opendatahub/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.127417091Z namespaces/opendatahub/opendatahub.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.127504164Z namespaces/opendatahub/apps.openshift.io/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.127560286Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.127609617Z namespaces/opendatahub/apps/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.127655598Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.127762021Z namespaces/opendatahub/apps/deployments.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.127895415Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.128044979Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.128067489Z namespaces/opendatahub/autoscaling/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.128127471Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.128199613Z namespaces/opendatahub/batch/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.128238924Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.128352477Z namespaces/opendatahub/batch/jobs.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.128410388Z namespaces/opendatahub/build.openshift.io/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.12846807Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.128574503Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.128613864Z namespaces/opendatahub/core/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.128679026Z namespaces/opendatahub/core/configmaps.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.128810789Z namespaces/opendatahub/core/endpoints.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.128911802Z namespaces/opendatahub/core/events.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.129035925Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.129130548Z namespaces/opendatahub/core/pods.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.129263272Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.129437476Z namespaces/opendatahub/core/secrets.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.129620881Z namespaces/opendatahub/core/services.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.129690503Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.129740834Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.129814396Z namespaces/opendatahub/image.openshift.io/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.129849967Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.12994251Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.129988981Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.130092444Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.130146616Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.130202067Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.130256139Z namespaces/opendatahub/networking.k8s.io/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.130334381Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.130414393Z namespaces/opendatahub/pods/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.130422453Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7c5547bb65-gp899/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.130480174Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7c5547bb65-gp899/kubeflow-trainer-controller-manager-7c5547bb65-gp899.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.130557857Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7c5547bb65-gp899/manager/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.130569547Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7c5547bb65-gp899/manager/manager/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.130573827Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7c5547bb65-gp899/manager/manager/logs/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.130619568Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7c5547bb65-gp899/manager/manager/logs/current.log [must-gather-cfsjp] OUT 2026-04-21T07:17:16.131964035Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7c5547bb65-gp899/manager/manager/logs/previous.insecure.log [must-gather-cfsjp] OUT 2026-04-21T07:17:16.132036436Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7c5547bb65-gp899/manager/manager/logs/previous.log [must-gather-cfsjp] OUT 2026-04-21T07:17:16.132076028Z namespaces/opendatahub/policy/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.132115039Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.13215472Z namespaces/opendatahub/route.openshift.io/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.132193101Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.132236462Z namespaces/openshift/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.132273643Z namespaces/openshift/openshift.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.132351795Z namespaces/openshift/apps.openshift.io/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.132381136Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.132430637Z namespaces/openshift/apps/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.132466298Z namespaces/openshift/apps/daemonsets.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.13255597Z namespaces/openshift/apps/deployments.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.132631853Z namespaces/openshift/apps/replicasets.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.132710025Z namespaces/openshift/apps/statefulsets.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.132757596Z namespaces/openshift/autoscaling/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.132793127Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.132839398Z namespaces/openshift/batch/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.132873469Z namespaces/openshift/batch/cronjobs.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.132955411Z namespaces/openshift/batch/jobs.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.132990832Z namespaces/openshift/build.openshift.io/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.133024663Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.133111536Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.133163037Z namespaces/openshift/core/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.133196848Z namespaces/openshift/core/configmaps.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.133308561Z namespaces/openshift/core/endpoints.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.133408784Z namespaces/openshift/core/events.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.133486626Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.133588078Z namespaces/openshift/core/pods.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.133686131Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.133825235Z namespaces/openshift/core/secrets.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.133993729Z namespaces/openshift/core/services.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.134056021Z namespaces/openshift/discovery.k8s.io/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.134114233Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.134170294Z namespaces/openshift/image.openshift.io/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.134221516Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.135445289Z namespaces/openshift/k8s.ovn.org/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.13549338Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.135598663Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.135651054Z namespaces/openshift/monitoring.coreos.com/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.135709226Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.135763497Z namespaces/openshift/networking.k8s.io/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.135816459Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.13586665Z namespaces/openshift/policy/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.135917721Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.135975973Z namespaces/openshift/route.openshift.io/ [must-gather-cfsjp] OUT 2026-04-21T07:17:16.136028924Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-cfsjp] OUT 2026-04-21T07:17:16.144559555Z [must-gather-cfsjp] OUT 2026-04-21T07:17:16.144580186Z sent 1,372 bytes received 100,277 bytes 67,766.00 bytes/sec [must-gather-cfsjp] OUT 2026-04-21T07:17:16.144587286Z total size is 1,302,332 speedup is 12.81 [must-gather ] OUT 2026-04-21T07:17:16.17652683Z namespace/openshift-must-gather-n589c deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: c0560c47-2324-4c49-97fc-67a08e772b8c ClientVersion: 4.21.4 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing