[must-gather ] OUT 2026-04-17T15:05:19.775973448Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 93a9d177-8176-4dde-96e4-dc2dc26bd2ca ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-04-17T15:05:19.82784288Z namespace/openshift-must-gather-q2msj created [must-gather ] OUT 2026-04-17T15:05:19.832061525Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-mp5mb created [must-gather ] OUT 2026-04-17T15:05:19.854583197Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-jgrt7] OUT 2026-04-17T15:06:10.692682983Z waiting for gather to complete [must-gather-jgrt7] OUT 2026-04-17T15:06:10.695003436Z downloading gather output [must-gather-jgrt7] OUT 2026-04-17T15:06:10.971852742Z receiving incremental file list [must-gather-jgrt7] OUT 2026-04-17T15:06:10.983773867Z ./ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.98390962Z aggregated-discovery-api.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.984219248Z aggregated-discovery-apis.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.984756373Z event-filter.html [must-gather-jgrt7] OUT 2026-04-17T15:06:10.984897367Z timestamp [must-gather-jgrt7] OUT 2026-04-17T15:06:10.98502415Z version [must-gather-jgrt7] OUT 2026-04-17T15:06:10.987615531Z namespaces/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.987629471Z namespaces/opendatahub/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.987712654Z namespaces/opendatahub/opendatahub.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.987868628Z namespaces/opendatahub/apps.openshift.io/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.987924619Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.987987271Z namespaces/opendatahub/apps/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.988046932Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.988146195Z namespaces/opendatahub/apps/deployments.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.988287559Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.988430933Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.988473304Z namespaces/opendatahub/autoscaling/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.988532786Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.988563607Z namespaces/opendatahub/batch/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.988620878Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.98870081Z namespaces/opendatahub/batch/jobs.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.988740291Z namespaces/opendatahub/build.openshift.io/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.988785603Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.988884445Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.988927416Z namespaces/opendatahub/core/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.988970038Z namespaces/opendatahub/core/configmaps.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.989097771Z namespaces/opendatahub/core/endpoints.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.989190394Z namespaces/opendatahub/core/events.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.989307217Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.989387479Z namespaces/opendatahub/core/pods.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.989521183Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.989656726Z namespaces/opendatahub/core/secrets.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.989852552Z namespaces/opendatahub/core/services.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.989915663Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.989952794Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.990012696Z namespaces/opendatahub/image.openshift.io/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.990044457Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.9901403Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.99017831Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.990257663Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.990298194Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.990345155Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.990386146Z namespaces/opendatahub/networking.k8s.io/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.990433997Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.990475979Z namespaces/opendatahub/pods/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.990482319Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-88gdk/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.99052312Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-88gdk/kubeflow-trainer-controller-manager-55f5694779-88gdk.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.990609162Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-88gdk/manager/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.990617662Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-88gdk/manager/manager/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.990621102Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-88gdk/manager/manager/logs/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.990658783Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-88gdk/manager/manager/logs/current.log [must-gather-jgrt7] OUT 2026-04-17T15:06:10.991037764Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-88gdk/manager/manager/logs/previous.insecure.log [must-gather-jgrt7] OUT 2026-04-17T15:06:10.991122126Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-88gdk/manager/manager/logs/previous.log [must-gather-jgrt7] OUT 2026-04-17T15:06:10.991158927Z namespaces/opendatahub/policy/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.991206529Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.99125404Z namespaces/opendatahub/route.openshift.io/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.991299901Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.991342022Z namespaces/openshift/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.991389363Z namespaces/openshift/openshift.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.991439805Z namespaces/openshift/apps.openshift.io/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.991485396Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.991528987Z namespaces/openshift/apps/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.991577439Z namespaces/openshift/apps/daemonsets.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.991648221Z namespaces/openshift/apps/deployments.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.991727823Z namespaces/openshift/apps/replicasets.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.991833306Z namespaces/openshift/apps/statefulsets.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.991892677Z namespaces/openshift/autoscaling/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.991939508Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.991980899Z namespaces/openshift/batch/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.992030521Z namespaces/openshift/batch/cronjobs.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.992125694Z namespaces/openshift/batch/jobs.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.992219056Z namespaces/openshift/build.openshift.io/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.992273247Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.992385521Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.992440262Z namespaces/openshift/core/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.992502764Z namespaces/openshift/core/configmaps.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.992632497Z namespaces/openshift/core/endpoints.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.99273753Z namespaces/openshift/core/events.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.992875234Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.992986487Z namespaces/openshift/core/pods.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.99309152Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.993258044Z namespaces/openshift/core/secrets.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.99347486Z namespaces/openshift/core/services.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.993538692Z namespaces/openshift/discovery.k8s.io/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.993600723Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.993661815Z namespaces/openshift/image.openshift.io/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.993718777Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.995711541Z namespaces/openshift/k8s.ovn.org/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.995748632Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.995934527Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.995978618Z namespaces/openshift/monitoring.coreos.com/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.996006169Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.996113622Z namespaces/openshift/networking.k8s.io/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.996135912Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.996227225Z namespaces/openshift/policy/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.996251046Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:10.996353018Z namespaces/openshift/route.openshift.io/ [must-gather-jgrt7] OUT 2026-04-17T15:06:10.996376289Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-jgrt7] OUT 2026-04-17T15:06:11.002728242Z [must-gather-jgrt7] OUT 2026-04-17T15:06:11.002741902Z sent 1,372 bytes received 74,689 bytes 50,707.33 bytes/sec [must-gather-jgrt7] OUT 2026-04-17T15:06:11.002746122Z total size is 880,642 speedup is 11.58 [must-gather ] OUT 2026-04-17T15:06:11.031220906Z namespace/openshift-must-gather-q2msj deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 93a9d177-8176-4dde-96e4-dc2dc26bd2ca ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing