[must-gather ] OUT 2026-06-09T09:43:17.779983737Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: c4e36e1b-b991-47e9-a0cc-2cb191f26ca8 ClientVersion: 4.21.9 ClusterVersion: Stable at "4.21.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-06-09T09:43:17.823101191Z namespace/openshift-must-gather-flb6v created [must-gather ] OUT 2026-06-09T09:43:17.829313167Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-kgchq created [must-gather ] OUT 2026-06-09T09:43:17.857485821Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-9dm7t] OUT 2026-06-09T09:44:09.006371891Z waiting for gather to complete [must-gather-9dm7t] OUT 2026-06-09T09:44:09.008364318Z downloading gather output [must-gather-9dm7t] OUT 2026-06-09T09:44:09.266680566Z receiving incremental file list [must-gather-9dm7t] OUT 2026-06-09T09:44:09.276387057Z ./ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.276467588Z aggregated-discovery-api.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.276901304Z aggregated-discovery-apis.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.277452872Z event-filter.html [must-gather-9dm7t] OUT 2026-06-09T09:44:09.277566393Z timestamp [must-gather-9dm7t] OUT 2026-06-09T09:44:09.277667304Z version [must-gather-9dm7t] OUT 2026-06-09T09:44:09.280928119Z namespaces/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.280969139Z namespaces/opendatahub/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.28101616Z namespaces/opendatahub/opendatahub.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.28105821Z namespaces/opendatahub/apps.openshift.io/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.281139651Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.281168852Z namespaces/opendatahub/apps/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.281259603Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.281373805Z namespaces/opendatahub/apps/deployments.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.281439595Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.281536427Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.281566387Z namespaces/opendatahub/autoscaling/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.281621238Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.281653678Z namespaces/opendatahub/batch/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.281702229Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.28177788Z namespaces/opendatahub/batch/jobs.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.281823841Z namespaces/opendatahub/build.openshift.io/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.281861161Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.281933122Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.281978293Z namespaces/opendatahub/core/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.282021283Z namespaces/opendatahub/core/configmaps.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.282133795Z namespaces/opendatahub/core/endpoints.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.282208076Z namespaces/opendatahub/core/events.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.282344048Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.282412799Z namespaces/opendatahub/core/pods.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.28252739Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.282644152Z namespaces/opendatahub/core/secrets.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.282804584Z namespaces/opendatahub/core/services.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.282856685Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.282897825Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.282933366Z namespaces/opendatahub/image.openshift.io/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.282981786Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.283067337Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.283101678Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.283188369Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.28322245Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.28328844Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.283350811Z namespaces/opendatahub/networking.k8s.io/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.283371722Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.283427102Z namespaces/opendatahub/pods/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.283435202Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-jhqcx/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.283480613Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-jhqcx/kubeflow-trainer-controller-manager-857f77d56c-jhqcx.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.283578844Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-jhqcx/manager/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.283587855Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-jhqcx/manager/manager/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.283591624Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-jhqcx/manager/manager/logs/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.283623525Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-jhqcx/manager/manager/logs/current.log [must-gather-9dm7t] OUT 2026-06-09T09:44:09.283774967Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-jhqcx/manager/manager/logs/previous.insecure.log [must-gather-9dm7t] OUT 2026-06-09T09:44:09.283840858Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-jhqcx/manager/manager/logs/previous.log [must-gather-9dm7t] OUT 2026-06-09T09:44:09.283872388Z namespaces/opendatahub/policy/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.283911409Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.283965Z namespaces/opendatahub/route.openshift.io/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.28400156Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.284045661Z namespaces/openshift/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.284090321Z namespaces/openshift/openshift.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.284142552Z namespaces/openshift/apps.openshift.io/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.284173262Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.284222373Z namespaces/openshift/apps/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.284286434Z namespaces/openshift/apps/daemonsets.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.284365105Z namespaces/openshift/apps/deployments.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.284443506Z namespaces/openshift/apps/replicasets.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.284514167Z namespaces/openshift/apps/statefulsets.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.284561878Z namespaces/openshift/autoscaling/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.284600338Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.284647499Z namespaces/openshift/batch/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.284685859Z namespaces/openshift/batch/cronjobs.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.28476063Z namespaces/openshift/batch/jobs.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.284804851Z namespaces/openshift/build.openshift.io/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.284847332Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.284924202Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.284969773Z namespaces/openshift/core/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.285006583Z namespaces/openshift/core/configmaps.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.285105755Z namespaces/openshift/core/endpoints.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.285183536Z namespaces/openshift/core/events.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.285284147Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.285358638Z namespaces/openshift/core/pods.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.285433479Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.285548691Z namespaces/openshift/core/secrets.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.285702023Z namespaces/openshift/core/services.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.285746304Z namespaces/openshift/discovery.k8s.io/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.285784724Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.285832055Z namespaces/openshift/image.openshift.io/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.285869215Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.287178803Z namespaces/openshift/k8s.ovn.org/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.287223433Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.287345985Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.287367586Z namespaces/openshift/monitoring.coreos.com/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.287424216Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.287470347Z namespaces/openshift/networking.k8s.io/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.287495707Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.287554718Z namespaces/openshift/policy/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.287584738Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.287637189Z namespaces/openshift/route.openshift.io/ [must-gather-9dm7t] OUT 2026-06-09T09:44:09.287666959Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-9dm7t] OUT 2026-06-09T09:44:09.293081173Z [must-gather-9dm7t] OUT 2026-06-09T09:44:09.293109713Z sent 1,372 bytes received 69,366 bytes 141,476.00 bytes/sec [must-gather-9dm7t] OUT 2026-06-09T09:44:09.293118273Z total size is 817,214 speedup is 11.55 [must-gather ] OUT 2026-06-09T09:44:09.321111641Z namespace/openshift-must-gather-flb6v deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: c4e36e1b-b991-47e9-a0cc-2cb191f26ca8 ClientVersion: 4.21.9 ClusterVersion: Stable at "4.21.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing