[must-gather ] OUT 2026-06-05T15:30:18.812301056Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 3ced2398-4b11-4500-9a8f-c8052bc36b61 ClientVersion: 4.21.9 ClusterVersion: Stable at "4.21.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-06-05T15:30:18.867675282Z namespace/openshift-must-gather-9gwrp created [must-gather ] OUT 2026-06-05T15:30:18.878028022Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-fwgfq created [must-gather ] OUT 2026-06-05T15:30:18.911768976Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-h2rw9] OUT 2026-06-05T15:31:21.112957929Z waiting for gather to complete [must-gather-h2rw9] OUT 2026-06-05T15:31:21.116464013Z downloading gather output [must-gather-h2rw9] OUT 2026-06-05T15:31:21.40630848Z receiving incremental file list [must-gather-h2rw9] OUT 2026-06-05T15:31:21.417237404Z ./ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.417324916Z aggregated-discovery-api.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.420596765Z aggregated-discovery-apis.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.421304062Z event-filter.html [must-gather-h2rw9] OUT 2026-06-05T15:31:21.421544637Z timestamp [must-gather-h2rw9] OUT 2026-06-05T15:31:21.4216492Z version [must-gather-h2rw9] OUT 2026-06-05T15:31:21.421774523Z namespaces/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.421794454Z namespaces/opendatahub/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.421831824Z namespaces/opendatahub/opendatahub.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.421910676Z namespaces/opendatahub/apps.openshift.io/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.421929187Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.421988588Z namespaces/opendatahub/apps/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.422001028Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.422104221Z namespaces/opendatahub/apps/deployments.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.422209084Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.422311626Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.422338437Z namespaces/opendatahub/autoscaling/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.422382888Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.422417289Z namespaces/opendatahub/batch/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.42246573Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.422540981Z namespaces/opendatahub/batch/jobs.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.422589223Z namespaces/opendatahub/build.openshift.io/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.422623834Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.422701576Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.422764377Z namespaces/opendatahub/core/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.422801998Z namespaces/opendatahub/core/configmaps.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.422917201Z namespaces/opendatahub/core/endpoints.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.423038584Z namespaces/opendatahub/core/events.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.423155896Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.423225448Z namespaces/opendatahub/core/pods.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.423346821Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.423461614Z namespaces/opendatahub/core/secrets.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.423633978Z namespaces/opendatahub/core/services.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.423693109Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.423752351Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.423815832Z namespaces/opendatahub/image.openshift.io/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.423846643Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.423940635Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.423978786Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424049858Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424100789Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.42414278Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424185431Z namespaces/opendatahub/networking.k8s.io/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424222602Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424263903Z namespaces/opendatahub/pods/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424272233Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-5jxgr/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424306474Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-5jxgr/kubeflow-trainer-controller-manager-857f77d56c-5jxgr.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424386396Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-5jxgr/manager/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424394196Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-5jxgr/manager/manager/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424397996Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-5jxgr/manager/manager/logs/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424426087Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-5jxgr/manager/manager/logs/current.log [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424591051Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-5jxgr/manager/manager/logs/previous.insecure.log [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424658143Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-5jxgr/manager/manager/logs/previous.log [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424745925Z namespaces/opendatahub/policy/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424767665Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424829957Z namespaces/opendatahub/route.openshift.io/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424865828Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424907779Z namespaces/openshift/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424938559Z namespaces/openshift/openshift.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.424993051Z namespaces/openshift/apps.openshift.io/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.425023021Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.425071922Z namespaces/openshift/apps/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.425100863Z namespaces/openshift/apps/daemonsets.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.425182065Z namespaces/openshift/apps/deployments.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.425260437Z namespaces/openshift/apps/replicasets.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.425328469Z namespaces/openshift/apps/statefulsets.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.42537454Z namespaces/openshift/autoscaling/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.425414271Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.425456692Z namespaces/openshift/batch/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.425502213Z namespaces/openshift/batch/cronjobs.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.425579255Z namespaces/openshift/batch/jobs.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.425621796Z namespaces/openshift/build.openshift.io/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.425658877Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.425745489Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.42578856Z namespaces/openshift/core/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.425827391Z namespaces/openshift/core/configmaps.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.425943463Z namespaces/openshift/core/endpoints.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.426013545Z namespaces/openshift/core/events.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.426093817Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.426166669Z namespaces/openshift/core/pods.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.426247241Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.426366664Z namespaces/openshift/core/secrets.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.426530828Z namespaces/openshift/core/services.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.426569399Z namespaces/openshift/discovery.k8s.io/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.42661528Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.426650221Z namespaces/openshift/image.openshift.io/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.426694952Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.428245179Z namespaces/openshift/k8s.ovn.org/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.42827607Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.428364312Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.428402383Z namespaces/openshift/monitoring.coreos.com/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.428445484Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.428482845Z namespaces/openshift/networking.k8s.io/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.428514936Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.428562147Z namespaces/openshift/policy/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.428592267Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.428645929Z namespaces/openshift/route.openshift.io/ [must-gather-h2rw9] OUT 2026-06-05T15:31:21.42868488Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-h2rw9] OUT 2026-06-05T15:31:21.435018472Z [must-gather-h2rw9] OUT 2026-06-05T15:31:21.435045063Z sent 1,372 bytes received 69,994 bytes 142,732.00 bytes/sec [must-gather-h2rw9] OUT 2026-06-05T15:31:21.435053573Z total size is 821,564 speedup is 11.51 [must-gather ] OUT 2026-06-05T15:31:21.463432047Z namespace/openshift-must-gather-9gwrp deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 3ced2398-4b11-4500-9a8f-c8052bc36b61 ClientVersion: 4.21.9 ClusterVersion: Stable at "4.21.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing