[must-gather ] OUT 2026-06-05T10:34:52.624101281Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 2137459f-7d5d-4173-bd94-6d098770ac5e ClientVersion: 4.21.9 ClusterVersion: Stable at "4.21.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-06-05T10:34:52.668557587Z namespace/openshift-must-gather-sxk8f created [must-gather ] OUT 2026-06-05T10:34:52.672924118Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-cjzl6 created [must-gather ] OUT 2026-06-05T10:34:52.721992347Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-f78bd] OUT 2026-06-05T10:35:44.560885788Z waiting for gather to complete [must-gather-f78bd] OUT 2026-06-05T10:35:44.563575414Z downloading gather output [must-gather-f78bd] OUT 2026-06-05T10:35:44.803477974Z receiving incremental file list [must-gather-f78bd] OUT 2026-06-05T10:35:44.813832449Z ./ [must-gather-f78bd] OUT 2026-06-05T10:35:44.813905883Z aggregated-discovery-api.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.814197497Z aggregated-discovery-apis.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.814794817Z event-filter.html [must-gather-f78bd] OUT 2026-06-05T10:35:44.814914614Z timestamp [must-gather-f78bd] OUT 2026-06-05T10:35:44.815017079Z version [must-gather-f78bd] OUT 2026-06-05T10:35:44.81721273Z namespaces/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.817222871Z namespaces/opendatahub/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.817285424Z namespaces/opendatahub/opendatahub.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.817377508Z namespaces/opendatahub/apps.openshift.io/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.81741812Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.817461443Z namespaces/opendatahub/apps/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.817529126Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.817620541Z namespaces/opendatahub/apps/deployments.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.817772038Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.817898125Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.817940337Z namespaces/opendatahub/autoscaling/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.817988339Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.818044882Z namespaces/opendatahub/batch/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.818082014Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.81819088Z namespaces/opendatahub/batch/jobs.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.818230542Z namespaces/opendatahub/build.openshift.io/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.818285704Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.818358958Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.8184031Z namespaces/opendatahub/core/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.818438832Z namespaces/opendatahub/core/configmaps.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.818556878Z namespaces/opendatahub/core/endpoints.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.818628982Z namespaces/opendatahub/core/events.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.818740907Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.818814071Z namespaces/opendatahub/core/pods.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.818934127Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.819051473Z namespaces/opendatahub/core/secrets.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.819246083Z namespaces/opendatahub/core/services.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.819284755Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.819331987Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.81938021Z namespaces/opendatahub/image.openshift.io/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.819419182Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.819519907Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.819561949Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.819626412Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.819674785Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.819711297Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.819745898Z namespaces/opendatahub/networking.k8s.io/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.81978277Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.819819272Z namespaces/opendatahub/pods/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.819826442Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-q79pq/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.819877015Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-q79pq/kubeflow-trainer-controller-manager-857f77d56c-q79pq.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.819967899Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-q79pq/manager/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.819991351Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-q79pq/manager/manager/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.819995181Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-q79pq/manager/manager/logs/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.820001541Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-q79pq/manager/manager/logs/current.log [must-gather-f78bd] OUT 2026-06-05T10:35:44.820202871Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-q79pq/manager/manager/logs/previous.insecure.log [must-gather-f78bd] OUT 2026-06-05T10:35:44.820269835Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-q79pq/manager/manager/logs/previous.log [must-gather-f78bd] OUT 2026-06-05T10:35:44.820301026Z namespaces/opendatahub/policy/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.820332708Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.820381231Z namespaces/opendatahub/route.openshift.io/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.820414272Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.820452374Z namespaces/openshift/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.820502137Z namespaces/openshift/openshift.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.820557369Z namespaces/openshift/apps.openshift.io/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.820599182Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.820641104Z namespaces/openshift/apps/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.820682316Z namespaces/openshift/apps/daemonsets.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.82076043Z namespaces/openshift/apps/deployments.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.820831903Z namespaces/openshift/apps/replicasets.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.820906337Z namespaces/openshift/apps/statefulsets.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.820952249Z namespaces/openshift/autoscaling/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.820988081Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.821029983Z namespaces/openshift/batch/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.821068195Z namespaces/openshift/batch/cronjobs.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.821177161Z namespaces/openshift/batch/jobs.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.821215043Z namespaces/openshift/build.openshift.io/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.821257955Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.821335949Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.821379461Z namespaces/openshift/core/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.821421443Z namespaces/openshift/core/configmaps.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.821515508Z namespaces/openshift/core/endpoints.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.821586501Z namespaces/openshift/core/events.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.821655315Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.821741409Z namespaces/openshift/core/pods.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.821812613Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.821925229Z namespaces/openshift/core/secrets.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.822080666Z namespaces/openshift/core/services.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.82215429Z namespaces/openshift/discovery.k8s.io/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.822183172Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.822240185Z namespaces/openshift/image.openshift.io/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.822278456Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.823761162Z namespaces/openshift/k8s.ovn.org/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.823807264Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.823889908Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.82393113Z namespaces/openshift/monitoring.coreos.com/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.823961642Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.824009244Z namespaces/openshift/networking.k8s.io/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.824027615Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.824079068Z namespaces/openshift/policy/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.824137941Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.824186663Z namespaces/openshift/route.openshift.io/ [must-gather-f78bd] OUT 2026-06-05T10:35:44.824232386Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-f78bd] OUT 2026-06-05T10:35:44.829986357Z [must-gather-f78bd] OUT 2026-06-05T10:35:44.830012058Z sent 1,372 bytes received 70,310 bytes 143,364.00 bytes/sec [must-gather-f78bd] OUT 2026-06-05T10:35:44.830020179Z total size is 824,840 speedup is 11.51 [must-gather ] OUT 2026-06-05T10:35:44.860688272Z namespace/openshift-must-gather-sxk8f deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 2137459f-7d5d-4173-bd94-6d098770ac5e ClientVersion: 4.21.9 ClusterVersion: Stable at "4.21.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing