[must-gather ] OUT 2026-06-05T20:33:09.868852105Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 2a2dc7ed-6cff-4779-8942-50b5a1ecedeb ClientVersion: 4.21.9 ClusterVersion: Stable at "4.21.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-06-05T20:33:09.921452265Z namespace/openshift-must-gather-pcr45 created [must-gather ] OUT 2026-06-05T20:33:09.928715649Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-qb5c8 created [must-gather ] OUT 2026-06-05T20:33:09.946481208Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-6nmb4] OUT 2026-06-05T20:34:05.120154745Z waiting for gather to complete [must-gather-6nmb4] OUT 2026-06-05T20:34:05.123259435Z downloading gather output [must-gather-6nmb4] OUT 2026-06-05T20:34:05.394760228Z receiving incremental file list [must-gather-6nmb4] OUT 2026-06-05T20:34:05.405698187Z ./ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.405867746Z aggregated-discovery-api.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.409505866Z aggregated-discovery-apis.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.410567594Z event-filter.html [must-gather-6nmb4] OUT 2026-06-05T20:34:05.410687381Z timestamp [must-gather-6nmb4] OUT 2026-06-05T20:34:05.410814388Z version [must-gather-6nmb4] OUT 2026-06-05T20:34:05.410943995Z namespaces/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.410953595Z namespaces/opendatahub/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.411004718Z namespaces/opendatahub/opendatahub.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.411076062Z namespaces/opendatahub/apps.openshift.io/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.411152086Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.411201199Z namespaces/opendatahub/apps/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.411266522Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.411347227Z namespaces/opendatahub/apps/deployments.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.411470944Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.41158487Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.411636093Z namespaces/opendatahub/autoscaling/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.411691906Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.411744119Z namespaces/opendatahub/batch/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.411796891Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.411887236Z namespaces/opendatahub/batch/jobs.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.411940249Z namespaces/opendatahub/build.openshift.io/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.411991062Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.412079707Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.412149751Z namespaces/opendatahub/core/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.412203694Z namespaces/opendatahub/core/configmaps.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.412329911Z namespaces/opendatahub/core/endpoints.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.412406245Z namespaces/opendatahub/core/events.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.412521231Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.412590745Z namespaces/opendatahub/core/pods.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.412715222Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.412831178Z namespaces/opendatahub/core/secrets.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.412999837Z namespaces/opendatahub/core/services.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.41304772Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.413092982Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.413173157Z namespaces/opendatahub/image.openshift.io/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.413217509Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.413319135Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.413361367Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.413438631Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.413491304Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.413517725Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.413559348Z namespaces/opendatahub/networking.k8s.io/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.413622801Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.413665724Z namespaces/opendatahub/pods/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.413672934Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-l7p97/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.413739428Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-l7p97/kubeflow-trainer-controller-manager-857f77d56c-l7p97.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.413823042Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-l7p97/manager/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.413832203Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-l7p97/manager/manager/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.413836073Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-l7p97/manager/manager/logs/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.413893266Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-l7p97/manager/manager/logs/current.log [must-gather-6nmb4] OUT 2026-06-05T20:34:05.414074886Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-l7p97/manager/manager/logs/previous.insecure.log [must-gather-6nmb4] OUT 2026-06-05T20:34:05.414173052Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-l7p97/manager/manager/logs/previous.log [must-gather-6nmb4] OUT 2026-06-05T20:34:05.414216384Z namespaces/opendatahub/policy/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.414280587Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.41433484Z namespaces/opendatahub/route.openshift.io/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.414395734Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.414449987Z namespaces/openshift/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.41450583Z namespaces/openshift/openshift.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.414566693Z namespaces/openshift/apps.openshift.io/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.414611765Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.414676159Z namespaces/openshift/apps/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.414714331Z namespaces/openshift/apps/daemonsets.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.414815597Z namespaces/openshift/apps/deployments.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.414911592Z namespaces/openshift/apps/replicasets.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.415002657Z namespaces/openshift/apps/statefulsets.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.415046839Z namespaces/openshift/autoscaling/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.415122744Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.415186727Z namespaces/openshift/batch/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.41524062Z namespaces/openshift/batch/cronjobs.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.415335485Z namespaces/openshift/batch/jobs.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.415392278Z namespaces/openshift/build.openshift.io/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.415438321Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.415538996Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.415579539Z namespaces/openshift/core/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.415643732Z namespaces/openshift/core/configmaps.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.415752838Z namespaces/openshift/core/endpoints.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.415838913Z namespaces/openshift/core/events.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.415933268Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.416029173Z namespaces/openshift/core/pods.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.416134099Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.416286797Z namespaces/openshift/core/secrets.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.416453766Z namespaces/openshift/core/services.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.41651451Z namespaces/openshift/discovery.k8s.io/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.416563923Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.416622586Z namespaces/openshift/image.openshift.io/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.416671428Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.418200902Z namespaces/openshift/k8s.ovn.org/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.418257145Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.418360431Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.418408313Z namespaces/openshift/monitoring.coreos.com/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.418465237Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.418507379Z namespaces/openshift/networking.k8s.io/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.418572082Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.418614345Z namespaces/openshift/policy/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.418677698Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.41871925Z namespaces/openshift/route.openshift.io/ [must-gather-6nmb4] OUT 2026-06-05T20:34:05.418781524Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-6nmb4] OUT 2026-06-05T20:34:05.424810124Z [must-gather-6nmb4] OUT 2026-06-05T20:34:05.424824045Z sent 1,372 bytes received 70,164 bytes 143,072.00 bytes/sec [must-gather-6nmb4] OUT 2026-06-05T20:34:05.424831535Z total size is 821,554 speedup is 11.48 [must-gather ] OUT 2026-06-05T20:34:05.453660925Z namespace/openshift-must-gather-pcr45 deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 2a2dc7ed-6cff-4779-8942-50b5a1ecedeb ClientVersion: 4.21.9 ClusterVersion: Stable at "4.21.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing