[must-gather ] OUT 2026-07-08T17:02:07.478636195Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 64ce839f-17a5-40f2-9f63-90439de61954 ClientVersion: 4.21.4 ClusterVersion: Stable at "4.21.23" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-07-08T17:02:07.532678906Z namespace/openshift-must-gather-npd78 created [must-gather ] OUT 2026-07-08T17:02:07.545164246Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-64kd9 created [must-gather ] OUT 2026-07-08T17:02:07.581177683Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-dbxht] OUT 2026-07-08T17:03:03.48268394Z waiting for gather to complete [must-gather-dbxht] OUT 2026-07-08T17:03:03.486327421Z downloading gather output [must-gather-dbxht] OUT 2026-07-08T17:03:03.854466779Z receiving incremental file list [must-gather-dbxht] OUT 2026-07-08T17:03:03.870124097Z ./ [must-gather-dbxht] OUT 2026-07-08T17:03:03.870194709Z aggregated-discovery-api.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.873344889Z aggregated-discovery-apis.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.874351871Z event-filter.html [must-gather-dbxht] OUT 2026-07-08T17:03:03.874490824Z timestamp [must-gather-dbxht] OUT 2026-07-08T17:03:03.874619917Z version [must-gather-dbxht] OUT 2026-07-08T17:03:03.874799361Z namespaces/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.874812981Z namespaces/opendatahub/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.874875783Z namespaces/opendatahub/opendatahub.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.874990065Z namespaces/opendatahub/apps.openshift.io/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.875070137Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.875126448Z namespaces/opendatahub/apps/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.875236211Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.875340233Z namespaces/opendatahub/apps/deployments.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.875484766Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.875621579Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.87568223Z namespaces/opendatahub/autoscaling/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.875743702Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.875802713Z namespaces/opendatahub/batch/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.875854694Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.875982137Z namespaces/opendatahub/batch/jobs.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.876039518Z namespaces/opendatahub/build.openshift.io/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.87609293Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.876192952Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.876262413Z namespaces/opendatahub/core/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.876313564Z namespaces/opendatahub/core/configmaps.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.876477018Z namespaces/opendatahub/core/endpoints.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.87659325Z namespaces/opendatahub/core/events.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.876753894Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.876881617Z namespaces/opendatahub/core/pods.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.877067911Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.877235595Z namespaces/opendatahub/core/secrets.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.87747801Z namespaces/opendatahub/core/services.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.877559452Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.877615593Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.877698285Z namespaces/opendatahub/image.openshift.io/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.877751886Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.877881439Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.877952981Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.878071783Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.878136005Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.878194686Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.878258527Z namespaces/opendatahub/networking.k8s.io/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.878327419Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.878393101Z namespaces/opendatahub/pods/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.878402511Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-86d75bcb49-wn4r8/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.878453922Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-86d75bcb49-wn4r8/kubeflow-trainer-controller-manager-86d75bcb49-wn4r8.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.878570765Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-86d75bcb49-wn4r8/manager/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.878587475Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-86d75bcb49-wn4r8/manager/manager/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.878594115Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-86d75bcb49-wn4r8/manager/manager/logs/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.878628046Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-86d75bcb49-wn4r8/manager/manager/logs/current.log [must-gather-dbxht] OUT 2026-07-08T17:03:03.87879787Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-86d75bcb49-wn4r8/manager/manager/logs/previous.insecure.log [must-gather-dbxht] OUT 2026-07-08T17:03:03.878874501Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-86d75bcb49-wn4r8/manager/manager/logs/previous.log [must-gather-dbxht] OUT 2026-07-08T17:03:03.878895442Z namespaces/opendatahub/policy/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.878949333Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.879036675Z namespaces/opendatahub/route.openshift.io/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.879074956Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.879124297Z namespaces/openshift/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.879175218Z namespaces/openshift/openshift.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.879211749Z namespaces/openshift/apps.openshift.io/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.8792634Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.879312491Z namespaces/openshift/apps/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.879350682Z namespaces/openshift/apps/daemonsets.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.879435854Z namespaces/openshift/apps/deployments.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.879530516Z namespaces/openshift/apps/replicasets.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.879623378Z namespaces/openshift/apps/statefulsets.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.879696619Z namespaces/openshift/autoscaling/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.879766131Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.879843553Z namespaces/openshift/batch/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.879904884Z namespaces/openshift/batch/cronjobs.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.880042717Z namespaces/openshift/batch/jobs.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.880104759Z namespaces/openshift/build.openshift.io/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.880147349Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.880254752Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.880322013Z namespaces/openshift/core/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.880383955Z namespaces/openshift/core/configmaps.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.880507948Z namespaces/openshift/core/endpoints.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.880656211Z namespaces/openshift/core/events.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.880753063Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.880879196Z namespaces/openshift/core/pods.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.881005208Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.881158862Z namespaces/openshift/core/secrets.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.881373877Z namespaces/openshift/core/services.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.881442358Z namespaces/openshift/discovery.k8s.io/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.88150439Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.881566501Z namespaces/openshift/image.openshift.io/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.881618212Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.883736979Z namespaces/openshift/k8s.ovn.org/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.88377708Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.883901703Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.883979614Z namespaces/openshift/monitoring.coreos.com/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.884046926Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.884115257Z namespaces/openshift/networking.k8s.io/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.884165169Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.8842251Z namespaces/openshift/policy/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.884278731Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.884331732Z namespaces/openshift/route.openshift.io/ [must-gather-dbxht] OUT 2026-07-08T17:03:03.884396564Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-dbxht] OUT 2026-07-08T17:03:03.893495216Z [must-gather-dbxht] OUT 2026-07-08T17:03:03.893533226Z sent 1,372 bytes received 69,273 bytes 141,290.00 bytes/sec [must-gather-dbxht] OUT 2026-07-08T17:03:03.893540597Z total size is 817,687 speedup is 11.57 [must-gather ] OUT 2026-07-08T17:03:03.925366693Z namespace/openshift-must-gather-npd78 deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 64ce839f-17a5-40f2-9f63-90439de61954 ClientVersion: 4.21.4 ClusterVersion: Stable at "4.21.23" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing