[must-gather ] OUT 2026-07-15T10:23:48.949258938Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: c25d8f46-14d3-4f7e-8bb5-22dbb0ea335d ClientVersion: 4.21.9 ClusterVersion: Stable at "4.21.24" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-07-15T10:23:49.007605909Z namespace/openshift-must-gather-2cjdw created [must-gather ] OUT 2026-07-15T10:23:49.017352666Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-hpqgw created [must-gather ] OUT 2026-07-15T10:23:49.05799992Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-mbvn5] OUT 2026-07-15T10:24:53.314962925Z waiting for gather to complete [must-gather-mbvn5] OUT 2026-07-15T10:24:53.31988004Z downloading gather output [must-gather-mbvn5] OUT 2026-07-15T10:24:53.643076234Z receiving incremental file list [must-gather-mbvn5] OUT 2026-07-15T10:24:53.653983068Z ./ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.654244364Z aggregated-discovery-api.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.656452747Z aggregated-discovery-apis.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.657425875Z event-filter.html [must-gather-mbvn5] OUT 2026-07-15T10:24:53.65751077Z timestamp [must-gather-mbvn5] OUT 2026-07-15T10:24:53.657634918Z version [must-gather-mbvn5] OUT 2026-07-15T10:24:53.660750185Z namespaces/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.660765935Z namespaces/opendatahub/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.660954377Z namespaces/opendatahub/opendatahub.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.661214582Z namespaces/opendatahub/apps.openshift.io/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.661264205Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.661328399Z namespaces/opendatahub/apps/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.661382532Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.661518291Z namespaces/opendatahub/apps/deployments.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.661643588Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.661772456Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.661825709Z namespaces/opendatahub/autoscaling/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.661867241Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.661945196Z namespaces/opendatahub/batch/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.661996539Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.662104696Z namespaces/opendatahub/batch/jobs.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.66217095Z namespaces/opendatahub/build.openshift.io/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.662221903Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.66233391Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.662384493Z namespaces/opendatahub/core/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.662427295Z namespaces/opendatahub/core/configmaps.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.662586555Z namespaces/opendatahub/core/endpoints.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.662690911Z namespaces/opendatahub/core/events.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.662822329Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.662914124Z namespaces/opendatahub/core/pods.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.663063913Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.663232603Z namespaces/opendatahub/core/secrets.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.663429555Z namespaces/opendatahub/core/services.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.663492759Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.663544992Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.663625337Z namespaces/opendatahub/image.openshift.io/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.66367313Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.663799257Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.663849191Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.663950387Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.66399938Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.664047363Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.664161669Z namespaces/opendatahub/networking.k8s.io/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.664181931Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.664267426Z namespaces/opendatahub/pods/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.664275626Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-rdk9s/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.664315728Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-rdk9s/kubeflow-trainer-controller-manager-857f77d56c-rdk9s.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.664423465Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-rdk9s/manager/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.664432226Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-rdk9s/manager/manager/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.664436616Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-rdk9s/manager/manager/logs/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.664468228Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-rdk9s/manager/manager/logs/current.log [must-gather-mbvn5] OUT 2026-07-15T10:24:53.664740114Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-rdk9s/manager/manager/logs/previous.insecure.log [must-gather-mbvn5] OUT 2026-07-15T10:24:53.664823559Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-857f77d56c-rdk9s/manager/manager/logs/previous.log [must-gather-mbvn5] OUT 2026-07-15T10:24:53.6648438Z namespaces/opendatahub/policy/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.664915295Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.664963917Z namespaces/opendatahub/route.openshift.io/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.665031791Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.665080634Z namespaces/openshift/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.665142038Z namespaces/openshift/openshift.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.665223293Z namespaces/openshift/apps.openshift.io/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.665272236Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.665325389Z namespaces/openshift/apps/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.665371542Z namespaces/openshift/apps/daemonsets.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.665486869Z namespaces/openshift/apps/deployments.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.665586815Z namespaces/openshift/apps/replicasets.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.665687931Z namespaces/openshift/apps/statefulsets.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.665737764Z namespaces/openshift/autoscaling/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.665782296Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.665853341Z namespaces/openshift/batch/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.665900963Z namespaces/openshift/batch/cronjobs.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.66600521Z namespaces/openshift/batch/jobs.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.666054793Z namespaces/openshift/build.openshift.io/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.666099526Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.666227223Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.666277616Z namespaces/openshift/core/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.666327769Z namespaces/openshift/core/configmaps.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.666452947Z namespaces/openshift/core/endpoints.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.666548033Z namespaces/openshift/core/events.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.666649948Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.666745294Z namespaces/openshift/core/pods.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.66684806Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.666991119Z namespaces/openshift/core/secrets.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.667189371Z namespaces/openshift/core/services.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.667239914Z namespaces/openshift/discovery.k8s.io/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.667304368Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.667352581Z namespaces/openshift/image.openshift.io/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.667417365Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.669120407Z namespaces/openshift/k8s.ovn.org/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.669194951Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.669298898Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.669349761Z namespaces/openshift/monitoring.coreos.com/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.669398853Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.669473058Z namespaces/openshift/networking.k8s.io/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.669523611Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.669570744Z namespaces/openshift/policy/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.669631627Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.669681981Z namespaces/openshift/route.openshift.io/ [must-gather-mbvn5] OUT 2026-07-15T10:24:53.669744964Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-mbvn5] OUT 2026-07-15T10:24:53.677021781Z [must-gather-mbvn5] OUT 2026-07-15T10:24:53.677039492Z sent 1,372 bytes received 70,905 bytes 144,554.00 bytes/sec [must-gather-mbvn5] OUT 2026-07-15T10:24:53.677045202Z total size is 842,096 speedup is 11.65 [must-gather ] OUT 2026-07-15T10:24:53.709324249Z namespace/openshift-must-gather-2cjdw deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: c25d8f46-14d3-4f7e-8bb5-22dbb0ea335d ClientVersion: 4.21.9 ClusterVersion: Stable at "4.21.24" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing