[must-gather ] OUT 2026-07-15T13:22:49.691474427Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: f70e367f-abd9-4193-a9ef-d3ca08cd9346 ClientVersion: 4.22.3 ClusterVersion: Stable at "4.21.24" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-07-15T13:22:49.744286738Z namespace/openshift-must-gather-rvn5h created [must-gather ] OUT 2026-07-15T13:22:49.752680731Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-2w8nj created [must-gather ] OUT 2026-07-15T13:22:49.772476762Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-mtk4w] OUT 2026-07-15T13:23:44.544411324Z waiting for gather to complete [must-gather-mtk4w] OUT 2026-07-15T13:23:44.547844381Z downloading gather output [must-gather-mtk4w] OUT 2026-07-15T13:23:44.829719359Z receiving incremental file list [must-gather-mtk4w] OUT 2026-07-15T13:23:44.84129981Z ./ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.841388447Z aggregated-discovery-api.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.842976281Z aggregated-discovery-apis.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.843729919Z event-filter.html [must-gather-mtk4w] OUT 2026-07-15T13:23:44.843846288Z timestamp [must-gather-mtk4w] OUT 2026-07-15T13:23:44.845388168Z version [must-gather-mtk4w] OUT 2026-07-15T13:23:44.846500975Z namespaces/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.846515416Z namespaces/opendatahub/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.846653527Z namespaces/opendatahub/opendatahub.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.846845812Z namespaces/opendatahub/apps.openshift.io/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.846960541Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.847116523Z namespaces/opendatahub/apps/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.847219611Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.847409255Z namespaces/opendatahub/apps/deployments.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.847645664Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.847761523Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.847797366Z namespaces/opendatahub/autoscaling/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.847832448Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.847888753Z namespaces/opendatahub/batch/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.847908854Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.848021243Z namespaces/opendatahub/batch/jobs.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.848050476Z namespaces/opendatahub/build.openshift.io/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.84811205Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.848196627Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.848243751Z namespaces/opendatahub/core/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.848266652Z namespaces/opendatahub/core/configmaps.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.848424665Z namespaces/opendatahub/core/endpoints.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.848506041Z namespaces/opendatahub/core/events.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.84862809Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.848707497Z namespaces/opendatahub/core/pods.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.848839827Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.848985578Z namespaces/opendatahub/core/secrets.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.849171923Z namespaces/opendatahub/core/services.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.849230317Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.849275661Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.849337205Z namespaces/opendatahub/image.openshift.io/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.849380149Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.849482647Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.84952027Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.849607077Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.8496464Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.849692813Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.849736797Z namespaces/opendatahub/networking.k8s.io/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.84977797Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.849824143Z namespaces/opendatahub/pods/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.849831824Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-5d74d48f95-4wm6t/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.849877788Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-5d74d48f95-4wm6t/kubeflow-trainer-controller-manager-5d74d48f95-4wm6t.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.849959124Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-5d74d48f95-4wm6t/manager/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.849968955Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-5d74d48f95-4wm6t/manager/manager/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.849973195Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-5d74d48f95-4wm6t/manager/manager/logs/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.850014068Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-5d74d48f95-4wm6t/manager/manager/logs/current.log [must-gather-mtk4w] OUT 2026-07-15T13:23:44.851719781Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-5d74d48f95-4wm6t/manager/manager/logs/previous.insecure.log [must-gather-mtk4w] OUT 2026-07-15T13:23:44.851785566Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-5d74d48f95-4wm6t/manager/manager/logs/previous.log [must-gather-mtk4w] OUT 2026-07-15T13:23:44.851822059Z namespaces/opendatahub/policy/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.851854741Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.851906175Z namespaces/opendatahub/route.openshift.io/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.851953559Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.851984322Z namespaces/openshift/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.852058967Z namespaces/openshift/openshift.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.852107461Z namespaces/openshift/apps.openshift.io/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.852146134Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.852179907Z namespaces/openshift/apps/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.852232891Z namespaces/openshift/apps/daemonsets.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.852309757Z namespaces/openshift/apps/deployments.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.852395074Z namespaces/openshift/apps/replicasets.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.852471149Z namespaces/openshift/apps/statefulsets.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.852519183Z namespaces/openshift/autoscaling/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.852561496Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.85260507Z namespaces/openshift/batch/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.852652023Z namespaces/openshift/batch/cronjobs.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.8527298Z namespaces/openshift/batch/jobs.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.852774313Z namespaces/openshift/build.openshift.io/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.852804745Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.852889252Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.852919164Z namespaces/openshift/core/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.852970598Z namespaces/openshift/core/configmaps.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.853098268Z namespaces/openshift/core/endpoints.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.853171024Z namespaces/openshift/core/events.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.85325038Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.853336427Z namespaces/openshift/core/pods.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.853415863Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.853546003Z namespaces/openshift/core/secrets.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.853711366Z namespaces/openshift/core/services.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.85375754Z namespaces/openshift/discovery.k8s.io/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.853809773Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.853852657Z namespaces/openshift/image.openshift.io/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.85389165Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.855526977Z namespaces/openshift/k8s.ovn.org/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.85556844Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.855651007Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.855698591Z namespaces/openshift/monitoring.coreos.com/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.855738983Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.855787157Z namespaces/openshift/networking.k8s.io/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.855830601Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.855876044Z namespaces/openshift/policy/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.855906977Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.85595748Z namespaces/openshift/route.openshift.io/ [must-gather-mtk4w] OUT 2026-07-15T13:23:44.856015325Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-mtk4w] OUT 2026-07-15T13:23:44.861762492Z [must-gather-mtk4w] OUT 2026-07-15T13:23:44.861785854Z sent 1,376 bytes received 101,834 bytes 206,420.00 bytes/sec [must-gather-mtk4w] OUT 2026-07-15T13:23:44.861792105Z total size is 1,333,327 speedup is 12.92 [must-gather ] OUT 2026-07-15T13:23:44.890333035Z namespace/openshift-must-gather-rvn5h deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: f70e367f-abd9-4193-a9ef-d3ca08cd9346 ClientVersion: 4.22.3 ClusterVersion: Stable at "4.21.24" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing