[must-gather ] OUT 2026-07-07T16:49:53.674870933Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 0ffab95d-cf1d-4624-8dfb-290a0adbd95e ClientVersion: 4.21.4 ClusterVersion: Stable at "4.21.23" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-07-07T16:49:53.726024642Z namespace/openshift-must-gather-f4vgc created [must-gather ] OUT 2026-07-07T16:49:53.744649828Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-xkscc created [must-gather ] OUT 2026-07-07T16:49:53.813554845Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-5lfcm] OUT 2026-07-07T16:50:49.760819132Z waiting for gather to complete [must-gather-5lfcm] OUT 2026-07-07T16:50:49.763806687Z downloading gather output [must-gather-5lfcm] OUT 2026-07-07T16:50:50.049826754Z receiving incremental file list [must-gather-5lfcm] OUT 2026-07-07T16:50:50.060431995Z ./ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.060524007Z aggregated-discovery-api.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.062607473Z aggregated-discovery-apis.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.063150644Z event-filter.html [must-gather-5lfcm] OUT 2026-07-07T16:50:50.063253836Z timestamp [must-gather-5lfcm] OUT 2026-07-07T16:50:50.063392899Z version [must-gather-5lfcm] OUT 2026-07-07T16:50:50.069438971Z namespaces/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.069455442Z namespaces/opendatahub/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.069499413Z namespaces/opendatahub/opendatahub.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.069581494Z namespaces/opendatahub/apps.openshift.io/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.069628786Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.069680797Z namespaces/opendatahub/apps/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.069722828Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.06980791Z namespaces/opendatahub/apps/deployments.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.069918192Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.070024164Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.070070765Z namespaces/opendatahub/autoscaling/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.070113036Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.070158907Z namespaces/opendatahub/batch/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.070200708Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.07027711Z namespaces/opendatahub/batch/jobs.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.070321891Z namespaces/opendatahub/build.openshift.io/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.070376572Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.070461244Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.070520255Z namespaces/opendatahub/core/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.070575746Z namespaces/opendatahub/core/configmaps.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.070708279Z namespaces/opendatahub/core/endpoints.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.070815132Z namespaces/opendatahub/core/events.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.070945784Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.071049887Z namespaces/opendatahub/core/pods.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.071184349Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.071322052Z namespaces/opendatahub/core/secrets.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.071542187Z namespaces/opendatahub/core/services.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.071609749Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.07166042Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.071732881Z namespaces/opendatahub/image.openshift.io/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.071786723Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.071914685Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.071951356Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.072064379Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.07211817Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.072159811Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.072231622Z namespaces/opendatahub/networking.k8s.io/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.072269923Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.072356955Z namespaces/opendatahub/pods/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.072377195Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-558bf49b46-flhcn/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.072391876Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-558bf49b46-flhcn/kubeflow-trainer-controller-manager-558bf49b46-flhcn.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.072529079Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-558bf49b46-flhcn/manager/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.072543479Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-558bf49b46-flhcn/manager/manager/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.072548729Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-558bf49b46-flhcn/manager/manager/logs/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.072558719Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-558bf49b46-flhcn/manager/manager/logs/current.log [must-gather-5lfcm] OUT 2026-07-07T16:50:50.074222106Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-558bf49b46-flhcn/manager/manager/logs/previous.insecure.log [must-gather-5lfcm] OUT 2026-07-07T16:50:50.074296437Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-558bf49b46-flhcn/manager/manager/logs/previous.log [must-gather-5lfcm] OUT 2026-07-07T16:50:50.074313578Z namespaces/opendatahub/policy/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.07440121Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.074436891Z namespaces/opendatahub/route.openshift.io/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.074486521Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.074546403Z namespaces/openshift/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.074607684Z namespaces/openshift/openshift.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.074693236Z namespaces/openshift/apps.openshift.io/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.074735167Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.074818999Z namespaces/openshift/apps/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.07485458Z namespaces/openshift/apps/daemonsets.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.074957112Z namespaces/openshift/apps/deployments.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.075066644Z namespaces/openshift/apps/replicasets.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.075161876Z namespaces/openshift/apps/statefulsets.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.075219017Z namespaces/openshift/autoscaling/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.075271689Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.07533009Z namespaces/openshift/batch/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.075406352Z namespaces/openshift/batch/cronjobs.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.075491034Z namespaces/openshift/batch/jobs.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.075523734Z namespaces/openshift/build.openshift.io/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.075573595Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.075653437Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.075698568Z namespaces/openshift/core/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.075733379Z namespaces/openshift/core/configmaps.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.075836111Z namespaces/openshift/core/endpoints.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.075910103Z namespaces/openshift/core/events.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.075993574Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.076071236Z namespaces/openshift/core/pods.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.076151108Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.076277151Z namespaces/openshift/core/secrets.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.076485135Z namespaces/openshift/core/services.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.076536066Z namespaces/openshift/discovery.k8s.io/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.076568747Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.076622478Z namespaces/openshift/image.openshift.io/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.076655609Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.07808324Z namespaces/openshift/k8s.ovn.org/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.078113761Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.078203563Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.078239983Z namespaces/openshift/monitoring.coreos.com/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.078285495Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.078329045Z namespaces/openshift/networking.k8s.io/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.078400117Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.078464018Z namespaces/openshift/policy/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.078505859Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.078571241Z namespaces/openshift/route.openshift.io/ [must-gather-5lfcm] OUT 2026-07-07T16:50:50.078612571Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-5lfcm] OUT 2026-07-07T16:50:50.101381798Z [must-gather-5lfcm] OUT 2026-07-07T16:50:50.101419739Z sent 1,376 bytes received 103,388 bytes 69,842.67 bytes/sec [must-gather-5lfcm] OUT 2026-07-07T16:50:50.101429969Z total size is 1,349,059 speedup is 12.88 [must-gather ] OUT 2026-07-07T16:50:50.133703993Z namespace/openshift-must-gather-f4vgc deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 0ffab95d-cf1d-4624-8dfb-290a0adbd95e ClientVersion: 4.21.4 ClusterVersion: Stable at "4.21.23" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing