[must-gather ] OUT 2026-04-17T09:19:34.810017137Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 08668547-9bf3-4d5c-898f-4831fc04dd95 ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-04-17T09:19:34.848975186Z namespace/openshift-must-gather-g7cc6 created [must-gather ] OUT 2026-04-17T09:19:34.859538063Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-nxgdn created [must-gather ] OUT 2026-04-17T09:19:34.878722926Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-tt6mb] OUT 2026-04-17T09:20:24.821007491Z waiting for gather to complete [must-gather-tt6mb] OUT 2026-04-17T09:20:24.823144613Z downloading gather output [must-gather-tt6mb] OUT 2026-04-17T09:20:25.0929077Z receiving incremental file list [must-gather-tt6mb] OUT 2026-04-17T09:20:25.106090763Z ./ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.106210996Z aggregated-discovery-api.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.106606934Z aggregated-discovery-apis.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.107144494Z event-filter.html [must-gather-tt6mb] OUT 2026-04-17T09:20:25.107244676Z timestamp [must-gather-tt6mb] OUT 2026-04-17T09:20:25.107352218Z version [must-gather-tt6mb] OUT 2026-04-17T09:20:25.110047542Z namespaces/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.110080153Z namespaces/opendatahub/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.110123644Z namespaces/opendatahub/opendatahub.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.110156565Z namespaces/opendatahub/apps.openshift.io/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.110216206Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.110243906Z namespaces/opendatahub/apps/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.110304187Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.110396939Z namespaces/opendatahub/apps/deployments.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.110527612Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.110633774Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.110666404Z namespaces/opendatahub/autoscaling/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.110721996Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.110740116Z namespaces/opendatahub/batch/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.110820088Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.110895539Z namespaces/opendatahub/batch/jobs.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.11091638Z namespaces/opendatahub/build.openshift.io/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.110969041Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.111045962Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.111088443Z namespaces/opendatahub/core/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.111106784Z namespaces/opendatahub/core/configmaps.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.111236856Z namespaces/opendatahub/core/endpoints.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.111321098Z namespaces/opendatahub/core/events.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.11143892Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.111508241Z namespaces/opendatahub/core/pods.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.111629954Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.111741266Z namespaces/opendatahub/core/secrets.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.11194264Z namespaces/opendatahub/core/services.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.111996551Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.112042592Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.112100773Z namespaces/opendatahub/image.openshift.io/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.112116084Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.112205095Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.112250266Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.112337988Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.112378259Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.11241749Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.11245433Z namespaces/opendatahub/networking.k8s.io/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.112500051Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.112547362Z namespaces/opendatahub/pods/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.112558182Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-nzv9z/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.112597413Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-nzv9z/kubeflow-trainer-controller-manager-55f5694779-nzv9z.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.112671385Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-nzv9z/manager/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.112683135Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-nzv9z/manager/manager/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.112687035Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-nzv9z/manager/manager/logs/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.112712696Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-nzv9z/manager/manager/logs/current.log [must-gather-tt6mb] OUT 2026-04-17T09:20:25.112879599Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-nzv9z/manager/manager/logs/previous.insecure.log [must-gather-tt6mb] OUT 2026-04-17T09:20:25.11294308Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-nzv9z/manager/manager/logs/previous.log [must-gather-tt6mb] OUT 2026-04-17T09:20:25.112979941Z namespaces/opendatahub/policy/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.113017882Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.113058362Z namespaces/opendatahub/route.openshift.io/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.113090543Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.113133464Z namespaces/openshift/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.113167345Z namespaces/openshift/openshift.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.113221296Z namespaces/openshift/apps.openshift.io/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.113252616Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.113297227Z namespaces/openshift/apps/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.113340898Z namespaces/openshift/apps/daemonsets.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.113410269Z namespaces/openshift/apps/deployments.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.113483041Z namespaces/openshift/apps/replicasets.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.113560572Z namespaces/openshift/apps/statefulsets.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.113600123Z namespaces/openshift/autoscaling/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.113636954Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.113679865Z namespaces/openshift/batch/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.113721796Z namespaces/openshift/batch/cronjobs.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.113816387Z namespaces/openshift/batch/jobs.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.113854478Z namespaces/openshift/build.openshift.io/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.113890279Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.11396261Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.114015882Z namespaces/openshift/core/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.114032402Z namespaces/openshift/core/configmaps.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.114139574Z namespaces/openshift/core/endpoints.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.114217415Z namespaces/openshift/core/events.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.114288847Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.114370499Z namespaces/openshift/core/pods.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.11444501Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.114564033Z namespaces/openshift/core/secrets.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.114720986Z namespaces/openshift/core/services.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.114778657Z namespaces/openshift/discovery.k8s.io/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.114826838Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.114876019Z namespaces/openshift/image.openshift.io/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.114899309Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.11643981Z namespaces/openshift/k8s.ovn.org/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.11645426Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.116557482Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.116570393Z namespaces/openshift/monitoring.coreos.com/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.116624814Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.116674204Z namespaces/openshift/networking.k8s.io/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.116709075Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.116777037Z namespaces/openshift/policy/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.116802387Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.116864028Z namespaces/openshift/route.openshift.io/ [must-gather-tt6mb] OUT 2026-04-17T09:20:25.116876219Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-tt6mb] OUT 2026-04-17T09:20:25.124591663Z [must-gather-tt6mb] OUT 2026-04-17T09:20:25.124609013Z sent 1,372 bytes received 68,955 bytes 46,884.67 bytes/sec [must-gather-tt6mb] OUT 2026-04-17T09:20:25.124614043Z total size is 814,020 speedup is 11.57 [must-gather ] OUT 2026-04-17T09:20:25.152721144Z namespace/openshift-must-gather-g7cc6 deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 08668547-9bf3-4d5c-898f-4831fc04dd95 ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing