[must-gather ] OUT 2026-04-22T14:08:22.37103224Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: d460f1fd-8fd6-457a-9b85-2fe671b3bc27 ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-04-22T14:08:22.423641247Z namespace/openshift-must-gather-jhrrk created [must-gather ] OUT 2026-04-22T14:08:22.427949046Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-7x2xx created [must-gather ] OUT 2026-04-22T14:08:22.450837713Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-thtz7] OUT 2026-04-22T14:09:19.871405527Z waiting for gather to complete [must-gather-thtz7] OUT 2026-04-22T14:09:19.874452344Z downloading gather output [must-gather-thtz7] OUT 2026-04-22T14:09:20.135503705Z receiving incremental file list [must-gather-thtz7] OUT 2026-04-22T14:09:20.145843296Z ./ [must-gather-thtz7] OUT 2026-04-22T14:09:20.145933378Z aggregated-discovery-api.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.146252146Z aggregated-discovery-apis.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.146878682Z event-filter.html [must-gather-thtz7] OUT 2026-04-22T14:09:20.147014035Z timestamp [must-gather-thtz7] OUT 2026-04-22T14:09:20.147132728Z version [must-gather-thtz7] OUT 2026-04-22T14:09:20.150466732Z namespaces/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.150498113Z namespaces/opendatahub/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.150515043Z namespaces/opendatahub/opendatahub.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.150604036Z namespaces/opendatahub/apps.openshift.io/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.150641757Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.150719099Z namespaces/opendatahub/apps/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.15077132Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.150874692Z namespaces/opendatahub/apps/deployments.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.151007096Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.151141049Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.15118972Z namespaces/opendatahub/autoscaling/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.151240192Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.151288003Z namespaces/opendatahub/batch/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.151321654Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.151436057Z namespaces/opendatahub/batch/jobs.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.151483478Z namespaces/opendatahub/build.openshift.io/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.151520799Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.151606581Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.151660352Z namespaces/opendatahub/core/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.151699423Z namespaces/opendatahub/core/configmaps.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.151827587Z namespaces/opendatahub/core/endpoints.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.151908469Z namespaces/opendatahub/core/events.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.152031702Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.152109874Z namespaces/opendatahub/core/pods.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.152241767Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.15237538Z namespaces/opendatahub/core/secrets.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.152590996Z namespaces/opendatahub/core/services.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.152649807Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.152685268Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.15274378Z namespaces/opendatahub/image.openshift.io/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.15278256Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.152875843Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.152920474Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.153002376Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.153047297Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.153091998Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.15314137Z namespaces/opendatahub/networking.k8s.io/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.15317993Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.153241842Z namespaces/opendatahub/pods/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.153254432Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-5fr9f/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.153286673Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-5fr9f/kubeflow-trainer-controller-manager-55f5694779-5fr9f.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.153376126Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-5fr9f/manager/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.153389966Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-5fr9f/manager/manager/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.153393566Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-5fr9f/manager/manager/logs/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.153439507Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-5fr9f/manager/manager/logs/current.log [must-gather-thtz7] OUT 2026-04-22T14:09:20.153864988Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-5fr9f/manager/manager/logs/previous.insecure.log [must-gather-thtz7] OUT 2026-04-22T14:09:20.15394055Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-5fr9f/manager/manager/logs/previous.log [must-gather-thtz7] OUT 2026-04-22T14:09:20.153974311Z namespaces/opendatahub/policy/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.154015872Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.154068673Z namespaces/opendatahub/route.openshift.io/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.154108784Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.154153775Z namespaces/openshift/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.154203016Z namespaces/openshift/openshift.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.154250408Z namespaces/openshift/apps.openshift.io/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.154296969Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.15433592Z namespaces/openshift/apps/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.154384141Z namespaces/openshift/apps/daemonsets.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.154490784Z namespaces/openshift/apps/deployments.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.154565016Z namespaces/openshift/apps/replicasets.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.154645778Z namespaces/openshift/apps/statefulsets.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.154695249Z namespaces/openshift/autoscaling/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.15473103Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.154780321Z namespaces/openshift/batch/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.154824322Z namespaces/openshift/batch/cronjobs.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.154909744Z namespaces/openshift/batch/jobs.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.154954635Z namespaces/openshift/build.openshift.io/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.154995496Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.155078458Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.155110419Z namespaces/openshift/core/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.155169161Z namespaces/openshift/core/configmaps.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.155265383Z namespaces/openshift/core/endpoints.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.155349195Z namespaces/openshift/core/events.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.155445278Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.15553629Z namespaces/openshift/core/pods.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.155614352Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.155752095Z namespaces/openshift/core/secrets.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.15591752Z namespaces/openshift/core/services.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.155968481Z namespaces/openshift/discovery.k8s.io/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.156015192Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.156056263Z namespaces/openshift/image.openshift.io/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.156101394Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.157605172Z namespaces/openshift/k8s.ovn.org/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.157655533Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.157745096Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.157790477Z namespaces/openshift/monitoring.coreos.com/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.157821047Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.157871599Z namespaces/openshift/networking.k8s.io/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.15791617Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.157972911Z namespaces/openshift/policy/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.158020543Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.158057944Z namespaces/openshift/route.openshift.io/ [must-gather-thtz7] OUT 2026-04-22T14:09:20.158101635Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-thtz7] OUT 2026-04-22T14:09:20.163792938Z [must-gather-thtz7] OUT 2026-04-22T14:09:20.163812459Z sent 1,372 bytes received 76,788 bytes 52,106.67 bytes/sec [must-gather-thtz7] OUT 2026-04-22T14:09:20.163817379Z total size is 921,787 speedup is 11.79 [must-gather ] OUT 2026-04-22T14:09:20.194179424Z namespace/openshift-must-gather-jhrrk deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: d460f1fd-8fd6-457a-9b85-2fe671b3bc27 ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing