[must-gather ] OUT 2026-04-17T11:52:48.974739842Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 84900ad4-b75f-46d0-8ff8-03e01cb813ab ClientVersion: 4.21.4 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-04-17T11:52:49.037723846Z namespace/openshift-must-gather-4j6mk created [must-gather ] OUT 2026-04-17T11:52:49.046141249Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-hwgll created [must-gather ] OUT 2026-04-17T11:52:49.068496124Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-wmxq9] OUT 2026-04-17T11:53:40.776134075Z waiting for gather to complete [must-gather-wmxq9] OUT 2026-04-17T11:53:40.779409719Z downloading gather output [must-gather-wmxq9] OUT 2026-04-17T11:53:41.039518443Z receiving incremental file list [must-gather-wmxq9] OUT 2026-04-17T11:53:41.050510135Z ./ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.050559416Z aggregated-discovery-api.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.050856581Z aggregated-discovery-apis.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.051341621Z event-filter.html [must-gather-wmxq9] OUT 2026-04-17T11:53:41.051452343Z timestamp [must-gather-wmxq9] OUT 2026-04-17T11:53:41.051562505Z version [must-gather-wmxq9] OUT 2026-04-17T11:53:41.055149804Z namespaces/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.055172735Z namespaces/opendatahub/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.055276257Z namespaces/opendatahub/opendatahub.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.05544303Z namespaces/opendatahub/apps.openshift.io/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.055533872Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.055653594Z namespaces/opendatahub/apps/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.055737096Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.055851268Z namespaces/opendatahub/apps/deployments.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.05596789Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.056085082Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.056130514Z namespaces/opendatahub/autoscaling/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.056168704Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.056223435Z namespaces/opendatahub/batch/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.056262656Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.056343947Z namespaces/opendatahub/batch/jobs.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.056391619Z namespaces/opendatahub/build.openshift.io/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.056436499Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.056509241Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.056554652Z namespaces/opendatahub/core/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.056596523Z namespaces/opendatahub/core/configmaps.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.056719315Z namespaces/opendatahub/core/endpoints.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.056831657Z namespaces/opendatahub/core/events.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.056951619Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.057027091Z namespaces/opendatahub/core/pods.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.057159173Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.057286836Z namespaces/opendatahub/core/secrets.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.057455759Z namespaces/opendatahub/core/services.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.05751126Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.057557681Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.057615022Z namespaces/opendatahub/image.openshift.io/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.057659383Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.057742015Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.057801376Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.057883657Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.057931138Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.057969109Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.05802495Z namespaces/opendatahub/networking.k8s.io/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.058063161Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.058107662Z namespaces/opendatahub/pods/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.058114072Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-5995989c79-fm62f/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.058155323Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-5995989c79-fm62f/kubeflow-trainer-controller-manager-5995989c79-fm62f.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.058246434Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-5995989c79-fm62f/manager/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.058257795Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-5995989c79-fm62f/manager/manager/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.058263315Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-5995989c79-fm62f/manager/manager/logs/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.058270355Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-5995989c79-fm62f/manager/manager/logs/current.log [must-gather-wmxq9] OUT 2026-04-17T11:53:41.059123181Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-5995989c79-fm62f/manager/manager/logs/previous.insecure.log [must-gather-wmxq9] OUT 2026-04-17T11:53:41.059190362Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-5995989c79-fm62f/manager/manager/logs/previous.log [must-gather-wmxq9] OUT 2026-04-17T11:53:41.059223373Z namespaces/opendatahub/policy/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.059265454Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.059313495Z namespaces/opendatahub/route.openshift.io/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.059351526Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.059399647Z namespaces/openshift/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.059440638Z namespaces/openshift/openshift.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.059488588Z namespaces/openshift/apps.openshift.io/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.059528639Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.05957788Z namespaces/openshift/apps/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.059607031Z namespaces/openshift/apps/daemonsets.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.059695452Z namespaces/openshift/apps/deployments.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.059791304Z namespaces/openshift/apps/replicasets.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.059872126Z namespaces/openshift/apps/statefulsets.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.059905316Z namespaces/openshift/autoscaling/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.059953747Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.059997478Z namespaces/openshift/batch/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.060039129Z namespaces/openshift/batch/cronjobs.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.06011594Z namespaces/openshift/batch/jobs.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.060155461Z namespaces/openshift/build.openshift.io/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.060208632Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.060290974Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.060335605Z namespaces/openshift/core/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.060374465Z namespaces/openshift/core/configmaps.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.060483947Z namespaces/openshift/core/endpoints.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.060563079Z namespaces/openshift/core/events.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.060638841Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.060717642Z namespaces/openshift/core/pods.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.060817564Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.060936076Z namespaces/openshift/core/secrets.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.06111247Z namespaces/openshift/core/services.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.061158551Z namespaces/openshift/discovery.k8s.io/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.061204641Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.061249822Z namespaces/openshift/image.openshift.io/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.061294713Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.062823303Z namespaces/openshift/k8s.ovn.org/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.062851583Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.062940765Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.062985906Z namespaces/openshift/monitoring.coreos.com/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.063015167Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.063065068Z namespaces/openshift/networking.k8s.io/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.063104608Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.063158449Z namespaces/openshift/policy/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.06318824Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.063243241Z namespaces/openshift/route.openshift.io/ [must-gather-wmxq9] OUT 2026-04-17T11:53:41.063280262Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-wmxq9] OUT 2026-04-17T11:53:41.069579663Z [must-gather-wmxq9] OUT 2026-04-17T11:53:41.069611144Z sent 1,376 bytes received 85,394 bytes 57,846.67 bytes/sec [must-gather-wmxq9] OUT 2026-04-17T11:53:41.069619774Z total size is 1,053,137 speedup is 12.14 [must-gather ] OUT 2026-04-17T11:53:41.100039951Z namespace/openshift-must-gather-4j6mk deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 84900ad4-b75f-46d0-8ff8-03e01cb813ab ClientVersion: 4.21.4 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing