[must-gather ] OUT 2026-07-29T09:14:00.078318276Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 6f8c4bb7-1540-4c7b-bcaa-78d932388308 ClientVersion: 4.22.5 ClusterVersion: Stable at "4.21.26" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-07-29T09:14:00.121830875Z namespace/openshift-must-gather-c88j6 created [must-gather ] OUT 2026-07-29T09:14:00.13089844Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-wnpkh created [must-gather ] OUT 2026-07-29T09:14:00.150986254Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-wrsfw] OUT 2026-07-29T09:14:53.014149833Z waiting for gather to complete [must-gather-wrsfw] OUT 2026-07-29T09:14:53.016960392Z downloading gather output [must-gather-wrsfw] OUT 2026-07-29T09:14:53.300073268Z receiving incremental file list [must-gather-wrsfw] OUT 2026-07-29T09:14:53.313153813Z ./ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.313230589Z aggregated-discovery-api.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.313516152Z aggregated-discovery-apis.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.314160895Z event-filter.html [must-gather-wrsfw] OUT 2026-07-29T09:14:53.314292125Z timestamp [must-gather-wrsfw] OUT 2026-07-29T09:14:53.314416865Z version [must-gather-wrsfw] OUT 2026-07-29T09:14:53.318054731Z namespaces/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.318074653Z namespaces/opendatahub/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.318119357Z namespaces/opendatahub/opendatahub.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.318223395Z namespaces/opendatahub/apps.openshift.io/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.31828868Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.318362417Z namespaces/opendatahub/apps/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.318414211Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.31852766Z namespaces/opendatahub/apps/deployments.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.318741387Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.318891549Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.318974236Z namespaces/opendatahub/autoscaling/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.31902015Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.319098116Z namespaces/opendatahub/batch/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.319136649Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.319257619Z namespaces/opendatahub/batch/jobs.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.319305703Z namespaces/opendatahub/build.openshift.io/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.319365798Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.319473587Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.31950739Z namespaces/opendatahub/core/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.319560294Z namespaces/opendatahub/core/configmaps.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.319692135Z namespaces/opendatahub/core/endpoints.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.319782782Z namespaces/opendatahub/core/events.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.319919193Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.32001006Z namespaces/opendatahub/core/pods.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.32013381Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.32025308Z namespaces/opendatahub/core/secrets.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.320429094Z namespaces/opendatahub/core/services.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.320487299Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.320530823Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.320583967Z namespaces/opendatahub/image.openshift.io/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.320629221Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.320731119Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.320759092Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.320855569Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.320895092Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.320944136Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.32099039Z namespaces/opendatahub/networking.k8s.io/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.321031194Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.321074177Z namespaces/opendatahub/pods/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.321082038Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-cl6vk/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.32110652Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-cl6vk/kubeflow-trainer-controller-manager-7b4fcbc79d-cl6vk.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.321198987Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-cl6vk/manager/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.321207548Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-cl6vk/manager/manager/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.321211738Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-cl6vk/manager/manager/logs/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.32123575Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-cl6vk/manager/manager/logs/current.log [must-gather-wrsfw] OUT 2026-07-29T09:14:53.321428896Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-cl6vk/manager/manager/logs/previous.insecure.log [must-gather-wrsfw] OUT 2026-07-29T09:14:53.321506272Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-cl6vk/manager/manager/logs/previous.log [must-gather-wrsfw] OUT 2026-07-29T09:14:53.321539335Z namespaces/opendatahub/policy/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.321575568Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.321634343Z namespaces/opendatahub/route.openshift.io/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.321672266Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.321704318Z namespaces/openshift/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.321756473Z namespaces/openshift/openshift.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.321817998Z namespaces/openshift/apps.openshift.io/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.321856511Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.321926006Z namespaces/openshift/apps/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.321956369Z namespaces/openshift/apps/daemonsets.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.322046126Z namespaces/openshift/apps/deployments.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.322114262Z namespaces/openshift/apps/replicasets.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.322189028Z namespaces/openshift/apps/statefulsets.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.322234801Z namespaces/openshift/autoscaling/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.322271775Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.322318738Z namespaces/openshift/batch/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.322354011Z namespaces/openshift/batch/cronjobs.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.322433068Z namespaces/openshift/batch/jobs.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.32246303Z namespaces/openshift/build.openshift.io/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.322556488Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.322633964Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.322678097Z namespaces/openshift/core/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.32270772Z namespaces/openshift/core/configmaps.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.322813648Z namespaces/openshift/core/endpoints.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.322904856Z namespaces/openshift/core/events.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.322997174Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.323065389Z namespaces/openshift/core/pods.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.323143525Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.323260735Z namespaces/openshift/core/secrets.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.323418628Z namespaces/openshift/core/services.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.323456261Z namespaces/openshift/discovery.k8s.io/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.323502855Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.323544538Z namespaces/openshift/image.openshift.io/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.323583391Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.32541224Z namespaces/openshift/k8s.ovn.org/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.325434972Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.325566753Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.325624457Z namespaces/openshift/monitoring.coreos.com/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.325683382Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.325740517Z namespaces/openshift/networking.k8s.io/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.325802882Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.325883649Z namespaces/openshift/policy/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.325973856Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.326005378Z namespaces/openshift/route.openshift.io/ [must-gather-wrsfw] OUT 2026-07-29T09:14:53.326081985Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-wrsfw] OUT 2026-07-29T09:14:53.333166671Z [must-gather-wrsfw] OUT 2026-07-29T09:14:53.333185483Z sent 1,372 bytes received 70,859 bytes 144,462.00 bytes/sec [must-gather-wrsfw] OUT 2026-07-29T09:14:53.333194443Z total size is 843,413 speedup is 11.68 [must-gather ] OUT 2026-07-29T09:14:53.363245129Z namespace/openshift-must-gather-c88j6 deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 6f8c4bb7-1540-4c7b-bcaa-78d932388308 ClientVersion: 4.22.5 ClusterVersion: Stable at "4.21.26" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing