[must-gather ] OUT 2026-07-29T11:34:50.693754651Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: ef98f928-c8cb-423e-b5ab-d53ec779514f ClientVersion: 4.22.5 ClusterVersion: Stable at "4.21.26" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-07-29T11:34:50.742998662Z namespace/openshift-must-gather-9z9gw created [must-gather ] OUT 2026-07-29T11:34:50.750280688Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-qhl2x created [must-gather ] OUT 2026-07-29T11:34:50.771245124Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-xcvx2] OUT 2026-07-29T11:35:42.660415606Z waiting for gather to complete [must-gather-xcvx2] OUT 2026-07-29T11:35:42.663320346Z downloading gather output [must-gather-xcvx2] OUT 2026-07-29T11:35:42.915456189Z receiving incremental file list [must-gather-xcvx2] OUT 2026-07-29T11:35:42.925902285Z ./ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.925947387Z aggregated-discovery-api.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.926393818Z aggregated-discovery-apis.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.926872972Z event-filter.html [must-gather-xcvx2] OUT 2026-07-29T11:35:42.926970817Z timestamp [must-gather-xcvx2] OUT 2026-07-29T11:35:42.927138354Z version [must-gather-xcvx2] OUT 2026-07-29T11:35:42.931309927Z namespaces/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.931338848Z namespaces/opendatahub/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.93137179Z namespaces/opendatahub/opendatahub.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.931480075Z namespaces/opendatahub/apps.openshift.io/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.931514857Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.931606291Z namespaces/opendatahub/apps/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.931650163Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.931736627Z namespaces/opendatahub/apps/deployments.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.931892795Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.932015271Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.932041112Z namespaces/opendatahub/autoscaling/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.932149237Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.932184049Z namespaces/opendatahub/batch/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.932267003Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.932326056Z namespaces/opendatahub/batch/jobs.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.932376548Z namespaces/opendatahub/build.openshift.io/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.93240538Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.932500114Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.932530706Z namespaces/opendatahub/core/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.932583378Z namespaces/opendatahub/core/configmaps.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.932703094Z namespaces/opendatahub/core/endpoints.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.932787578Z namespaces/opendatahub/core/events.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.932902544Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.932983148Z namespaces/opendatahub/core/pods.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.933133215Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.93325122Z namespaces/opendatahub/core/secrets.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.933422059Z namespaces/opendatahub/core/services.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.933478681Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.933524314Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.933579246Z namespaces/opendatahub/image.openshift.io/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.933625419Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.933715333Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.933755965Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.933839539Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.933885041Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.933927833Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.933978776Z namespaces/opendatahub/networking.k8s.io/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.934024348Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.93406282Z namespaces/opendatahub/pods/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.93406979Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-gxs4t/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.934137733Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-gxs4t/kubeflow-trainer-controller-manager-7b4fcbc79d-gxs4t.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.934228378Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-gxs4t/manager/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.934244489Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-gxs4t/manager/manager/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.934249059Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-gxs4t/manager/manager/logs/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.93426587Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-gxs4t/manager/manager/logs/current.log [must-gather-xcvx2] OUT 2026-07-29T11:35:42.934432678Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-gxs4t/manager/manager/logs/previous.insecure.log [must-gather-xcvx2] OUT 2026-07-29T11:35:42.934500991Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-7b4fcbc79d-gxs4t/manager/manager/logs/previous.log [must-gather-xcvx2] OUT 2026-07-29T11:35:42.934535132Z namespaces/opendatahub/policy/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.934581225Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.934634817Z namespaces/opendatahub/route.openshift.io/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.934675999Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.934731542Z namespaces/openshift/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.934760463Z namespaces/openshift/openshift.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.934819826Z namespaces/openshift/apps.openshift.io/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.934848738Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.934909711Z namespaces/openshift/apps/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.934947263Z namespaces/openshift/apps/daemonsets.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.935032377Z namespaces/openshift/apps/deployments.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.935136942Z namespaces/openshift/apps/replicasets.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.935223086Z namespaces/openshift/apps/statefulsets.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.935272728Z namespaces/openshift/autoscaling/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.93530374Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.935342782Z namespaces/openshift/batch/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.935396954Z namespaces/openshift/batch/cronjobs.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.935489729Z namespaces/openshift/batch/jobs.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.935534261Z namespaces/openshift/build.openshift.io/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.935576553Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.935659927Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.935704989Z namespaces/openshift/core/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.935749851Z namespaces/openshift/core/configmaps.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.935849456Z namespaces/openshift/core/endpoints.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.93593021Z namespaces/openshift/core/events.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.936014574Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.936100248Z namespaces/openshift/core/pods.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.936205763Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.936326469Z namespaces/openshift/core/secrets.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.936480577Z namespaces/openshift/core/services.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.936530119Z namespaces/openshift/discovery.k8s.io/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.936569431Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.936621933Z namespaces/openshift/image.openshift.io/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.936672676Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.938006761Z namespaces/openshift/k8s.ovn.org/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.938048223Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.938169928Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.938215191Z namespaces/openshift/monitoring.coreos.com/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.938250843Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.938309305Z namespaces/openshift/networking.k8s.io/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.938340137Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.938397179Z namespaces/openshift/policy/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.938435841Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.938486314Z namespaces/openshift/route.openshift.io/ [must-gather-xcvx2] OUT 2026-07-29T11:35:42.938505285Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-xcvx2] OUT 2026-07-29T11:35:42.944450763Z [must-gather-xcvx2] OUT 2026-07-29T11:35:42.944508565Z sent 1,372 bytes received 70,315 bytes 143,374.00 bytes/sec [must-gather-xcvx2] OUT 2026-07-29T11:35:42.944521686Z total size is 837,376 speedup is 11.68 [must-gather ] OUT 2026-07-29T11:35:42.973686267Z namespace/openshift-must-gather-9z9gw deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: ef98f928-c8cb-423e-b5ab-d53ec779514f ClientVersion: 4.22.5 ClusterVersion: Stable at "4.21.26" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing