[must-gather ] OUT 2026-07-15T11:38:38.970423344Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 88896b19-392a-4d22-9b36-c3242f97b32e ClientVersion: 4.22.3 ClusterVersion: Stable at "4.21.24" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-07-15T11:38:39.019459902Z namespace/openshift-must-gather-dlr65 created [must-gather ] OUT 2026-07-15T11:38:39.026374287Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-ppqsn created [must-gather ] OUT 2026-07-15T11:38:39.064854769Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-sfkr8] OUT 2026-07-15T11:39:34.854552721Z waiting for gather to complete [must-gather-sfkr8] OUT 2026-07-15T11:39:34.857192285Z downloading gather output [must-gather-sfkr8] OUT 2026-07-15T11:39:35.126506565Z receiving incremental file list [must-gather-sfkr8] OUT 2026-07-15T11:39:35.137458406Z ./ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.13759458Z aggregated-discovery-api.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.137852059Z aggregated-discovery-apis.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.138898162Z event-filter.html [must-gather-sfkr8] OUT 2026-07-15T11:39:35.139031006Z timestamp [must-gather-sfkr8] OUT 2026-07-15T11:39:35.139179711Z version [must-gather-sfkr8] OUT 2026-07-15T11:39:35.143946494Z namespaces/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.143967184Z namespaces/opendatahub/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.144029117Z namespaces/opendatahub/opendatahub.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.144164971Z namespaces/opendatahub/apps.openshift.io/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.144221463Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.144308345Z namespaces/opendatahub/apps/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.144385808Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.144524052Z namespaces/opendatahub/apps/deployments.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.144667337Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.144799421Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.144860753Z namespaces/opendatahub/autoscaling/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.144911085Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.144984447Z namespaces/opendatahub/batch/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.145033489Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.145173053Z namespaces/opendatahub/batch/jobs.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.145234675Z namespaces/opendatahub/build.openshift.io/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.145283447Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.14538249Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.145439602Z namespaces/opendatahub/core/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.145497064Z namespaces/opendatahub/core/configmaps.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.145636358Z namespaces/opendatahub/core/endpoints.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.145746152Z namespaces/opendatahub/core/events.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.145880916Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.145986439Z namespaces/opendatahub/core/pods.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.146157325Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.14631957Z namespaces/opendatahub/core/secrets.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.146525806Z namespaces/opendatahub/core/services.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.146597989Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.14664823Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.146752854Z namespaces/opendatahub/image.openshift.io/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.146787405Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.146899518Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.14694915Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.147049323Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.147129876Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.147185047Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.147244209Z namespaces/opendatahub/networking.k8s.io/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.147290611Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.147359413Z namespaces/opendatahub/pods/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.147373104Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-59f987bd9d-pkcdp/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.147410885Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-59f987bd9d-pkcdp/kubeflow-trainer-controller-manager-59f987bd9d-pkcdp.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.147514208Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-59f987bd9d-pkcdp/manager/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.147522838Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-59f987bd9d-pkcdp/manager/manager/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.147527298Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-59f987bd9d-pkcdp/manager/manager/logs/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.14757254Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-59f987bd9d-pkcdp/manager/manager/logs/current.log [must-gather-sfkr8] OUT 2026-07-15T11:39:35.149115829Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-59f987bd9d-pkcdp/manager/manager/logs/previous.insecure.log [must-gather-sfkr8] OUT 2026-07-15T11:39:35.149228053Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-59f987bd9d-pkcdp/manager/manager/logs/previous.log [must-gather-sfkr8] OUT 2026-07-15T11:39:35.149248844Z namespaces/opendatahub/policy/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.149300155Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.149363427Z namespaces/opendatahub/route.openshift.io/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.149414839Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.149488371Z namespaces/openshift/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.149533553Z namespaces/openshift/openshift.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.149602185Z namespaces/openshift/apps.openshift.io/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.149646806Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.149740909Z namespaces/openshift/apps/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.149793911Z namespaces/openshift/apps/daemonsets.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.149898644Z namespaces/openshift/apps/deployments.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.149994697Z namespaces/openshift/apps/replicasets.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.150117812Z namespaces/openshift/apps/statefulsets.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.150179213Z namespaces/openshift/autoscaling/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.150236325Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.150301627Z namespaces/openshift/batch/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.150343779Z namespaces/openshift/batch/cronjobs.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.150443852Z namespaces/openshift/batch/jobs.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.150504504Z namespaces/openshift/build.openshift.io/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.150556015Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.150657599Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.150735891Z namespaces/openshift/core/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.150777982Z namespaces/openshift/core/configmaps.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.150896456Z namespaces/openshift/core/endpoints.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.15099714Z namespaces/openshift/core/events.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.151129054Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.151231767Z namespaces/openshift/core/pods.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.15132385Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.151483885Z namespaces/openshift/core/secrets.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.151687452Z namespaces/openshift/core/services.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.151743793Z namespaces/openshift/discovery.k8s.io/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.151799705Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.151868308Z namespaces/openshift/image.openshift.io/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.151914719Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.153313374Z namespaces/openshift/k8s.ovn.org/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.153354895Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.153479109Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.15352182Z namespaces/openshift/monitoring.coreos.com/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.153582822Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.153626044Z namespaces/openshift/networking.k8s.io/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.153689236Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.153746097Z namespaces/openshift/policy/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.153794209Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.153849871Z namespaces/openshift/route.openshift.io/ [must-gather-sfkr8] OUT 2026-07-15T11:39:35.153902302Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-sfkr8] OUT 2026-07-15T11:39:35.161038231Z [must-gather-sfkr8] OUT 2026-07-15T11:39:35.161056631Z sent 1,380 bytes received 98,820 bytes 66,800.00 bytes/sec [must-gather-sfkr8] OUT 2026-07-15T11:39:35.161107353Z total size is 1,270,737 speedup is 12.68 [must-gather ] OUT 2026-07-15T11:39:35.191784915Z namespace/openshift-must-gather-dlr65 deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 88896b19-392a-4d22-9b36-c3242f97b32e ClientVersion: 4.22.3 ClusterVersion: Stable at "4.21.24" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing