[must-gather ] OUT 2026-04-17T10:58:54.663243888Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 4d7cc157-c88d-4ac0-a65f-cd1e5b874cf6 ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-04-17T10:58:54.719918496Z namespace/openshift-must-gather-4hpc2 created [must-gather ] OUT 2026-04-17T10:58:54.726763949Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-nj9w4 created [must-gather ] OUT 2026-04-17T10:58:54.751804416Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-qzv2m] OUT 2026-04-17T10:59:45.465159492Z waiting for gather to complete [must-gather-qzv2m] OUT 2026-04-17T10:59:45.468558607Z downloading gather output [must-gather-qzv2m] OUT 2026-04-17T10:59:45.753704193Z receiving incremental file list [must-gather-qzv2m] OUT 2026-04-17T10:59:45.766934515Z ./ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.767080296Z aggregated-discovery-api.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.767412221Z aggregated-discovery-apis.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.767903927Z event-filter.html [must-gather-qzv2m] OUT 2026-04-17T10:59:45.768036957Z timestamp [must-gather-qzv2m] OUT 2026-04-17T10:59:45.768181548Z version [must-gather-qzv2m] OUT 2026-04-17T10:59:45.771452733Z namespaces/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.771474225Z namespaces/opendatahub/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.771520658Z namespaces/opendatahub/opendatahub.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.771606735Z namespaces/opendatahub/apps.openshift.io/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.771685961Z namespaces/opendatahub/apps.openshift.io/deploymentconfigs.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.771715983Z namespaces/opendatahub/apps/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.771783798Z namespaces/opendatahub/apps/daemonsets.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.771924669Z namespaces/opendatahub/apps/deployments.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.772111203Z namespaces/opendatahub/apps/replicasets.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.772242952Z namespaces/opendatahub/apps/statefulsets.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.772294296Z namespaces/opendatahub/autoscaling/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.77234788Z namespaces/opendatahub/autoscaling/horizontalpodautoscalers.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.772400404Z namespaces/opendatahub/batch/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.772461659Z namespaces/opendatahub/batch/cronjobs.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.772583088Z namespaces/opendatahub/batch/jobs.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.772637732Z namespaces/opendatahub/build.openshift.io/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.772689336Z namespaces/opendatahub/build.openshift.io/buildconfigs.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.772800414Z namespaces/opendatahub/build.openshift.io/builds.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.772866379Z namespaces/opendatahub/core/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.772918013Z namespaces/opendatahub/core/configmaps.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.773091316Z namespaces/opendatahub/core/endpoints.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.773214175Z namespaces/opendatahub/core/events.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.773353646Z namespaces/opendatahub/core/persistentvolumeclaims.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.773423741Z namespaces/opendatahub/core/pods.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.773553441Z namespaces/opendatahub/core/replicationcontrollers.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.77367891Z namespaces/opendatahub/core/secrets.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.773875365Z namespaces/opendatahub/core/services.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.773934839Z namespaces/opendatahub/discovery.k8s.io/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.773981953Z namespaces/opendatahub/discovery.k8s.io/endpointslices.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.774034937Z namespaces/opendatahub/image.openshift.io/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.774093811Z namespaces/opendatahub/image.openshift.io/imagestreams.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.774180278Z namespaces/opendatahub/k8s.ovn.org/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.774219211Z namespaces/opendatahub/k8s.ovn.org/egressfirewalls.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.774300737Z namespaces/opendatahub/k8s.ovn.org/egressqoses.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.77434246Z namespaces/opendatahub/monitoring.coreos.com/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.774376652Z namespaces/opendatahub/monitoring.coreos.com/servicemonitors.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.774445958Z namespaces/opendatahub/networking.k8s.io/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.7744745Z namespaces/opendatahub/networking.k8s.io/networkpolicies.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.774529864Z namespaces/opendatahub/pods/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.774543485Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-k6qjj/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.774567407Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-k6qjj/kubeflow-trainer-controller-manager-55f5694779-k6qjj.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.774647243Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-k6qjj/manager/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.774655533Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-k6qjj/manager/manager/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.774659124Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-k6qjj/manager/manager/logs/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.774697516Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-k6qjj/manager/manager/logs/current.log [must-gather-qzv2m] OUT 2026-04-17T10:59:45.775230396Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-k6qjj/manager/manager/logs/previous.insecure.log [must-gather-qzv2m] OUT 2026-04-17T10:59:45.7752843Z namespaces/opendatahub/pods/kubeflow-trainer-controller-manager-55f5694779-k6qjj/manager/manager/logs/previous.log [must-gather-qzv2m] OUT 2026-04-17T10:59:45.775323683Z namespaces/opendatahub/policy/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.775351996Z namespaces/opendatahub/policy/poddisruptionbudgets.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.77540821Z namespaces/opendatahub/route.openshift.io/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.775432152Z namespaces/opendatahub/route.openshift.io/routes.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.775485416Z namespaces/openshift/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.775525969Z namespaces/openshift/openshift.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.775590734Z namespaces/openshift/apps.openshift.io/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.775611605Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.77567068Z namespaces/openshift/apps/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.775711733Z namespaces/openshift/apps/daemonsets.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.775793359Z namespaces/openshift/apps/deployments.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.775878835Z namespaces/openshift/apps/replicasets.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.775956871Z namespaces/openshift/apps/statefulsets.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.775994744Z namespaces/openshift/autoscaling/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.776048048Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.776116573Z namespaces/openshift/batch/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.776139725Z namespaces/openshift/batch/cronjobs.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.776221871Z namespaces/openshift/batch/jobs.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.776255764Z namespaces/openshift/build.openshift.io/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.776299567Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.776379973Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.776435697Z namespaces/openshift/core/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.776494311Z namespaces/openshift/core/configmaps.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.776588568Z namespaces/openshift/core/endpoints.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.776666924Z namespaces/openshift/core/events.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.776735619Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.776820516Z namespaces/openshift/core/pods.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.776900552Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.777057464Z namespaces/openshift/core/secrets.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.777245467Z namespaces/openshift/core/services.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.777298842Z namespaces/openshift/discovery.k8s.io/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.777340505Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.777384628Z namespaces/openshift/image.openshift.io/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.777419971Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.778969327Z namespaces/openshift/k8s.ovn.org/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.77901178Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.779129439Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.779157241Z namespaces/openshift/monitoring.coreos.com/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.779232836Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.7792787Z namespaces/openshift/networking.k8s.io/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.779313723Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.779369957Z namespaces/openshift/policy/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.779400339Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.779452523Z namespaces/openshift/route.openshift.io/ [must-gather-qzv2m] OUT 2026-04-17T10:59:45.779495466Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather-qzv2m] OUT 2026-04-17T10:59:45.787466874Z [must-gather-qzv2m] OUT 2026-04-17T10:59:45.787484975Z sent 1,372 bytes received 79,620 bytes 161,984.00 bytes/sec [must-gather-qzv2m] OUT 2026-04-17T10:59:45.787489955Z total size is 939,878 speedup is 11.60 [must-gather ] OUT 2026-04-17T10:59:45.816548244Z namespace/openshift-must-gather-4hpc2 deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 4d7cc157-c88d-4ac0-a65f-cd1e5b874cf6 ClientVersion: 4.21.9 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing