[must-gather ] OUT 2026-04-22T19:27:04.789945946Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 5fc9fe23-c338-428c-973c-fc3e7883393e ClientVersion: 4.21.5 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-04-22T19:27:04.849461659Z namespace/openshift-must-gather-hjdk5 created [must-gather ] OUT 2026-04-22T19:27:04.855099464Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-xs9hk created [must-gather ] OUT 2026-04-22T19:27:04.885654939Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-pk87w] OUT 2026-04-22T19:27:30.426274839Z waiting for gather to complete [must-gather-pk87w] OUT 2026-04-22T19:27:30.430491789Z downloading gather output [must-gather-pk87w] OUT 2026-04-22T19:27:30.717912302Z receiving incremental file list [must-gather-pk87w] OUT 2026-04-22T19:27:30.728439661Z ./ [must-gather-pk87w] OUT 2026-04-22T19:27:30.728515093Z aggregated-discovery-api.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.728785719Z aggregated-discovery-apis.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.729395793Z event-filter.html [must-gather-pk87w] OUT 2026-04-22T19:27:30.729619699Z timestamp [must-gather-pk87w] OUT 2026-04-22T19:27:30.729783623Z version [must-gather-pk87w] OUT 2026-04-22T19:27:30.732907877Z cluster-scoped-resources/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.732944337Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.732953268Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.732974238Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.73306341Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.73307264Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.733114161Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.733197754Z namespaces/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.733205674Z namespaces/kserve-ci-e2e-test/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.733268595Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.733331977Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.733388978Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.733448669Z namespaces/kserve-ci-e2e-test/apps/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.73348718Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.733568102Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.733696905Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.733807588Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.733860219Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.73391852Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.733980422Z namespaces/kserve-ci-e2e-test/batch/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.734026783Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.734113505Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.734177166Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.734253258Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.734348031Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.734392682Z namespaces/kserve-ci-e2e-test/core/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.734429732Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.734579466Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.734703459Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.734867053Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.734947145Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.735082508Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.735220801Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.735460627Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.735510008Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.735557109Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.735619101Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.735679962Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.735726103Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.735779224Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.735862897Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.735911467Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.735957669Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.73603997Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.736077691Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.736131493Z namespaces/kserve-ci-e2e-test/pods/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.736143793Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.736179264Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.736343868Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/agent/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.736358648Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/agent/agent/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.736366318Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/agent/agent/logs/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.736390249Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/agent/agent/logs/current.log [must-gather-pk87w] OUT 2026-04-22T19:27:30.736488541Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/agent/agent/logs/previous.insecure.log [must-gather-pk87w] OUT 2026-04-22T19:27:30.736557593Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/agent/agent/logs/previous.log [must-gather-pk87w] OUT 2026-04-22T19:27:30.736601484Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/kserve-container/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.736613154Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/kserve-container/kserve-container/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.736618834Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/kserve-container/kserve-container/logs/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.736647255Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/kserve-container/kserve-container/logs/current.log [must-gather-pk87w] OUT 2026-04-22T19:27:30.736753498Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-pk87w] OUT 2026-04-22T19:27:30.736826009Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/kserve-container/kserve-container/logs/previous.log [must-gather-pk87w] OUT 2026-04-22T19:27:30.73686762Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/storage-initializer/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.73687927Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/storage-initializer/storage-initializer/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.73688471Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/storage-initializer/storage-initializer/logs/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.736918991Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/storage-initializer/storage-initializer/logs/current.log [must-gather-pk87w] OUT 2026-04-22T19:27:30.737018134Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-pk87w] OUT 2026-04-22T19:27:30.737092075Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-af6af-predictor-6bddc89fbc-slm4c/storage-initializer/storage-initializer/logs/previous.log [must-gather-pk87w] OUT 2026-04-22T19:27:30.737130736Z namespaces/kserve-ci-e2e-test/policy/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.737172037Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.737248039Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather-pk87w] OUT 2026-04-22T19:27:30.7372884Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather-pk87w] OUT 2026-04-22T19:27:30.746108199Z [must-gather-pk87w] OUT 2026-04-22T19:27:30.746133319Z sent 995 bytes received 43,653 bytes 89,296.00 bytes/sec [must-gather-pk87w] OUT 2026-04-22T19:27:30.746140849Z total size is 312,658 speedup is 7.00 [must-gather ] OUT 2026-04-22T19:27:30.777674705Z namespace/openshift-must-gather-hjdk5 deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 5fc9fe23-c338-428c-973c-fc3e7883393e ClientVersion: 4.21.5 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing