[must-gather ] OUT 2026-04-22T20:07:44.179328591Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 71d5e3c7-f27c-4551-b002-d33ef4cbb640 ClientVersion: 4.21.5 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-04-22T20:07:44.234674188Z namespace/openshift-must-gather-jqggs created [must-gather ] OUT 2026-04-22T20:07:44.239594533Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-wcntc created [must-gather ] OUT 2026-04-22T20:07:44.259429444Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-4plx5] OUT 2026-04-22T20:08:09.654864836Z waiting for gather to complete [must-gather-4plx5] OUT 2026-04-22T20:08:09.657832246Z downloading gather output [must-gather-4plx5] OUT 2026-04-22T20:08:09.912959391Z receiving incremental file list [must-gather-4plx5] OUT 2026-04-22T20:08:09.926426952Z ./ [must-gather-4plx5] OUT 2026-04-22T20:08:09.926609404Z aggregated-discovery-api.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.927245415Z aggregated-discovery-apis.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.927837463Z event-filter.html [must-gather-4plx5] OUT 2026-04-22T20:08:09.928069497Z timestamp [must-gather-4plx5] OUT 2026-04-22T20:08:09.928233608Z version [must-gather-4plx5] OUT 2026-04-22T20:08:09.928324884Z cluster-scoped-resources/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.928337224Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.928344425Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.928393328Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.928480714Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.928494414Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.928542038Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.928617993Z namespaces/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.928628673Z namespaces/kserve-ci-e2e-test/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.928676566Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.928748821Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.928801834Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.928850977Z namespaces/kserve-ci-e2e-test/apps/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.928942153Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.929019858Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.929171878Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.929295846Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.92935485Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.929409463Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.929489618Z namespaces/kserve-ci-e2e-test/batch/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.929545502Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.929641898Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.929693541Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.929745845Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.929839021Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.929890734Z namespaces/kserve-ci-e2e-test/core/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.929964329Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.930117998Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.930215505Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.930405447Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.930497353Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.930656443Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.930804682Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.931039768Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.931110522Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.931173006Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.931244501Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.931297884Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.931352188Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.931405091Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.931493957Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.93155587Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.931597213Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.93170871Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.931759743Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.931818127Z namespaces/kserve-ci-e2e-test/pods/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.931829388Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.931877301Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.932052842Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/agent/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.932065573Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/agent/agent/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.932073203Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/agent/agent/logs/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.932112716Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/agent/agent/logs/current.log [must-gather-4plx5] OUT 2026-04-22T20:08:09.932219323Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/agent/agent/logs/previous.insecure.log [must-gather-4plx5] OUT 2026-04-22T20:08:09.932303378Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/agent/agent/logs/previous.log [must-gather-4plx5] OUT 2026-04-22T20:08:09.932350761Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/kserve-container/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.932358062Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/kserve-container/kserve-container/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.932361762Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/kserve-container/kserve-container/logs/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.932401484Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/kserve-container/kserve-container/logs/current.log [must-gather-4plx5] OUT 2026-04-22T20:08:09.932525743Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-4plx5] OUT 2026-04-22T20:08:09.932610248Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/kserve-container/kserve-container/logs/previous.log [must-gather-4plx5] OUT 2026-04-22T20:08:09.932658351Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/storage-initializer/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.932668412Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/storage-initializer/storage-initializer/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.932673432Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/storage-initializer/storage-initializer/logs/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.932707814Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/storage-initializer/storage-initializer/logs/current.log [must-gather-4plx5] OUT 2026-04-22T20:08:09.932813281Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-4plx5] OUT 2026-04-22T20:08:09.932911367Z namespaces/kserve-ci-e2e-test/pods/isvc-raw-sklearn-batcher-ccfea-predictor-6d6f8b4979-6b8df/storage-initializer/storage-initializer/logs/previous.log [must-gather-4plx5] OUT 2026-04-22T20:08:09.93296078Z namespaces/kserve-ci-e2e-test/policy/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.933001503Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.933059617Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather-4plx5] OUT 2026-04-22T20:08:09.93311031Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather-4plx5] OUT 2026-04-22T20:08:09.941841519Z [must-gather-4plx5] OUT 2026-04-22T20:08:09.941883021Z sent 995 bytes received 43,773 bytes 89,536.00 bytes/sec [must-gather-4plx5] OUT 2026-04-22T20:08:09.941891962Z total size is 312,701 speedup is 6.98 [must-gather ] OUT 2026-04-22T20:08:09.972975901Z namespace/openshift-must-gather-jqggs deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 71d5e3c7-f27c-4551-b002-d33ef4cbb640 ClientVersion: 4.21.5 ClusterVersion: Stable at "4.20.19" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing