[must-gather ] OUT 2026-08-05T17:41:55.7897437Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 6d591aa5-880d-46e2-9d66-1f7f9fabfaea ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.27" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-08-05T17:41:55.846373214Z namespace/openshift-must-gather-jt96s created [must-gather ] OUT 2026-08-05T17:41:55.857631179Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-bwlzf created [must-gather ] OUT 2026-08-05T17:41:55.91247807Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-vflx9] OUT 2026-08-05T17:42:26.739397363Z waiting for gather to complete [must-gather-vflx9] OUT 2026-08-05T17:42:26.744001951Z downloading gather output [must-gather-vflx9] OUT 2026-08-05T17:42:27.022386379Z receiving incremental file list [must-gather-vflx9] OUT 2026-08-05T17:42:27.036512871Z ./ [must-gather-vflx9] OUT 2026-08-05T17:42:27.037010976Z aggregated-discovery-api.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.037062598Z aggregated-discovery-apis.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.038070568Z event-filter.html [must-gather-vflx9] OUT 2026-08-05T17:42:27.039425458Z timestamp [must-gather-vflx9] OUT 2026-08-05T17:42:27.039555272Z version [must-gather-vflx9] OUT 2026-08-05T17:42:27.040328195Z cluster-scoped-resources/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.040347896Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.040355416Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.040368206Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.040454339Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.04047296Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.04049049Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.040550252Z namespaces/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.040566942Z namespaces/kserve-ci-e2e-test/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.040606524Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.040674826Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.040695736Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.040761718Z namespaces/kserve-ci-e2e-test/apps/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.040793249Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.040906952Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.040948524Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.041034566Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.041064307Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.041111848Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.04116324Z namespaces/kserve-ci-e2e-test/batch/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.041202361Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.041305904Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.041366816Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.041398787Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.04148251Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.041523091Z namespaces/kserve-ci-e2e-test/core/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.041567992Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.041706856Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.041762968Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.044059096Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.044132319Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.044320454Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.04450927Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.044712446Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.044749627Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.044796369Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.04484831Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.044869301Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.044930242Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.044970314Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.045130528Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.04516638Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.045213101Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.045278863Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.045299784Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.045373416Z namespaces/kserve-ci-e2e-test/pods/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.045383326Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.045391616Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.045563361Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/agent/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.045573212Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/agent/agent/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.045578322Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/agent/agent/logs/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.045586502Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/agent/agent/logs/current.log [must-gather-vflx9] OUT 2026-08-05T17:42:27.045708326Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/agent/agent/logs/previous.insecure.log [must-gather-vflx9] OUT 2026-08-05T17:42:27.045773688Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/agent/agent/logs/previous.log [must-gather-vflx9] OUT 2026-08-05T17:42:27.045795719Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/kserve-container/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.045808599Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/kserve-container/kserve-container/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.045816989Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/kserve-container/kserve-container/logs/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.04584473Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/kserve-container/kserve-container/logs/current.log [must-gather-vflx9] OUT 2026-08-05T17:42:27.045960983Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-vflx9] OUT 2026-08-05T17:42:27.046029165Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/kserve-container/kserve-container/logs/previous.log [must-gather-vflx9] OUT 2026-08-05T17:42:27.046048156Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/kube-rbac-proxy/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.046054926Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/kube-rbac-proxy/kube-rbac-proxy/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.046059206Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.046092177Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather-vflx9] OUT 2026-08-05T17:42:27.046214111Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather-vflx9] OUT 2026-08-05T17:42:27.046298694Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather-vflx9] OUT 2026-08-05T17:42:27.046334384Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/storage-initializer/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.046339685Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/storage-initializer/storage-initializer/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.046343605Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/storage-initializer/storage-initializer/logs/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.046375396Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/storage-initializer/storage-initializer/logs/current.log [must-gather-vflx9] OUT 2026-08-05T17:42:27.046474629Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-vflx9] OUT 2026-08-05T17:42:27.04653509Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7d4b6c5f84-qmtr5/storage-initializer/storage-initializer/logs/previous.log [must-gather-vflx9] OUT 2026-08-05T17:42:27.046565231Z namespaces/kserve-ci-e2e-test/policy/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.046602352Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.046652774Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather-vflx9] OUT 2026-08-05T17:42:27.046690105Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather-vflx9] OUT 2026-08-05T17:42:27.053654253Z [must-gather-vflx9] OUT 2026-08-05T17:42:27.053669384Z sent 1,068 bytes received 93,552 bytes 63,080.00 bytes/sec [must-gather-vflx9] OUT 2026-08-05T17:42:27.053675264Z total size is 1,321,960 speedup is 13.97 [must-gather ] OUT 2026-08-05T17:42:27.163110964Z namespace/openshift-must-gather-jt96s deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 6d591aa5-880d-46e2-9d66-1f7f9fabfaea ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.27" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing