[must-gather ] OUT 2026-09-18T16:49:44.787898996Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: d924007d-6f06-4d5e-8aa5-cf40bb5fee64 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.34" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-09-18T16:49:44.846448361Z namespace/openshift-must-gather-r9h5x created [must-gather ] OUT 2026-09-18T16:49:44.856635084Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-mmct5 created [must-gather ] OUT 2026-09-18T16:49:44.896726532Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-9fj44] OUT 2026-09-18T16:50:15.496316761Z waiting for gather to complete [must-gather-9fj44] OUT 2026-09-18T16:50:15.499317264Z downloading gather output [must-gather-9fj44] OUT 2026-09-18T16:50:15.811117948Z receiving incremental file list [must-gather-9fj44] OUT 2026-09-18T16:50:15.824276893Z ./ [must-gather-9fj44] OUT 2026-09-18T16:50:15.824344285Z aggregated-discovery-api.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.8283845Z aggregated-discovery-apis.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.82934397Z event-filter.html [must-gather-9fj44] OUT 2026-09-18T16:50:15.830504964Z timestamp [must-gather-9fj44] OUT 2026-09-18T16:50:15.830642787Z version [must-gather-9fj44] OUT 2026-09-18T16:50:15.830694048Z cluster-scoped-resources/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.830704718Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.830730749Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.83076564Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.830849961Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.830861722Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.830895902Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.830939993Z namespaces/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.830949593Z namespaces/kserve-ci-e2e-test/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.831008125Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.831049195Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.831096527Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.831144997Z namespaces/kserve-ci-e2e-test/apps/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.831169218Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.83125939Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.831334352Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.831420213Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.831464904Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.831486095Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.831549196Z namespaces/kserve-ci-e2e-test/batch/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.831596367Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.831669508Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.83172714Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.83175446Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.831852852Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.831901803Z namespaces/kserve-ci-e2e-test/core/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.831933484Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.832057307Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.832136048Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.83458907Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.834658281Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.834872616Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.834993728Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.835189112Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.835234083Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.835283534Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.835328115Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.835371486Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.835415737Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.835444127Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.835531609Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.83557864Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.835607591Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.835664162Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.835698813Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.835760614Z namespaces/kserve-ci-e2e-test/pods/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.835772674Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.835809275Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.835998999Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/agent/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.836008869Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/agent/agent/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.83601371Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/agent/agent/logs/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.83604113Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/agent/agent/logs/current.log [must-gather-9fj44] OUT 2026-09-18T16:50:15.836167223Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/agent/agent/logs/previous.insecure.log [must-gather-9fj44] OUT 2026-09-18T16:50:15.836217114Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/agent/agent/logs/previous.log [must-gather-9fj44] OUT 2026-09-18T16:50:15.836253975Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/kserve-container/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.836268055Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/kserve-container/kserve-container/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.836272395Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/kserve-container/kserve-container/logs/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.836297125Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/kserve-container/kserve-container/logs/current.log [must-gather-9fj44] OUT 2026-09-18T16:50:15.836412428Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-9fj44] OUT 2026-09-18T16:50:15.836483729Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/kserve-container/kserve-container/logs/previous.log [must-gather-9fj44] OUT 2026-09-18T16:50:15.8365218Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/kube-rbac-proxy/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.83652912Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/kube-rbac-proxy/kube-rbac-proxy/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.83654041Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.836559731Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather-9fj44] OUT 2026-09-18T16:50:15.836687384Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather-9fj44] OUT 2026-09-18T16:50:15.836774815Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather-9fj44] OUT 2026-09-18T16:50:15.836806526Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/storage-initializer/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.836814486Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/storage-initializer/storage-initializer/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.836818646Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/storage-initializer/storage-initializer/logs/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.836848947Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/storage-initializer/storage-initializer/logs/current.log [must-gather-9fj44] OUT 2026-09-18T16:50:15.836951259Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-9fj44] OUT 2026-09-18T16:50:15.837027681Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-kqp6p/storage-initializer/storage-initializer/logs/previous.log [must-gather-9fj44] OUT 2026-09-18T16:50:15.837045181Z namespaces/kserve-ci-e2e-test/policy/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.837094952Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.837138393Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather-9fj44] OUT 2026-09-18T16:50:15.837180074Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather-9fj44] OUT 2026-09-18T16:50:15.844536288Z [must-gather-9fj44] OUT 2026-09-18T16:50:15.844598719Z sent 1,072 bytes received 99,802 bytes 201,748.00 bytes/sec [must-gather-9fj44] OUT 2026-09-18T16:50:15.84461785Z total size is 1,459,549 speedup is 14.47 [must-gather ] OUT 2026-09-18T16:50:15.959345774Z namespace/openshift-must-gather-r9h5x deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: d924007d-6f06-4d5e-8aa5-cf40bb5fee64 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.34" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing