[must-gather ] OUT 2026-09-15T16:55:24.988044688Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 0920466a-2e99-42c5-b806-6a9afffb59f1 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.33" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-09-15T16:55:25.039838608Z namespace/openshift-must-gather-sfncz created [must-gather ] OUT 2026-09-15T16:55:25.058156864Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-smd6s created [must-gather ] OUT 2026-09-15T16:55:25.096054221Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-4pkgn] OUT 2026-09-15T16:55:54.940555814Z waiting for gather to complete [must-gather-4pkgn] OUT 2026-09-15T16:55:54.943381998Z downloading gather output [must-gather-4pkgn] OUT 2026-09-15T16:55:55.200297542Z receiving incremental file list [must-gather-4pkgn] OUT 2026-09-15T16:55:55.21285054Z ./ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.212940162Z aggregated-discovery-api.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.213294749Z aggregated-discovery-apis.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.214348738Z event-filter.html [must-gather-4pkgn] OUT 2026-09-15T16:55:55.21546141Z timestamp [must-gather-4pkgn] OUT 2026-09-15T16:55:55.215609753Z version [must-gather-4pkgn] OUT 2026-09-15T16:55:55.215672434Z cluster-scoped-resources/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.215691854Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.215701464Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.215716124Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.215791566Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.215806586Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.215834817Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.215880688Z namespaces/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.215894968Z namespaces/kserve-ci-e2e-test/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.215915528Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.2159808Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.216031601Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.216054161Z namespaces/kserve-ci-e2e-test/apps/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.216108512Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.216218344Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.216299015Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.216376107Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.216422028Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.216446218Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.21651317Z namespaces/kserve-ci-e2e-test/batch/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.21654153Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.216626092Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.216681433Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.216720334Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.216796965Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.216841236Z namespaces/kserve-ci-e2e-test/core/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.216887167Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.216999719Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.21707555Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.219487466Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.219559997Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.219739621Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.219855703Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.220053957Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.220103958Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.22019326Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.22023957Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.220283881Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.220316312Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.220364853Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.220441254Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.220487435Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.220527266Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.220585537Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.220615648Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.220667718Z namespaces/kserve-ci-e2e-test/pods/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.220674689Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.220719579Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.220874542Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/agent/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.220884762Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/agent/agent/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.220890093Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/agent/agent/logs/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.220899243Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/agent/agent/logs/current.log [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221035745Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/agent/agent/logs/previous.insecure.log [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221099607Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/agent/agent/logs/previous.log [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221148967Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/kserve-container/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221163918Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/kserve-container/kserve-container/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221168108Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/kserve-container/kserve-container/logs/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221197188Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/kserve-container/kserve-container/logs/current.log [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221308901Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221373082Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/kserve-container/kserve-container/logs/previous.log [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221415703Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/kube-rbac-proxy/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221424203Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/kube-rbac-proxy/kube-rbac-proxy/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221428073Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221435193Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221558005Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221628797Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221656537Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/storage-initializer/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221660947Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/storage-initializer/storage-initializer/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221664617Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/storage-initializer/storage-initializer/logs/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221701978Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/storage-initializer/storage-initializer/logs/current.log [must-gather-4pkgn] OUT 2026-09-15T16:55:55.22179892Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221869101Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c69cff6d-nt5lb/storage-initializer/storage-initializer/logs/previous.log [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221906192Z namespaces/kserve-ci-e2e-test/policy/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221934393Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.221989054Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather-4pkgn] OUT 2026-09-15T16:55:55.222017834Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather-4pkgn] OUT 2026-09-15T16:55:55.228809643Z [must-gather-4pkgn] OUT 2026-09-15T16:55:55.228827113Z sent 1,072 bytes received 99,100 bytes 66,781.33 bytes/sec [must-gather-4pkgn] OUT 2026-09-15T16:55:55.228842744Z total size is 1,458,929 speedup is 14.56 [must-gather ] OUT 2026-09-15T16:55:55.339409281Z namespace/openshift-must-gather-sfncz deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 0920466a-2e99-42c5-b806-6a9afffb59f1 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.33" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing