[must-gather ] OUT 2026-09-08T13:45:10.289328008Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 5e9e7288-3629-40b5-ac40-9fbe6a289fd7 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.32" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-09-08T13:45:10.337589627Z namespace/openshift-must-gather-2n2hd created [must-gather ] OUT 2026-09-08T13:45:10.346942605Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-xl9kq created [must-gather ] OUT 2026-09-08T13:45:10.369543355Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-drb2q] OUT 2026-09-08T13:45:40.29972801Z waiting for gather to complete [must-gather-drb2q] OUT 2026-09-08T13:45:40.303286008Z downloading gather output [must-gather-drb2q] OUT 2026-09-08T13:45:40.627986361Z receiving incremental file list [must-gather-drb2q] OUT 2026-09-08T13:45:40.647522053Z ./ [must-gather-drb2q] OUT 2026-09-08T13:45:40.647642183Z aggregated-discovery-api.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.647967119Z aggregated-discovery-apis.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.648923717Z event-filter.html [must-gather-drb2q] OUT 2026-09-08T13:45:40.650182149Z timestamp [must-gather-drb2q] OUT 2026-09-08T13:45:40.650360133Z version [must-gather-drb2q] OUT 2026-09-08T13:45:40.658803867Z cluster-scoped-resources/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.658826499Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.658833039Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.658943798Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.659083819Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.659097741Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.659156196Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.659243883Z namespaces/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.659257294Z namespaces/kserve-ci-e2e-test/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.659311038Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.659412066Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.65946475Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.659524735Z namespaces/kserve-ci-e2e-test/apps/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.659568609Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.659681688Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.659801248Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.659917907Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.659976532Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.660038277Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.660104172Z namespaces/kserve-ci-e2e-test/batch/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.660160697Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.660271636Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.660329771Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.660389045Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.660491684Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.660546048Z namespaces/kserve-ci-e2e-test/core/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.660598272Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.660766986Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.661010546Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.663914101Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.663987827Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.664179742Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.664354376Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.66465043Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.664697254Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.664740138Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.66477142Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.664851567Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.664904171Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.664927193Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.66501997Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.665067004Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.665111368Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.665155721Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.665201715Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.665241488Z namespaces/kserve-ci-e2e-test/pods/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.665251649Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.665298463Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.665478357Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/agent/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.665489168Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/agent/agent/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.665494299Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/agent/agent/logs/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.665503849Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/agent/agent/logs/current.log [must-gather-drb2q] OUT 2026-09-08T13:45:40.665624359Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/agent/agent/logs/previous.insecure.log [must-gather-drb2q] OUT 2026-09-08T13:45:40.665726977Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/agent/agent/logs/previous.log [must-gather-drb2q] OUT 2026-09-08T13:45:40.665839446Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/kserve-container/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.66588183Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/kserve-container/kserve-container/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.66588741Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/kserve-container/kserve-container/logs/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.665891661Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/kserve-container/kserve-container/logs/current.log [must-gather-drb2q] OUT 2026-09-08T13:45:40.665901771Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-drb2q] OUT 2026-09-08T13:45:40.665978008Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/kserve-container/kserve-container/logs/previous.log [must-gather-drb2q] OUT 2026-09-08T13:45:40.666024352Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/kube-rbac-proxy/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.666031832Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/kube-rbac-proxy/kube-rbac-proxy/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.666035973Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.666096457Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather-drb2q] OUT 2026-09-08T13:45:40.666207906Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather-drb2q] OUT 2026-09-08T13:45:40.666278902Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather-drb2q] OUT 2026-09-08T13:45:40.666316645Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/storage-initializer/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.666324086Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/storage-initializer/storage-initializer/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.666328386Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/storage-initializer/storage-initializer/logs/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.666359249Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/storage-initializer/storage-initializer/logs/current.log [must-gather-drb2q] OUT 2026-09-08T13:45:40.666470418Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-drb2q] OUT 2026-09-08T13:45:40.666575196Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-5fc9c469d5-9cjl2/storage-initializer/storage-initializer/logs/previous.log [must-gather-drb2q] OUT 2026-09-08T13:45:40.666608419Z namespaces/kserve-ci-e2e-test/policy/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.666636301Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.666695126Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather-drb2q] OUT 2026-09-08T13:45:40.666725848Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather-drb2q] OUT 2026-09-08T13:45:40.679628423Z [must-gather-drb2q] OUT 2026-09-08T13:45:40.679649535Z sent 1,072 bytes received 99,874 bytes 201,892.00 bytes/sec [must-gather-drb2q] OUT 2026-09-08T13:45:40.679656456Z total size is 1,455,040 speedup is 14.41 [must-gather ] OUT 2026-09-08T13:45:40.807375638Z namespace/openshift-must-gather-2n2hd deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 5e9e7288-3629-40b5-ac40-9fbe6a289fd7 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.32" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing