[must-gather ] OUT 2026-09-17T23:37:08.69915975Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 96d1dffb-5e6a-41e3-a767-7aee8396a267 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.34" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-09-17T23:37:08.7519789Z namespace/openshift-must-gather-7gr5m created [must-gather ] OUT 2026-09-17T23:37:08.763276298Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-dmr5v created [must-gather ] OUT 2026-09-17T23:37:08.792000692Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-f7pnh] OUT 2026-09-17T23:37:40.187235394Z waiting for gather to complete [must-gather-f7pnh] OUT 2026-09-17T23:37:40.190402702Z downloading gather output [must-gather-f7pnh] OUT 2026-09-17T23:37:40.479713594Z receiving incremental file list [must-gather-f7pnh] OUT 2026-09-17T23:37:40.493630998Z ./ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.493841434Z aggregated-discovery-api.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.494232853Z aggregated-discovery-apis.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.49486044Z event-filter.html [must-gather-f7pnh] OUT 2026-09-17T23:37:40.495958563Z timestamp [must-gather-f7pnh] OUT 2026-09-17T23:37:40.496092893Z version [must-gather-f7pnh] OUT 2026-09-17T23:37:40.496341891Z cluster-scoped-resources/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.496352762Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.496358443Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.496403536Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.496461191Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.496471021Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.496511874Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.496569659Z namespaces/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.496579659Z namespaces/kserve-ci-e2e-test/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.496625313Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.496704579Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.496768934Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.496820818Z namespaces/kserve-ci-e2e-test/apps/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.49685348Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.496940616Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.497006501Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.497088498Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.497131801Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.497179134Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.497220337Z namespaces/kserve-ci-e2e-test/batch/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.497267541Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.497351057Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.497398151Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.497418892Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.497503179Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.497555793Z namespaces/kserve-ci-e2e-test/core/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.497598866Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.497741217Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.497819813Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.499967264Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.500067891Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.500271266Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.500385235Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.500558158Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.50058863Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.500643745Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.50071318Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.500728851Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.500819258Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.50084929Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.500950948Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.5009855Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501002111Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501051775Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501099469Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501149832Z namespaces/kserve-ci-e2e-test/pods/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501160023Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501172864Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501351978Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/agent/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501361638Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/agent/agent/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501370169Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/agent/agent/logs/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.50138921Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/agent/agent/logs/current.log [must-gather-f7pnh] OUT 2026-09-17T23:37:40.50151479Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/agent/agent/logs/previous.insecure.log [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501581515Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/agent/agent/logs/previous.log [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501612787Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/kserve-container/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501631528Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/kserve-container/kserve-container/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501636929Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/kserve-container/kserve-container/logs/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501666511Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/kserve-container/kserve-container/logs/current.log [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501813842Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501878747Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/kserve-container/kserve-container/logs/previous.log [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501936231Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/kube-rbac-proxy/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501956713Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/kube-rbac-proxy/kube-rbac-proxy/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501964313Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.501980425Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather-f7pnh] OUT 2026-09-17T23:37:40.502066381Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather-f7pnh] OUT 2026-09-17T23:37:40.502131286Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather-f7pnh] OUT 2026-09-17T23:37:40.502161578Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/storage-initializer/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.502167629Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/storage-initializer/storage-initializer/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.502172139Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/storage-initializer/storage-initializer/logs/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.502215532Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/storage-initializer/storage-initializer/logs/current.log [must-gather-f7pnh] OUT 2026-09-17T23:37:40.502308599Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-f7pnh] OUT 2026-09-17T23:37:40.502379265Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-856f4c4b54-grmbw/storage-initializer/storage-initializer/logs/previous.log [must-gather-f7pnh] OUT 2026-09-17T23:37:40.502425458Z namespaces/kserve-ci-e2e-test/policy/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.502439479Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.502501194Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather-f7pnh] OUT 2026-09-17T23:37:40.502535986Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather-f7pnh] OUT 2026-09-17T23:37:40.509769409Z [must-gather-f7pnh] OUT 2026-09-17T23:37:40.50978515Z sent 1,072 bytes received 98,459 bytes 199,062.00 bytes/sec [must-gather-f7pnh] OUT 2026-09-17T23:37:40.509793631Z total size is 1,443,039 speedup is 14.50 [must-gather ] OUT 2026-09-17T23:37:40.622498509Z namespace/openshift-must-gather-7gr5m deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 96d1dffb-5e6a-41e3-a767-7aee8396a267 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.34" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing