[must-gather ] OUT 2026-09-17T19:09:16.443509738Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 6d16e471-4c72-4cf7-b190-a406dd66b8e6 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.34" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-09-17T19:09:16.501814944Z namespace/openshift-must-gather-7srn5 created [must-gather ] OUT 2026-09-17T19:09:16.518278533Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-f9d9b created [must-gather ] OUT 2026-09-17T19:09:16.574775011Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-d5hd5] OUT 2026-09-17T19:09:47.417812598Z waiting for gather to complete [must-gather-d5hd5] OUT 2026-09-17T19:09:47.421599709Z downloading gather output [must-gather-d5hd5] OUT 2026-09-17T19:09:47.72983754Z receiving incremental file list [must-gather-d5hd5] OUT 2026-09-17T19:09:47.751425524Z ./ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.751564927Z aggregated-discovery-api.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.751858294Z aggregated-discovery-apis.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.752783793Z event-filter.html [must-gather-d5hd5] OUT 2026-09-17T19:09:47.753929338Z timestamp [must-gather-d5hd5] OUT 2026-09-17T19:09:47.754049201Z version [must-gather-d5hd5] OUT 2026-09-17T19:09:47.758263331Z cluster-scoped-resources/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.758312062Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.758325053Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.758383424Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.758427965Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.758439795Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.758462515Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.758521887Z namespaces/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.758547687Z namespaces/kserve-ci-e2e-test/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.758566878Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.75868238Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.758714651Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.758742321Z namespaces/kserve-ci-e2e-test/apps/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.758757472Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.758870364Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.758904645Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.759019238Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.759050728Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.759064988Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.759185261Z namespaces/kserve-ci-e2e-test/batch/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.759223622Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.759297393Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.759335604Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.759351205Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.759453787Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.759479317Z namespaces/kserve-ci-e2e-test/core/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.759535918Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.759645631Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.759726763Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.762113814Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.762200266Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.76238638Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.762503822Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.762688256Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.762741537Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.762774358Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.762828029Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.76287251Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.762916611Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.762964772Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.763038494Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.763075114Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.763135766Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.763196527Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.763217198Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.763277469Z namespaces/kserve-ci-e2e-test/pods/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.763286509Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.76333055Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.763489783Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/agent/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.763499784Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/agent/agent/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.763504724Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/agent/agent/logs/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.763525984Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/agent/agent/logs/current.log [must-gather-d5hd5] OUT 2026-09-17T19:09:47.763665517Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/agent/agent/logs/previous.insecure.log [must-gather-d5hd5] OUT 2026-09-17T19:09:47.763732319Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/agent/agent/logs/previous.log [must-gather-d5hd5] OUT 2026-09-17T19:09:47.763761819Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/kserve-container/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.76377624Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/kserve-container/kserve-container/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.76378103Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/kserve-container/kserve-container/logs/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.76381281Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/kserve-container/kserve-container/logs/current.log [must-gather-d5hd5] OUT 2026-09-17T19:09:47.763923353Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-d5hd5] OUT 2026-09-17T19:09:47.763994094Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/kserve-container/kserve-container/logs/previous.log [must-gather-d5hd5] OUT 2026-09-17T19:09:47.764033285Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/kube-rbac-proxy/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.764042215Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/kube-rbac-proxy/kube-rbac-proxy/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.764048426Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.764059366Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather-d5hd5] OUT 2026-09-17T19:09:47.764211889Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather-d5hd5] OUT 2026-09-17T19:09:47.764285031Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather-d5hd5] OUT 2026-09-17T19:09:47.764299471Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/storage-initializer/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.764308971Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/storage-initializer/storage-initializer/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.764313071Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/storage-initializer/storage-initializer/logs/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.764356472Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/storage-initializer/storage-initializer/logs/current.log [must-gather-d5hd5] OUT 2026-09-17T19:09:47.764451174Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-d5hd5] OUT 2026-09-17T19:09:47.764533226Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-77c98dccfb-g4bvr/storage-initializer/storage-initializer/logs/previous.log [must-gather-d5hd5] OUT 2026-09-17T19:09:47.764567957Z namespaces/kserve-ci-e2e-test/policy/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.764611838Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.764673269Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather-d5hd5] OUT 2026-09-17T19:09:47.764702789Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather-d5hd5] OUT 2026-09-17T19:09:47.780737394Z [must-gather-d5hd5] OUT 2026-09-17T19:09:47.780783505Z sent 1,072 bytes received 98,757 bytes 199,658.00 bytes/sec [must-gather-d5hd5] OUT 2026-09-17T19:09:47.780799005Z total size is 1,444,233 speedup is 14.47 [must-gather ] OUT 2026-09-17T19:09:47.891062854Z namespace/openshift-must-gather-7srn5 deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 6d16e471-4c72-4cf7-b190-a406dd66b8e6 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.34" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing