[must-gather ] OUT 2026-09-17T18:23:38.193712624Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 43597b1a-a0cd-4bd0-8c77-7c568567fe83 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.34" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-09-17T18:23:38.237298798Z namespace/openshift-must-gather-t9cqr created [must-gather ] OUT 2026-09-17T18:23:38.246901791Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-2jhjb created [must-gather ] OUT 2026-09-17T18:23:38.266528119Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-bxzmf] OUT 2026-09-17T18:24:07.615390689Z waiting for gather to complete [must-gather-bxzmf] OUT 2026-09-17T18:24:07.617965593Z downloading gather output [must-gather-bxzmf] OUT 2026-09-17T18:24:07.922285261Z receiving incremental file list [must-gather-bxzmf] OUT 2026-09-17T18:24:07.941197308Z ./ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.941910609Z aggregated-discovery-api.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.942035892Z aggregated-discovery-apis.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.942570977Z event-filter.html [must-gather-bxzmf] OUT 2026-09-17T18:24:07.943594967Z timestamp [must-gather-bxzmf] OUT 2026-09-17T18:24:07.94371227Z version [must-gather-bxzmf] OUT 2026-09-17T18:24:07.95129713Z cluster-scoped-resources/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.951317101Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.951325971Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.951340031Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.951437314Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.951454094Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.951495706Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.951582928Z namespaces/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.951595718Z namespaces/kserve-ci-e2e-test/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.95164467Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.951696592Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.951772964Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.951840456Z namespaces/kserve-ci-e2e-test/apps/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.951886737Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.951960429Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.952048482Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.952137634Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.952180705Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.952207836Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.952268838Z namespaces/kserve-ci-e2e-test/batch/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.952320819Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.952401972Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.952455363Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.952472944Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.952570106Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.952729781Z namespaces/kserve-ci-e2e-test/core/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.952756452Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.952790593Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.952883606Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.955015277Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.955076479Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.955246234Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.955388008Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.955566023Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.955620935Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.955638825Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.955702517Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.955770579Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.955817831Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.955875232Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.955946124Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.956001646Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.956026326Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.956084288Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.95613362Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.956180641Z namespaces/kserve-ci-e2e-test/pods/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.956190321Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.956226512Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.956419188Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/agent/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.956428068Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/agent/agent/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.956432338Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/agent/agent/logs/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.956446449Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/agent/agent/logs/current.log [must-gather-bxzmf] OUT 2026-09-17T18:24:07.956561632Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/agent/agent/logs/previous.insecure.log [must-gather-bxzmf] OUT 2026-09-17T18:24:07.956645864Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/agent/agent/logs/previous.log [must-gather-bxzmf] OUT 2026-09-17T18:24:07.956674465Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/kserve-container/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.956689606Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/kserve-container/kserve-container/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.956694116Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/kserve-container/kserve-container/logs/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.956732337Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/kserve-container/kserve-container/logs/current.log [must-gather-bxzmf] OUT 2026-09-17T18:24:07.956902062Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-bxzmf] OUT 2026-09-17T18:24:07.956968024Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/kserve-container/kserve-container/logs/previous.log [must-gather-bxzmf] OUT 2026-09-17T18:24:07.956998715Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/kube-rbac-proxy/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.957007815Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/kube-rbac-proxy/kube-rbac-proxy/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.957011745Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.957046776Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather-bxzmf] OUT 2026-09-17T18:24:07.957158049Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather-bxzmf] OUT 2026-09-17T18:24:07.957226891Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather-bxzmf] OUT 2026-09-17T18:24:07.957267432Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/storage-initializer/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.957274982Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/storage-initializer/storage-initializer/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.957279013Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/storage-initializer/storage-initializer/logs/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.957319974Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/storage-initializer/storage-initializer/logs/current.log [must-gather-bxzmf] OUT 2026-09-17T18:24:07.957416087Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-bxzmf] OUT 2026-09-17T18:24:07.957496289Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-6d54d95b97-vmkp7/storage-initializer/storage-initializer/logs/previous.log [must-gather-bxzmf] OUT 2026-09-17T18:24:07.95751626Z namespaces/kserve-ci-e2e-test/policy/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.957565941Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.957618892Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather-bxzmf] OUT 2026-09-17T18:24:07.957646543Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather-bxzmf] OUT 2026-09-17T18:24:07.97518265Z [must-gather-bxzmf] OUT 2026-09-17T18:24:07.975200761Z sent 1,072 bytes received 99,560 bytes 201,264.00 bytes/sec [must-gather-bxzmf] OUT 2026-09-17T18:24:07.975206161Z total size is 1,446,746 speedup is 14.38 [must-gather ] OUT 2026-09-17T18:24:08.089492515Z namespace/openshift-must-gather-t9cqr deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 43597b1a-a0cd-4bd0-8c77-7c568567fe83 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.34" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing