[must-gather ] OUT 2026-08-01T00:12:07.115736448Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: ab5e10e0-2785-49e5-9b88-5b88afbcb6dd ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.27" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-08-01T00:12:07.160840155Z namespace/openshift-must-gather-brn9x created [must-gather ] OUT 2026-08-01T00:12:07.168878545Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-f5d56 created [must-gather ] OUT 2026-08-01T00:12:07.191431594Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-svz8j] OUT 2026-08-01T00:12:37.916715149Z waiting for gather to complete [must-gather-svz8j] OUT 2026-08-01T00:12:37.919912274Z downloading gather output [must-gather-svz8j] OUT 2026-08-01T00:12:38.190584525Z receiving incremental file list [must-gather-svz8j] OUT 2026-08-01T00:12:38.202483454Z ./ [must-gather-svz8j] OUT 2026-08-01T00:12:38.2025758Z aggregated-discovery-api.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.202907339Z aggregated-discovery-apis.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.204043845Z event-filter.html [must-gather-svz8j] OUT 2026-08-01T00:12:38.205104496Z timestamp [must-gather-svz8j] OUT 2026-08-01T00:12:38.205236864Z version [must-gather-svz8j] OUT 2026-08-01T00:12:38.205756814Z cluster-scoped-resources/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.205775295Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.205781765Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.205806457Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.205880421Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.205890732Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.205923983Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.205995528Z namespaces/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.206009408Z namespaces/kserve-ci-e2e-test/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.206019359Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.206102624Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.206130675Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.206191059Z namespaces/kserve-ci-e2e-test/apps/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.206241702Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.206313666Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.206395161Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.206472025Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.206518998Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.20655185Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.206614043Z namespaces/kserve-ci-e2e-test/batch/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.206676347Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.206758512Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.206798184Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.206841387Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.206921351Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.206965094Z namespaces/kserve-ci-e2e-test/core/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.206994356Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.207122403Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.207197757Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.209331101Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.209407935Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.209579385Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.209707013Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.209917075Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.209948897Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.21000307Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.210046752Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.210079904Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.210127297Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.210167689Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.210247534Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.210279776Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.210317178Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.210371541Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.210399063Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.210450406Z namespaces/kserve-ci-e2e-test/pods/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.210458146Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.210499679Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.210680079Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/agent/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.21069085Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/agent/agent/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.21069596Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/agent/agent/logs/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.210722032Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/agent/agent/logs/current.log [must-gather-svz8j] OUT 2026-08-01T00:12:38.210832158Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/agent/agent/logs/previous.insecure.log [must-gather-svz8j] OUT 2026-08-01T00:12:38.210899492Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/agent/agent/logs/previous.log [must-gather-svz8j] OUT 2026-08-01T00:12:38.210936294Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/kserve-container/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.210949105Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/kserve-container/kserve-container/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.210953475Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/kserve-container/kserve-container/logs/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.210971986Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/kserve-container/kserve-container/logs/current.log [must-gather-svz8j] OUT 2026-08-01T00:12:38.211084113Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-svz8j] OUT 2026-08-01T00:12:38.211148976Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/kserve-container/kserve-container/logs/previous.log [must-gather-svz8j] OUT 2026-08-01T00:12:38.211187599Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/kube-rbac-proxy/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.211194529Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/kube-rbac-proxy/kube-rbac-proxy/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.211198409Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.211240782Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather-svz8j] OUT 2026-08-01T00:12:38.211352728Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather-svz8j] OUT 2026-08-01T00:12:38.211412741Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather-svz8j] OUT 2026-08-01T00:12:38.211459194Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/storage-initializer/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.211467865Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/storage-initializer/storage-initializer/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.211472435Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/storage-initializer/storage-initializer/logs/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.211482905Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/storage-initializer/storage-initializer/logs/current.log [must-gather-svz8j] OUT 2026-08-01T00:12:38.211606673Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-svz8j] OUT 2026-08-01T00:12:38.211678527Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-fc5d477ff-k7bnh/storage-initializer/storage-initializer/logs/previous.log [must-gather-svz8j] OUT 2026-08-01T00:12:38.211722889Z namespaces/kserve-ci-e2e-test/policy/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.211745721Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.211786963Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather-svz8j] OUT 2026-08-01T00:12:38.211830216Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather-svz8j] OUT 2026-08-01T00:12:38.218400436Z [must-gather-svz8j] OUT 2026-08-01T00:12:38.218419087Z sent 1,068 bytes received 93,295 bytes 62,908.67 bytes/sec [must-gather-svz8j] OUT 2026-08-01T00:12:38.218426518Z total size is 1,304,307 speedup is 13.82 [must-gather ] OUT 2026-08-01T00:12:38.329360574Z namespace/openshift-must-gather-brn9x deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: ab5e10e0-2785-49e5-9b88-5b88afbcb6dd ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.27" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing