[must-gather ] OUT 2026-08-04T18:26:37.494266049Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 5602e902-e57c-4b74-9e00-181ce1820cf1 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.27" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-08-04T18:26:37.539784673Z namespace/openshift-must-gather-wvz5s created [must-gather ] OUT 2026-08-04T18:26:37.551949248Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-bvs64 created [must-gather ] OUT 2026-08-04T18:26:37.584773392Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-5x5bt] OUT 2026-08-04T18:27:07.566316343Z waiting for gather to complete [must-gather-5x5bt] OUT 2026-08-04T18:27:07.569808059Z downloading gather output [must-gather-5x5bt] OUT 2026-08-04T18:27:07.849377444Z receiving incremental file list [must-gather-5x5bt] OUT 2026-08-04T18:27:07.863866012Z ./ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.863940304Z aggregated-discovery-api.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.864229502Z aggregated-discovery-apis.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.864990883Z event-filter.html [must-gather-5x5bt] OUT 2026-08-04T18:27:07.866042642Z timestamp [must-gather-5x5bt] OUT 2026-08-04T18:27:07.866172056Z version [must-gather-5x5bt] OUT 2026-08-04T18:27:07.866601037Z cluster-scoped-resources/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.866633418Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.866644069Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.8666806Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.86670178Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.866710771Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.866727251Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.866808363Z namespaces/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.866829434Z namespaces/kserve-ci-e2e-test/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.866837284Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.866917986Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.866961627Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.867022079Z namespaces/kserve-ci-e2e-test/apps/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.867095371Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.867223085Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.867326657Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.86742136Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.867509473Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.867558454Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.867619296Z namespaces/kserve-ci-e2e-test/batch/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.867663097Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.867765549Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.867812481Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.867852672Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.867930864Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.867976805Z namespaces/kserve-ci-e2e-test/core/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.868016527Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.86813641Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.868214502Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.870417973Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.870500805Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.87068498Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.870801603Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.870995548Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.87104338Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.87107472Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.871220904Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.871263756Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.871310987Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.871352178Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.871454391Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.871503752Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.871540253Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.871589265Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.871636206Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.871684447Z namespaces/kserve-ci-e2e-test/pods/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.871694028Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.871719418Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.871886453Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/agent/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.871895153Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/agent/agent/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.871900323Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/agent/agent/logs/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.871932164Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/agent/agent/logs/current.log [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872035907Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/agent/agent/logs/previous.insecure.log [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872103489Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/agent/agent/logs/previous.log [must-gather-5x5bt] OUT 2026-08-04T18:27:07.87214599Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/kserve-container/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.87216811Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/kserve-container/kserve-container/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872173211Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/kserve-container/kserve-container/logs/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872186741Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/kserve-container/kserve-container/logs/current.log [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872298894Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872368096Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/kserve-container/kserve-container/logs/previous.log [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872414707Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/kube-rbac-proxy/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872425328Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/kube-rbac-proxy/kube-rbac-proxy/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872429548Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872462499Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872581242Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872649604Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872688385Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/storage-initializer/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872695125Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/storage-initializer/storage-initializer/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872699325Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/storage-initializer/storage-initializer/logs/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872720936Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/storage-initializer/storage-initializer/logs/current.log [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872823659Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872893761Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-94ff54bf4-vzx99/storage-initializer/storage-initializer/logs/previous.log [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872907801Z namespaces/kserve-ci-e2e-test/policy/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.872960302Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.873015994Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather-5x5bt] OUT 2026-08-04T18:27:07.873031354Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather-5x5bt] OUT 2026-08-04T18:27:07.880485999Z [must-gather-5x5bt] OUT 2026-08-04T18:27:07.88050335Z sent 1,072 bytes received 94,070 bytes 190,284.00 bytes/sec [must-gather-5x5bt] OUT 2026-08-04T18:27:07.88050865Z total size is 1,330,754 speedup is 13.99 [must-gather ] OUT 2026-08-04T18:27:07.985342752Z namespace/openshift-must-gather-wvz5s deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 5602e902-e57c-4b74-9e00-181ce1820cf1 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.27" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing