[must-gather ] OUT 2026-09-11T16:43:22.610204638Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 6a936995-5a8c-44cb-a277-b555e07603a6 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.33" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-09-11T16:43:22.655443514Z namespace/openshift-must-gather-k8pb5 created [must-gather ] OUT 2026-09-11T16:43:22.662524463Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-ngzwv created [must-gather ] OUT 2026-09-11T16:43:22.689076589Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-rdt6n] OUT 2026-09-11T16:43:53.296933456Z waiting for gather to complete [must-gather-rdt6n] OUT 2026-09-11T16:43:53.304862495Z downloading gather output [must-gather-rdt6n] OUT 2026-09-11T16:43:53.589230423Z receiving incremental file list [must-gather-rdt6n] OUT 2026-09-11T16:43:53.606210346Z ./ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.606281507Z aggregated-discovery-api.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.609229044Z aggregated-discovery-apis.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.610223746Z event-filter.html [must-gather-rdt6n] OUT 2026-09-11T16:43:53.611375122Z timestamp [must-gather-rdt6n] OUT 2026-09-11T16:43:53.611515955Z version [must-gather-rdt6n] OUT 2026-09-11T16:43:53.611590907Z cluster-scoped-resources/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.611600197Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.611605787Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.611653468Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.61172891Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.61174146Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.611772761Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.611814432Z namespaces/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.611823412Z namespaces/kserve-ci-e2e-test/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.611887444Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.611940565Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.611999546Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.612054547Z namespaces/kserve-ci-e2e-test/apps/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.612085728Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.61217004Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.612244452Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.612324313Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.612360104Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.612408825Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.612448986Z namespaces/kserve-ci-e2e-test/batch/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.612492527Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.612569919Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.61261399Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.612656731Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.612735053Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.612781764Z namespaces/kserve-ci-e2e-test/core/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.612811124Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.612935747Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.6130364Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.615454524Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.615534626Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.6157345Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.615853823Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.616069078Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.616109489Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.61615607Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.616190471Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.616226431Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.616279162Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.616308143Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.616394805Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.616446126Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.616476417Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.616527278Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.616578879Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.61661202Z namespaces/kserve-ci-e2e-test/pods/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.61661848Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.616664101Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.616860076Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/agent/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.616872266Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/agent/agent/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.616876086Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/agent/agent/logs/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.616905107Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/agent/agent/logs/current.log [must-gather-rdt6n] OUT 2026-09-11T16:43:53.61703877Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/agent/agent/logs/previous.insecure.log [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617111831Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/agent/agent/logs/previous.log [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617151042Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/kserve-container/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617167763Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/kserve-container/kserve-container/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617174043Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/kserve-container/kserve-container/logs/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617185023Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/kserve-container/kserve-container/logs/current.log [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617301596Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617368817Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/kserve-container/kserve-container/logs/previous.log [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617389788Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/kube-rbac-proxy/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617396228Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/kube-rbac-proxy/kube-rbac-proxy/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617402638Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617437589Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617571372Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617640513Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617657384Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/storage-initializer/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617664864Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/storage-initializer/storage-initializer/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617671164Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/storage-initializer/storage-initializer/logs/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617717455Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/storage-initializer/storage-initializer/logs/current.log [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617799947Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617868758Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-778ff5f68f-jhcpf/storage-initializer/storage-initializer/logs/previous.log [must-gather-rdt6n] OUT 2026-09-11T16:43:53.617904479Z namespaces/kserve-ci-e2e-test/policy/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.618010392Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.618021542Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather-rdt6n] OUT 2026-09-11T16:43:53.618028092Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather-rdt6n] OUT 2026-09-11T16:43:53.624548799Z [must-gather-rdt6n] OUT 2026-09-11T16:43:53.624562749Z sent 1,072 bytes received 99,934 bytes 202,012.00 bytes/sec [must-gather-rdt6n] OUT 2026-09-11T16:43:53.624567539Z total size is 1,460,011 speedup is 14.45 [must-gather ] OUT 2026-09-11T16:43:53.747758985Z namespace/openshift-must-gather-k8pb5 deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 6a936995-5a8c-44cb-a277-b555e07603a6 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.33" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing