[must-gather ] OUT 2026-09-17T21:18:37.666875231Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 109e5c11-6659-4137-b3eb-c0832631cfc4 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.34" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-09-17T21:18:37.716338199Z namespace/openshift-must-gather-qqcrd created [must-gather ] OUT 2026-09-17T21:18:37.726942587Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-pwlgb created [must-gather ] OUT 2026-09-17T21:18:37.759977881Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-jz9wr] OUT 2026-09-17T21:19:07.957813388Z waiting for gather to complete [must-gather-jz9wr] OUT 2026-09-17T21:19:07.961512272Z downloading gather output [must-gather-jz9wr] OUT 2026-09-17T21:19:08.230593687Z receiving incremental file list [must-gather-jz9wr] OUT 2026-09-17T21:19:08.243024983Z ./ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.243110775Z aggregated-discovery-api.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.243409593Z aggregated-discovery-apis.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.24411009Z event-filter.html [must-gather-jz9wr] OUT 2026-09-17T21:19:08.2452573Z timestamp [must-gather-jz9wr] OUT 2026-09-17T21:19:08.245413264Z version [must-gather-jz9wr] OUT 2026-09-17T21:19:08.245494386Z cluster-scoped-resources/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.245506996Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.245515096Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.245554247Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.245632469Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.245642069Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.24566749Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.245735762Z namespaces/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.245744372Z namespaces/kserve-ci-e2e-test/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.245783893Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.245839974Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.245894156Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.245939427Z namespaces/kserve-ci-e2e-test/apps/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.245969258Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.24607307Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.246165403Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.246242114Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.246288916Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.246358037Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.246407659Z namespaces/kserve-ci-e2e-test/batch/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.24646765Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.246557273Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.246610884Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.246641445Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.246729207Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.246774258Z namespaces/kserve-ci-e2e-test/core/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.246818589Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.246939202Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.247017814Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.249560549Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.249688412Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.249872797Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.24999682Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.250187715Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.250238946Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.250270327Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.250326438Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.250362759Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.25040992Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.250478752Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.250569364Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.250606565Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.250638606Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.250702308Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.250729339Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.25078116Z namespaces/kserve-ci-e2e-test/pods/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.25078832Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.250831191Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/isvc-logger-raw-cipn-predictor-797ff577-vsv2w.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.251018396Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/agent/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.251025196Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/agent/agent/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.251029466Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/agent/agent/logs/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.251062147Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/agent/agent/logs/current.log [must-gather-jz9wr] OUT 2026-09-17T21:19:08.25117028Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/agent/agent/logs/previous.insecure.log [must-gather-jz9wr] OUT 2026-09-17T21:19:08.251236272Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/agent/agent/logs/previous.log [must-gather-jz9wr] OUT 2026-09-17T21:19:08.251262202Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/kserve-container/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.251275102Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/kserve-container/kserve-container/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.251283333Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/kserve-container/kserve-container/logs/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.251316003Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/kserve-container/kserve-container/logs/current.log [must-gather-jz9wr] OUT 2026-09-17T21:19:08.251437666Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-jz9wr] OUT 2026-09-17T21:19:08.251516719Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/kserve-container/kserve-container/logs/previous.log [must-gather-jz9wr] OUT 2026-09-17T21:19:08.251553529Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/kube-rbac-proxy/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.2515633Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/kube-rbac-proxy/kube-rbac-proxy/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.25156851Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.251601641Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather-jz9wr] OUT 2026-09-17T21:19:08.251720364Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather-jz9wr] OUT 2026-09-17T21:19:08.251789035Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather-jz9wr] OUT 2026-09-17T21:19:08.251830356Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/storage-initializer/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.251837777Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/storage-initializer/storage-initializer/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.251841917Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/storage-initializer/storage-initializer/logs/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.251870708Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/storage-initializer/storage-initializer/logs/current.log [must-gather-jz9wr] OUT 2026-09-17T21:19:08.25196396Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-jz9wr] OUT 2026-09-17T21:19:08.252044482Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-797ff577-vsv2w/storage-initializer/storage-initializer/logs/previous.log [must-gather-jz9wr] OUT 2026-09-17T21:19:08.252083133Z namespaces/kserve-ci-e2e-test/policy/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.252114624Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.252169665Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather-jz9wr] OUT 2026-09-17T21:19:08.252200586Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather-jz9wr] OUT 2026-09-17T21:19:08.263632777Z [must-gather-jz9wr] OUT 2026-09-17T21:19:08.263663118Z sent 1,072 bytes received 100,464 bytes 67,690.67 bytes/sec [must-gather-jz9wr] OUT 2026-09-17T21:19:08.263673028Z total size is 1,463,740 speedup is 14.42 [must-gather ] OUT 2026-09-17T21:19:08.379219077Z namespace/openshift-must-gather-qqcrd deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 109e5c11-6659-4137-b3eb-c0832631cfc4 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.34" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing