[must-gather ] OUT 2026-09-16T19:14:25.168315987Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 4133f82c-7ff5-4789-a142-7b7ae269545d ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.33" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-09-16T19:14:25.213214377Z namespace/openshift-must-gather-jlscm created [must-gather ] OUT 2026-09-16T19:14:25.222517069Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-xcxpp created [must-gather ] OUT 2026-09-16T19:14:25.246652865Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-gmkvj] OUT 2026-09-16T19:14:56.807571806Z waiting for gather to complete [must-gather-gmkvj] OUT 2026-09-16T19:14:56.810589758Z downloading gather output [must-gather-gmkvj] OUT 2026-09-16T19:14:57.087434826Z receiving incremental file list [must-gather-gmkvj] OUT 2026-09-16T19:14:57.103101871Z ./ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.103223004Z aggregated-discovery-api.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.103536903Z aggregated-discovery-apis.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.104434737Z event-filter.html [must-gather-gmkvj] OUT 2026-09-16T19:14:57.105670551Z timestamp [must-gather-gmkvj] OUT 2026-09-16T19:14:57.105812085Z version [must-gather-gmkvj] OUT 2026-09-16T19:14:57.105864686Z cluster-scoped-resources/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.105875416Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.105885307Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.105926178Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.10602243Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.106032371Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.106079172Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.106159174Z namespaces/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.106173094Z namespaces/kserve-ci-e2e-test/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.106219256Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.106288618Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.106351439Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.106396081Z namespaces/kserve-ci-e2e-test/apps/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.106453862Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.106548794Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.106642637Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.10674863Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.106811812Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.106867863Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.106913975Z namespaces/kserve-ci-e2e-test/batch/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.106969726Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.107073229Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.10713501Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.107188122Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.107296835Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.107347846Z namespaces/kserve-ci-e2e-test/core/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.107393608Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.107528191Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.107617584Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.110193013Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.110286926Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.110381229Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.110524022Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.110744328Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.110816461Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.110866942Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.110914203Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.110952094Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.110999835Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.111057837Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.11116255Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.111209551Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.111237972Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.111293233Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.111321784Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.111376766Z namespaces/kserve-ci-e2e-test/pods/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.111383956Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.111442507Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.111625823Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/agent/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.111638483Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/agent/agent/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.111657373Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/agent/agent/logs/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.111671324Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/agent/agent/logs/current.log [must-gather-gmkvj] OUT 2026-09-16T19:14:57.111786617Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/agent/agent/logs/previous.insecure.log [must-gather-gmkvj] OUT 2026-09-16T19:14:57.111853829Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/agent/agent/logs/previous.log [must-gather-gmkvj] OUT 2026-09-16T19:14:57.111874379Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/kserve-container/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.11188877Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/kserve-container/kserve-container/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.11189333Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/kserve-container/kserve-container/logs/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.111935461Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/kserve-container/kserve-container/logs/current.log [must-gather-gmkvj] OUT 2026-09-16T19:14:57.112049814Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-gmkvj] OUT 2026-09-16T19:14:57.112123506Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/kserve-container/kserve-container/logs/previous.log [must-gather-gmkvj] OUT 2026-09-16T19:14:57.112180347Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/kube-rbac-proxy/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.112188158Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/kube-rbac-proxy/kube-rbac-proxy/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.112192398Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.112237889Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather-gmkvj] OUT 2026-09-16T19:14:57.112367383Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather-gmkvj] OUT 2026-09-16T19:14:57.112453545Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather-gmkvj] OUT 2026-09-16T19:14:57.112468665Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/storage-initializer/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.112474726Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/storage-initializer/storage-initializer/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.112478456Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/storage-initializer/storage-initializer/logs/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.112523307Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/storage-initializer/storage-initializer/logs/current.log [must-gather-gmkvj] OUT 2026-09-16T19:14:57.1126347Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-gmkvj] OUT 2026-09-16T19:14:57.112701782Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-7fd84f4ff-27rf6/storage-initializer/storage-initializer/logs/previous.log [must-gather-gmkvj] OUT 2026-09-16T19:14:57.112751623Z namespaces/kserve-ci-e2e-test/policy/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.112794254Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.112836805Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather-gmkvj] OUT 2026-09-16T19:14:57.112884417Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather-gmkvj] OUT 2026-09-16T19:14:57.121046788Z [must-gather-gmkvj] OUT 2026-09-16T19:14:57.121079099Z sent 1,072 bytes received 96,229 bytes 64,867.33 bytes/sec [must-gather-gmkvj] OUT 2026-09-16T19:14:57.121089689Z total size is 1,417,858 speedup is 14.57 [must-gather ] OUT 2026-09-16T19:14:57.23159029Z namespace/openshift-must-gather-jlscm deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 4133f82c-7ff5-4789-a142-7b7ae269545d ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.33" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing