[must-gather ] OUT 2026-09-18T20:46:30.968869987Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 6f8011b1-5641-47a1-a317-231a67816824 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.34" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-09-18T20:46:31.011406016Z namespace/openshift-must-gather-4qczb created [must-gather ] OUT 2026-09-18T20:46:31.019195621Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-mckbh created [must-gather ] OUT 2026-09-18T20:46:31.044631315Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-fh7b9] OUT 2026-09-18T20:47:00.7114715Z waiting for gather to complete [must-gather-fh7b9] OUT 2026-09-18T20:47:00.714346224Z downloading gather output [must-gather-fh7b9] OUT 2026-09-18T20:47:00.970932566Z receiving incremental file list [must-gather-fh7b9] OUT 2026-09-18T20:47:00.981660419Z ./ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.981799983Z aggregated-discovery-api.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.982410551Z aggregated-discovery-apis.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.983531223Z event-filter.html [must-gather-fh7b9] OUT 2026-09-18T20:47:00.98480249Z timestamp [must-gather-fh7b9] OUT 2026-09-18T20:47:00.984974835Z version [must-gather-fh7b9] OUT 2026-09-18T20:47:00.985344226Z cluster-scoped-resources/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.985357166Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.985362396Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.985399077Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.9854838Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.98549185Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.985533441Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.985608404Z namespaces/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.985615784Z namespaces/kserve-ci-e2e-test/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.985667525Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.985773548Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.985818459Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.985891802Z namespaces/kserve-ci-e2e-test/apps/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.985938123Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.986043596Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.986153929Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.986250182Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.986310604Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.986370796Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.986440008Z namespaces/kserve-ci-e2e-test/batch/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.986486889Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.986612083Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.986658914Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.986723176Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.98686862Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.986919942Z namespaces/kserve-ci-e2e-test/core/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.986964763Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.987118357Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.98719805Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.989892078Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.989981881Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.990191837Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.990336271Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.990566438Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.990621539Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.990684341Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.990762733Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.990835876Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.990879787Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.990935788Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.991021601Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.991082143Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.991132484Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.991191856Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.991249388Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.991311869Z namespaces/kserve-ci-e2e-test/pods/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.99132053Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.991372851Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.991552716Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/agent/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.991559857Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/agent/agent/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.991563717Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/agent/agent/logs/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.991614968Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/agent/agent/logs/current.log [must-gather-fh7b9] OUT 2026-09-18T20:47:00.991785773Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/agent/agent/logs/previous.insecure.log [must-gather-fh7b9] OUT 2026-09-18T20:47:00.991875706Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/agent/agent/logs/previous.log [must-gather-fh7b9] OUT 2026-09-18T20:47:00.991923617Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/kserve-container/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.991939508Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/kserve-container/kserve-container/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.991943808Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/kserve-container/kserve-container/logs/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.991980619Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/kserve-container/kserve-container/logs/current.log [must-gather-fh7b9] OUT 2026-09-18T20:47:00.992117013Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-fh7b9] OUT 2026-09-18T20:47:00.992204115Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/kserve-container/kserve-container/logs/previous.log [must-gather-fh7b9] OUT 2026-09-18T20:47:00.992253967Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/kube-rbac-proxy/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.992261087Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/kube-rbac-proxy/kube-rbac-proxy/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.992265137Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.992331379Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather-fh7b9] OUT 2026-09-18T20:47:00.992488684Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather-fh7b9] OUT 2026-09-18T20:47:00.992585036Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather-fh7b9] OUT 2026-09-18T20:47:00.992619477Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/storage-initializer/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.992630458Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/storage-initializer/storage-initializer/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.992641358Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/storage-initializer/storage-initializer/logs/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.99270696Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/storage-initializer/storage-initializer/logs/current.log [must-gather-fh7b9] OUT 2026-09-18T20:47:00.992870395Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-fh7b9] OUT 2026-09-18T20:47:00.992959627Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-787489bd95-h5cf7/storage-initializer/storage-initializer/logs/previous.log [must-gather-fh7b9] OUT 2026-09-18T20:47:00.992992848Z namespaces/kserve-ci-e2e-test/policy/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.99307089Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.993119552Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather-fh7b9] OUT 2026-09-18T20:47:00.993173393Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather-fh7b9] OUT 2026-09-18T20:47:00.998347284Z [must-gather-fh7b9] OUT 2026-09-18T20:47:00.998369865Z sent 1,072 bytes received 98,821 bytes 199,786.00 bytes/sec [must-gather-fh7b9] OUT 2026-09-18T20:47:00.998377645Z total size is 1,443,944 speedup is 14.45 [must-gather ] OUT 2026-09-18T20:47:01.111147135Z namespace/openshift-must-gather-4qczb deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 6f8011b1-5641-47a1-a317-231a67816824 ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.34" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing