[must-gather ] OUT 2026-09-16T13:14:23.853198043Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 3a728fc4-b123-403c-b72c-6bd0e8dd308b ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.33" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-09-16T13:14:23.898880428Z namespace/openshift-must-gather-6c97j created [must-gather ] OUT 2026-09-16T13:14:23.906613509Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-rvh95 created [must-gather ] OUT 2026-09-16T13:14:23.927085428Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-42r4r] OUT 2026-09-16T13:14:54.733469759Z waiting for gather to complete [must-gather-42r4r] OUT 2026-09-16T13:14:54.736237462Z downloading gather output [must-gather-42r4r] OUT 2026-09-16T13:14:54.99644911Z receiving incremental file list [must-gather-42r4r] OUT 2026-09-16T13:14:55.007468917Z ./ [must-gather-42r4r] OUT 2026-09-16T13:14:55.007533202Z aggregated-discovery-api.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.007827126Z aggregated-discovery-apis.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.008844968Z event-filter.html [must-gather-42r4r] OUT 2026-09-16T13:14:55.010023413Z timestamp [must-gather-42r4r] OUT 2026-09-16T13:14:55.010145132Z version [must-gather-42r4r] OUT 2026-09-16T13:14:55.011056416Z cluster-scoped-resources/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.011071407Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.011076327Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.01111512Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.011201007Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.011210558Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.011252272Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.011326927Z namespaces/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.011337168Z namespaces/kserve-ci-e2e-test/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.011375891Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.011456238Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.011518533Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.011585298Z namespaces/kserve-ci-e2e-test/apps/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.011628402Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.011710388Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.011784664Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.011863981Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.011926956Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.01198149Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.012021603Z namespaces/kserve-ci-e2e-test/batch/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.012077858Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.012157344Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.012201628Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.012239821Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.012319507Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.012364801Z namespaces/kserve-ci-e2e-test/core/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.012415025Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.012547746Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.012629792Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.015137134Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.01521617Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.015401105Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.015519055Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.015699059Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.015752243Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.015864843Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.015932928Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.0159626Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.016020125Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.016055908Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.016130714Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.016163747Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.016210891Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.016244483Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.016292447Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.01632715Z namespaces/kserve-ci-e2e-test/pods/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.01633179Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.016383694Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.016557918Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/agent/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.016570099Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/agent/agent/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.01657428Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/agent/agent/logs/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.016591771Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/agent/agent/logs/current.log [must-gather-42r4r] OUT 2026-09-16T13:14:55.016726972Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/agent/agent/logs/previous.insecure.log [must-gather-42r4r] OUT 2026-09-16T13:14:55.016791037Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/agent/agent/logs/previous.log [must-gather-42r4r] OUT 2026-09-16T13:14:55.01683027Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/kserve-container/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.016844141Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/kserve-container/kserve-container/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.016848332Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/kserve-container/kserve-container/logs/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.016899466Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/kserve-container/kserve-container/logs/current.log [must-gather-42r4r] OUT 2026-09-16T13:14:55.017002764Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-42r4r] OUT 2026-09-16T13:14:55.01707118Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/kserve-container/kserve-container/logs/previous.log [must-gather-42r4r] OUT 2026-09-16T13:14:55.017106843Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/kube-rbac-proxy/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.017113313Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/kube-rbac-proxy/kube-rbac-proxy/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.017117443Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.017150256Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather-42r4r] OUT 2026-09-16T13:14:55.017270186Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather-42r4r] OUT 2026-09-16T13:14:55.01732999Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather-42r4r] OUT 2026-09-16T13:14:55.017356763Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/storage-initializer/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.017361063Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/storage-initializer/storage-initializer/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.017366973Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/storage-initializer/storage-initializer/logs/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.017409967Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/storage-initializer/storage-initializer/logs/current.log [must-gather-42r4r] OUT 2026-09-16T13:14:55.017508475Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-42r4r] OUT 2026-09-16T13:14:55.01757643Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66/storage-initializer/storage-initializer/logs/previous.log [must-gather-42r4r] OUT 2026-09-16T13:14:55.017609593Z namespaces/kserve-ci-e2e-test/policy/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.017635225Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.0176917Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather-42r4r] OUT 2026-09-16T13:14:55.017718922Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather-42r4r] OUT 2026-09-16T13:14:55.023073523Z [must-gather-42r4r] OUT 2026-09-16T13:14:55.023093684Z sent 1,072 bytes received 99,346 bytes 66,945.33 bytes/sec [must-gather-42r4r] OUT 2026-09-16T13:14:55.023099265Z total size is 1,443,663 speedup is 14.38 [must-gather ] OUT 2026-09-16T13:14:55.142655925Z namespace/openshift-must-gather-6c97j deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 3a728fc4-b123-403c-b72c-6bd0e8dd308b ClientVersion: 4.21.10 ClusterVersion: Stable at "4.21.33" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing