task e2e-llm-inference-service has failed: "step-fail-if-needed" exited with code 1: Error [get-kubeconfig] Found kubeconfig secret: cluster-8gfw7-admin-kubeconfig [get-kubeconfig] Wrote kubeconfig to /credentials/cluster-8gfw7-kubeconfig [get-kubeconfig] Found admin password secret: cluster-8gfw7-admin-password [get-kubeconfig] Retrieved username [get-kubeconfig] Wrote password to /credentials/cluster-8gfw7-password [get-kubeconfig] API Server URL: https://a01d81a2739d8439ab55f0c0fc859d34-54a3aef725acc4ee.elb.us-east-1.amazonaws.com:6443 [get-kubeconfig] Console URL: https://console-openshift-console.apps.769bf792-e6a2-42ba-a290-147a326c6f65.prod.konfluxeaas.com [clone-repo] dependabot/uv/python/test_resources/graph/error_404_isvc/orjson-3.11.6 [clone-repo] https://github.com/opendatahub-io/kserve [clone-repo] Cloning into '/workspace/source'... [e2e-llm-inference-service] + bash [e2e-llm-inference-service] + STATUS_FILE=/test-status/deploy-and-e2e-status [e2e-llm-inference-service] + echo failed [e2e-llm-inference-service] + COMPONENT_NAME=kserve-agent-ci [e2e-llm-inference-service] ++ jq -r --arg component_name kserve-agent-ci '.[$component_name].image' [e2e-llm-inference-service] + export KSERVE_AGENT_IMAGE=quay.io/opendatahub/kserve-agent@sha256:f72c005cb705ef76fbeae81cf78e50cb05f1674ac01bdd8893cf8fb48213f3d0 [e2e-llm-inference-service] + KSERVE_AGENT_IMAGE=quay.io/opendatahub/kserve-agent@sha256:f72c005cb705ef76fbeae81cf78e50cb05f1674ac01bdd8893cf8fb48213f3d0 [e2e-llm-inference-service] + COMPONENT_NAME=kserve-controller-ci [e2e-llm-inference-service] ++ jq -r --arg component_name kserve-controller-ci '.[$component_name].image' [e2e-llm-inference-service] + export KSERVE_CONTROLLER_IMAGE=quay.io/opendatahub/kserve-controller@sha256:0c038aba898a912067485d557312a064b630ab65ea0561c19f6c96f49f2bc7e5 [e2e-llm-inference-service] + KSERVE_CONTROLLER_IMAGE=quay.io/opendatahub/kserve-controller@sha256:0c038aba898a912067485d557312a064b630ab65ea0561c19f6c96f49f2bc7e5 [e2e-llm-inference-service] + COMPONENT_NAME=kserve-router-ci [e2e-llm-inference-service] ++ jq -r --arg component_name kserve-router-ci '.[$component_name].image' [e2e-llm-inference-service] + export KSERVE_ROUTER_IMAGE=quay.io/opendatahub/kserve-router@sha256:bfb5b2782772ad46be0a5c41e64aded1dd42f09d6e2e6f1f1c3194223df058cb [e2e-llm-inference-service] + KSERVE_ROUTER_IMAGE=quay.io/opendatahub/kserve-router@sha256:bfb5b2782772ad46be0a5c41e64aded1dd42f09d6e2e6f1f1c3194223df058cb [e2e-llm-inference-service] + COMPONENT_NAME=kserve-storage-initializer-ci [e2e-llm-inference-service] ++ jq -r --arg component_name kserve-storage-initializer-ci '.[$component_name].image' [e2e-llm-inference-service] + export STORAGE_INITIALIZER_IMAGE=quay.io/opendatahub/kserve-storage-initializer@sha256:0dd2798f9cdbffc0563bd148612201df0e589ff8c26a6b19d321fd120fc5c097 [e2e-llm-inference-service] + STORAGE_INITIALIZER_IMAGE=quay.io/opendatahub/kserve-storage-initializer@sha256:0dd2798f9cdbffc0563bd148612201df0e589ff8c26a6b19d321fd120fc5c097 [e2e-llm-inference-service] + COMPONENT_NAME=odh-kserve-llmisvc-controller-ci [e2e-llm-inference-service] ++ jq -r --arg component_name odh-kserve-llmisvc-controller-ci '.[$component_name].image' [e2e-llm-inference-service] + export LLMISVC_CONTROLLER_IMAGE=quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:121abf8003a7315ab9f217afd00d9ba894cf4400988abda45a391a5551db37a4 [e2e-llm-inference-service] + LLMISVC_CONTROLLER_IMAGE=quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:121abf8003a7315ab9f217afd00d9ba894cf4400988abda45a391a5551db37a4 [e2e-llm-inference-service] + ./test/scripts/openshift-ci/run-e2e-tests.sh 'llminferenceservice and cluster_cpu' 2 llm-d [e2e-llm-inference-service] Installing on cluster [e2e-llm-inference-service] Using namespace: kserve for KServe components [e2e-llm-inference-service] SKLEARN_IMAGE=quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1450 [e2e-llm-inference-service] KSERVE_CONTROLLER_IMAGE=quay.io/opendatahub/kserve-controller@sha256:0c038aba898a912067485d557312a064b630ab65ea0561c19f6c96f49f2bc7e5 [e2e-llm-inference-service] LLMISVC_CONTROLLER_IMAGE=quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:121abf8003a7315ab9f217afd00d9ba894cf4400988abda45a391a5551db37a4 [e2e-llm-inference-service] KSERVE_AGENT_IMAGE=quay.io/opendatahub/kserve-agent@sha256:f72c005cb705ef76fbeae81cf78e50cb05f1674ac01bdd8893cf8fb48213f3d0 [e2e-llm-inference-service] KSERVE_ROUTER_IMAGE=quay.io/opendatahub/kserve-router@sha256:bfb5b2782772ad46be0a5c41e64aded1dd42f09d6e2e6f1f1c3194223df058cb [e2e-llm-inference-service] STORAGE_INITIALIZER_IMAGE=quay.io/opendatahub/kserve-storage-initializer@sha256:0dd2798f9cdbffc0563bd148612201df0e589ff8c26a6b19d321fd120fc5c097 [e2e-llm-inference-service] ERROR_404_ISVC_IMAGE=quay.io/opendatahub/error-404-isvc:odh-pr-1450 [e2e-llm-inference-service] SUCCESS_200_ISVC_IMAGE=quay.io/opendatahub/success-200-isvc:odh-pr-1450 [e2e-llm-inference-service] [INFO] Installing Kustomize v5.8.1 for linux/amd64... [e2e-llm-inference-service] [SUCCESS] Successfully installed Kustomize v5.8.1 to /workspace/source/bin/kustomize [e2e-llm-inference-service] v5.8.1 [e2e-llm-inference-service] make: Entering directory '/workspace/source' [e2e-llm-inference-service] [INFO] Installing yq v4.52.1 for linux/amd64... [e2e-llm-inference-service] [SUCCESS] Successfully installed yq v4.52.1 to /workspace/source/bin/yq [e2e-llm-inference-service] yq (https://github.com/mikefarah/yq/) version v4.52.1 [e2e-llm-inference-service] make: Leaving directory '/workspace/source' [e2e-llm-inference-service] Installing KServe Python SDK ... [e2e-llm-inference-service] [INFO] Installing uv 0.7.8 for linux/amd64... [e2e-llm-inference-service] [SUCCESS] Successfully installed uv 0.7.8 to /workspace/source/bin/uv [e2e-llm-inference-service] warning: Failed to read project metadata (No `pyproject.toml` found in current directory or any parent directory). Running `uv self version` for compatibility. This fallback will be removed in the future; pass `--preview` to force an error. [e2e-llm-inference-service] uv 0.7.8 [e2e-llm-inference-service] Creating virtual environment... [e2e-llm-inference-service] warning: virtualenv's `--clear` has no effect (uv always clears the virtual environment) [e2e-llm-inference-service] Using CPython 3.9.25 interpreter at: /usr/bin/python3 [e2e-llm-inference-service] Creating virtual environment at: .venv [e2e-llm-inference-service] /workspace/source [e2e-llm-inference-service] Using CPython 3.11.13 interpreter at: /usr/bin/python3.11 [e2e-llm-inference-service] Creating virtual environment at: .venv [e2e-llm-inference-service] Resolved 259 packages in 1ms [e2e-llm-inference-service] Building kserve @ file:///workspace/source/python/kserve [e2e-llm-inference-service] Downloading pandas (12.5MiB) [e2e-llm-inference-service] Downloading cryptography (4.3MiB) [e2e-llm-inference-service] Downloading grpcio-tools (2.5MiB) [e2e-llm-inference-service] Downloading aiohttp (1.7MiB) [e2e-llm-inference-service] Downloading kubernetes (1.9MiB) [e2e-llm-inference-service] Downloading mypy (17.2MiB) [e2e-llm-inference-service] Downloading pydantic-core (2.0MiB) [e2e-llm-inference-service] Downloading numpy (15.7MiB) [e2e-llm-inference-service] Downloading portforward (3.9MiB) [e2e-llm-inference-service] Downloading botocore (12.9MiB) [e2e-llm-inference-service] Downloading grpcio (6.4MiB) [e2e-llm-inference-service] Downloading setuptools (1.2MiB) [e2e-llm-inference-service] Downloading black (1.6MiB) [e2e-llm-inference-service] Downloading pyarrow (40.1MiB) [e2e-llm-inference-service] Downloading uvloop (3.8MiB) [e2e-llm-inference-service] Building timeout-sampler==1.0.3 [e2e-llm-inference-service] Building python-simple-logger==2.0.19 [e2e-llm-inference-service] Building pyasn==1.6.2 [e2e-llm-inference-service] Downloading aiohttp [e2e-llm-inference-service] Downloading pydantic-core [e2e-llm-inference-service] Downloading black [e2e-llm-inference-service] Downloading grpcio-tools [e2e-llm-inference-service] Downloading setuptools [e2e-llm-inference-service] Built python-simple-logger==2.0.19 [e2e-llm-inference-service] Downloading portforward [e2e-llm-inference-service] Downloading uvloop [e2e-llm-inference-service] Downloading cryptography [e2e-llm-inference-service] Downloading grpcio [e2e-llm-inference-service] Downloading kubernetes [e2e-llm-inference-service] Built timeout-sampler==1.0.3 [e2e-llm-inference-service] Downloading numpy [e2e-llm-inference-service] Downloading pandas [e2e-llm-inference-service] Built kserve @ file:///workspace/source/python/kserve [e2e-llm-inference-service] Downloading botocore [e2e-llm-inference-service] Downloading mypy [e2e-llm-inference-service] Downloading pyarrow [e2e-llm-inference-service] Built pyasn==1.6.2 [e2e-llm-inference-service] Prepared 100 packages in 1.90s [e2e-llm-inference-service] warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance. [e2e-llm-inference-service] If the cache and target directories are on different filesystems, hardlinking may not be supported. [e2e-llm-inference-service] If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning. [e2e-llm-inference-service] Installed 100 packages in 385ms [e2e-llm-inference-service] + aiohappyeyeballs==2.6.1 [e2e-llm-inference-service] + aiohttp==3.13.3 [e2e-llm-inference-service] + aiosignal==1.4.0 [e2e-llm-inference-service] + annotated-doc==0.0.4 [e2e-llm-inference-service] + annotated-types==0.7.0 [e2e-llm-inference-service] + anyio==4.9.0 [e2e-llm-inference-service] + attrs==25.3.0 [e2e-llm-inference-service] + avro==1.12.0 [e2e-llm-inference-service] + black==24.3.0 [e2e-llm-inference-service] + boto3==1.37.35 [e2e-llm-inference-service] + botocore==1.37.35 [e2e-llm-inference-service] + cachetools==5.5.2 [e2e-llm-inference-service] + certifi==2025.1.31 [e2e-llm-inference-service] + cffi==2.0.0 [e2e-llm-inference-service] + charset-normalizer==3.4.1 [e2e-llm-inference-service] + click==8.1.8 [e2e-llm-inference-service] + cloudevents==1.11.0 [e2e-llm-inference-service] + colorama==0.4.6 [e2e-llm-inference-service] + colorlog==6.10.1 [e2e-llm-inference-service] + coverage==7.8.0 [e2e-llm-inference-service] + cryptography==46.0.5 [e2e-llm-inference-service] + deprecation==2.1.0 [e2e-llm-inference-service] + durationpy==0.9 [e2e-llm-inference-service] + execnet==2.1.1 [e2e-llm-inference-service] + fastapi==0.121.3 [e2e-llm-inference-service] + frozenlist==1.5.0 [e2e-llm-inference-service] + google-auth==2.39.0 [e2e-llm-inference-service] + grpc-interceptor==0.15.4 [e2e-llm-inference-service] + grpcio==1.78.1 [e2e-llm-inference-service] + grpcio-testing==1.78.1 [e2e-llm-inference-service] + grpcio-tools==1.78.1 [e2e-llm-inference-service] + h11==0.16.0 [e2e-llm-inference-service] + httpcore==1.0.9 [e2e-llm-inference-service] + httptools==0.6.4 [e2e-llm-inference-service] + httpx==0.27.2 [e2e-llm-inference-service] + httpx-retries==0.4.5 [e2e-llm-inference-service] + idna==3.10 [e2e-llm-inference-service] + iniconfig==2.1.0 [e2e-llm-inference-service] + jinja2==3.1.6 [e2e-llm-inference-service] + jmespath==1.0.1 [e2e-llm-inference-service] + kserve==0.18.0rc1 (from file:///workspace/source/python/kserve) [e2e-llm-inference-service] + kubernetes==32.0.1 [e2e-llm-inference-service] + markupsafe==3.0.2 [e2e-llm-inference-service] + multidict==6.4.3 [e2e-llm-inference-service] + mypy==0.991 [e2e-llm-inference-service] + mypy-extensions==1.0.0 [e2e-llm-inference-service] + numpy==2.2.4 [e2e-llm-inference-service] + oauthlib==3.2.2 [e2e-llm-inference-service] + orjson==3.10.16 [e2e-llm-inference-service] + packaging==24.2 [e2e-llm-inference-service] + pandas==2.2.3 [e2e-llm-inference-service] + pathspec==0.12.1 [e2e-llm-inference-service] + platformdirs==4.3.7 [e2e-llm-inference-service] + pluggy==1.5.0 [e2e-llm-inference-service] + portforward==0.7.1 [e2e-llm-inference-service] + prometheus-client==0.21.1 [e2e-llm-inference-service] + propcache==0.3.1 [e2e-llm-inference-service] + protobuf==6.33.5 [e2e-llm-inference-service] + psutil==5.9.8 [e2e-llm-inference-service] + pyarrow==19.0.1 [e2e-llm-inference-service] + pyasn==1.6.2 [e2e-llm-inference-service] + pyasn1==0.6.1 [e2e-llm-inference-service] + pyasn1-modules==0.4.2 [e2e-llm-inference-service] + pycparser==2.22 [e2e-llm-inference-service] + pydantic==2.12.4 [e2e-llm-inference-service] + pydantic-core==2.41.5 [e2e-llm-inference-service] + pyjwt==2.12.1 [e2e-llm-inference-service] + pytest==7.4.4 [e2e-llm-inference-service] + pytest-asyncio==0.23.8 [e2e-llm-inference-service] + pytest-cov==5.0.0 [e2e-llm-inference-service] + pytest-httpx==0.30.0 [e2e-llm-inference-service] + pytest-xdist==3.6.1 [e2e-llm-inference-service] + python-dateutil==2.9.0.post0 [e2e-llm-inference-service] + python-dotenv==1.1.0 [e2e-llm-inference-service] + python-multipart==0.0.22 [e2e-llm-inference-service] + python-simple-logger==2.0.19 [e2e-llm-inference-service] + pytz==2025.2 [e2e-llm-inference-service] + pyyaml==6.0.2 [e2e-llm-inference-service] + requests==2.32.3 [e2e-llm-inference-service] + requests-oauthlib==2.0.0 [e2e-llm-inference-service] + rsa==4.9.1 [e2e-llm-inference-service] + s3transfer==0.11.4 [e2e-llm-inference-service] + setuptools==78.1.0 [e2e-llm-inference-service] + six==1.17.0 [e2e-llm-inference-service] + sniffio==1.3.1 [e2e-llm-inference-service] + starlette==0.49.1 [e2e-llm-inference-service] + tabulate==0.9.0 [e2e-llm-inference-service] + timeout-sampler==1.0.3 [e2e-llm-inference-service] + timing-asgi==0.3.1 [e2e-llm-inference-service] + tomlkit==0.13.2 [e2e-llm-inference-service] + typing-extensions==4.15.0 [e2e-llm-inference-service] + typing-inspection==0.4.2 [e2e-llm-inference-service] + tzdata==2025.2 [e2e-llm-inference-service] + urllib3==2.6.2 [e2e-llm-inference-service] + uvicorn==0.34.1 [e2e-llm-inference-service] + uvloop==0.21.0 [e2e-llm-inference-service] + watchfiles==1.0.5 [e2e-llm-inference-service] + websocket-client==1.8.0 [e2e-llm-inference-service] + websockets==15.0.1 [e2e-llm-inference-service] + yarl==1.20.0 [e2e-llm-inference-service] Audited 1 package in 46ms [e2e-llm-inference-service] /workspace/source [e2e-llm-inference-service] Creating namespace openshift-keda... [e2e-llm-inference-service] namespace/openshift-keda created [e2e-llm-inference-service] Namespace openshift-keda created/ensured. [e2e-llm-inference-service] --- [e2e-llm-inference-service] Creating OperatorGroup openshift-keda... [e2e-llm-inference-service] operatorgroup.operators.coreos.com/openshift-keda created [e2e-llm-inference-service] OperatorGroup openshift-keda created/ensured. [e2e-llm-inference-service] --- [e2e-llm-inference-service] Creating Subscription for openshift-custom-metrics-autoscaler-operator... [e2e-llm-inference-service] subscription.operators.coreos.com/openshift-custom-metrics-autoscaler-operator created [e2e-llm-inference-service] Subscription openshift-custom-metrics-autoscaler-operator created/ensured. [e2e-llm-inference-service] --- [e2e-llm-inference-service] Waiting for openshift-custom-metrics-autoscaler-operator CSV to become ready... [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-custom-metrics-autoscaler-operator... (0/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-custom-metrics-autoscaler-operator... (5/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-custom-metrics-autoscaler-operator... (10/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-custom-metrics-autoscaler-operator... (15/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-custom-metrics-autoscaler-operator... (20/600) [e2e-llm-inference-service] CSV custom-metrics-autoscaler.v2.18.1-2 found, but not yet Succeeded (Phase: Installing). Waiting... (25/600) [e2e-llm-inference-service] CSV custom-metrics-autoscaler.v2.18.1-2 found, but not yet Succeeded (Phase: Installing). Waiting... (30/600) [e2e-llm-inference-service] CSV custom-metrics-autoscaler.v2.18.1-2 found, but not yet Succeeded (Phase: Installing). Waiting... (35/600) [e2e-llm-inference-service] CSV custom-metrics-autoscaler.v2.18.1-2 found, but not yet Succeeded (Phase: Installing). Waiting... (40/600) [e2e-llm-inference-service] CSV custom-metrics-autoscaler.v2.18.1-2 found, but not yet Succeeded (Phase: Installing). Waiting... (45/600) [e2e-llm-inference-service] CSV custom-metrics-autoscaler.v2.18.1-2 is ready (Phase: Succeeded). [e2e-llm-inference-service] --- [e2e-llm-inference-service] Applying KedaController custom resource... [e2e-llm-inference-service] Warning: resource kedacontrollers/keda is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically. [e2e-llm-inference-service] kedacontroller.keda.sh/keda configured [e2e-llm-inference-service] KedaController custom resource applied. [e2e-llm-inference-service] --- [e2e-llm-inference-service] Allowing time for KEDA components to be provisioned by the operator ... [e2e-llm-inference-service] Waiting for KEDA Operator pod (selector: "app=keda-operator") to be ready in namespace openshift-keda... [e2e-llm-inference-service] Waiting for pod -l "app=keda-operator" in namespace "openshift-keda" to be created... [e2e-llm-inference-service] Pod -l "app=keda-operator" in namespace "openshift-keda" found. [e2e-llm-inference-service] Current pods for -l "app=keda-operator" in namespace "openshift-keda": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] keda-operator-ffbb595cb-p8cdh 1/1 Running 0 41s [e2e-llm-inference-service] Waiting up to 120s for pod(s) -l "app=keda-operator" in namespace "openshift-keda" to become ready... [e2e-llm-inference-service] pod/keda-operator-ffbb595cb-p8cdh condition met [e2e-llm-inference-service] Pod(s) -l "app=keda-operator" in namespace "openshift-keda" are ready. [e2e-llm-inference-service] KEDA Operator pod is ready. [e2e-llm-inference-service] Waiting for KEDA Metrics API Server pod (selector: "app=keda-metrics-apiserver") to be ready in namespace openshift-keda... [e2e-llm-inference-service] Waiting for pod -l "app=keda-metrics-apiserver" in namespace "openshift-keda" to be created... [e2e-llm-inference-service] Pod -l "app=keda-metrics-apiserver" in namespace "openshift-keda" found. [e2e-llm-inference-service] Current pods for -l "app=keda-metrics-apiserver" in namespace "openshift-keda": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] keda-metrics-apiserver-7c9f485588-lnrsl 1/1 Running 0 46s [e2e-llm-inference-service] Waiting up to 120s for pod(s) -l "app=keda-metrics-apiserver" in namespace "openshift-keda" to become ready... [e2e-llm-inference-service] pod/keda-metrics-apiserver-7c9f485588-lnrsl condition met [e2e-llm-inference-service] Pod(s) -l "app=keda-metrics-apiserver" in namespace "openshift-keda" are ready. [e2e-llm-inference-service] KEDA Metrics API Server pod is ready. [e2e-llm-inference-service] Waiting for KEDA Webhook pod (selector: "app=keda-admission-webhooks") to be ready in namespace openshift-keda... [e2e-llm-inference-service] Waiting for pod -l "app=keda-admission-webhooks" in namespace "openshift-keda" to be created... [e2e-llm-inference-service] Pod -l "app=keda-admission-webhooks" in namespace "openshift-keda" found. [e2e-llm-inference-service] Current pods for -l "app=keda-admission-webhooks" in namespace "openshift-keda": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] keda-admission-cf49989db-t7n7v 1/1 Running 0 51s [e2e-llm-inference-service] Waiting up to 120s for pod(s) -l "app=keda-admission-webhooks" in namespace "openshift-keda" to become ready... [e2e-llm-inference-service] pod/keda-admission-cf49989db-t7n7v condition met [e2e-llm-inference-service] Pod(s) -l "app=keda-admission-webhooks" in namespace "openshift-keda" are ready. [e2e-llm-inference-service] KEDA Webhook pod is ready. [e2e-llm-inference-service] --- [e2e-llm-inference-service] ✅ KEDA deployment script finished successfully. [e2e-llm-inference-service] 🔧 Configuration: [e2e-llm-inference-service] KServe deployment: ❌ disabled [e2e-llm-inference-service] Kuadrant deployment: ✅ enabled [e2e-llm-inference-service] [e2e-llm-inference-service] Checking OpenShift server version...(4.20.19) [e2e-llm-inference-service] 🎯 Server version (4.20.19) is 4.19.9 or higher - continue with the script [e2e-llm-inference-service] ⏳ Installing cert-manager [e2e-llm-inference-service] namespace/cert-manager-operator created [e2e-llm-inference-service] operatorgroup.operators.coreos.com/cert-manager-operator created [e2e-llm-inference-service] subscription.operators.coreos.com/openshift-cert-manager-operator created [e2e-llm-inference-service] Waiting for openshift-cert-manager-operator CSV to become ready... [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-cert-manager-operator... (0/300) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-cert-manager-operator... (5/300) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-cert-manager-operator... (10/300) [e2e-llm-inference-service] CSV cert-manager-operator.v1.19.0 found, but not yet Succeeded (Phase: Installing). Waiting... (15/300) [e2e-llm-inference-service] CSV cert-manager-operator.v1.19.0 is ready (Phase: Succeeded). [e2e-llm-inference-service] Waiting for CRD certificates.cert-manager.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD certificates.cert-manager.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/certificates.cert-manager.io condition met [e2e-llm-inference-service] ✅ Cert-manager installed [e2e-llm-inference-service] ⏳ Installing openshift-lws-operator [e2e-llm-inference-service] namespace/openshift-lws-operator created [e2e-llm-inference-service] operatorgroup.operators.coreos.com/leader-worker-set created [e2e-llm-inference-service] subscription.operators.coreos.com/leader-worker-set created [e2e-llm-inference-service] Waiting for leader-worker-set CSV to become ready... [e2e-llm-inference-service] Waiting for CSV to be installed for subscription leader-worker-set... (0/300) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription leader-worker-set... (5/300) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription leader-worker-set... (10/300) [e2e-llm-inference-service] CSV leader-worker-set.v1.0.0 found, but not yet Succeeded (Phase: Installing). Waiting... (15/300) [e2e-llm-inference-service] CSV leader-worker-set.v1.0.0 is ready (Phase: Succeeded). [e2e-llm-inference-service] Waiting for CRD leaderworkersetoperators.operator.openshift.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD leaderworkersetoperators.operator.openshift.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/leaderworkersetoperators.operator.openshift.io condition met [e2e-llm-inference-service] leaderworkersetoperator.operator.openshift.io/cluster created [e2e-llm-inference-service] ⏳ waiting for openshift-lws-operator to be ready.… [e2e-llm-inference-service] Waiting for pod -l "name=openshift-lws-operator" in namespace "openshift-lws-operator" to be created... [e2e-llm-inference-service] Pod -l "name=openshift-lws-operator" in namespace "openshift-lws-operator" found. [e2e-llm-inference-service] Current pods for -l "name=openshift-lws-operator" in namespace "openshift-lws-operator": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] openshift-lws-operator-bfc7f696d-z7n4k 1/1 Running 0 13s [e2e-llm-inference-service] Waiting up to 600s for pod(s) -l "name=openshift-lws-operator" in namespace "openshift-lws-operator" to become ready... [e2e-llm-inference-service] pod/openshift-lws-operator-bfc7f696d-z7n4k condition met [e2e-llm-inference-service] Pod(s) -l "name=openshift-lws-operator" in namespace "openshift-lws-operator" are ready. [e2e-llm-inference-service] ✅ openshift-lws-operator installed [e2e-llm-inference-service] gatewayclass.gateway.networking.k8s.io/openshift-default created [e2e-llm-inference-service] Waiting for pod -l "app=istiod" in namespace "openshift-ingress" to be created... [e2e-llm-inference-service] Pod -l "app=istiod" in namespace "openshift-ingress" found. [e2e-llm-inference-service] Current pods for -l "app=istiod" in namespace "openshift-ingress": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] istiod-openshift-gateway-7cd77c7ffd-qkhkg 0/1 Running 0 7s [e2e-llm-inference-service] Waiting up to 600s for pod(s) -l "app=istiod" in namespace "openshift-ingress" to become ready... [e2e-llm-inference-service] pod/istiod-openshift-gateway-7cd77c7ffd-qkhkg condition met [e2e-llm-inference-service] Pod(s) -l "app=istiod" in namespace "openshift-ingress" are ready. [e2e-llm-inference-service] ⏳ Creating a Gateway [e2e-llm-inference-service] Error from server (AlreadyExists): namespaces "openshift-ingress" already exists [e2e-llm-inference-service] gateway.gateway.networking.k8s.io/openshift-ai-inference created [e2e-llm-inference-service] Waiting for pod -l "serving.kserve.io/gateway=kserve-ingress-gateway" in namespace "openshift-ingress" to be created... [e2e-llm-inference-service] Pod -l "serving.kserve.io/gateway=kserve-ingress-gateway" in namespace "openshift-ingress" found. [e2e-llm-inference-service] Current pods for -l "serving.kserve.io/gateway=kserve-ingress-gateway" in namespace "openshift-ingress": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d 0/1 Running 0 5s [e2e-llm-inference-service] Waiting up to 600s for pod(s) -l "serving.kserve.io/gateway=kserve-ingress-gateway" in namespace "openshift-ingress" to become ready... [e2e-llm-inference-service] pod/openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d condition met [e2e-llm-inference-service] Pod(s) -l "serving.kserve.io/gateway=kserve-ingress-gateway" in namespace "openshift-ingress" are ready. [e2e-llm-inference-service] ⏳ Installing RHCL(Kuadrant) operator [e2e-llm-inference-service] namespace/kuadrant-system created [e2e-llm-inference-service] subscription.operators.coreos.com/rhcl-operator created [e2e-llm-inference-service] operatorgroup.operators.coreos.com/kuadrant created [e2e-llm-inference-service] Waiting for rhcl-operator CSV to become ready... [e2e-llm-inference-service] Waiting for CSV to be installed for subscription rhcl-operator... (0/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription rhcl-operator... (5/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription rhcl-operator... (10/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription rhcl-operator... (15/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription rhcl-operator... (20/600) [e2e-llm-inference-service] CSV rhcl-operator.v1.3.2 found, but not yet Succeeded (Phase: Installing). Waiting... (25/600) [e2e-llm-inference-service] CSV rhcl-operator.v1.3.2 found, but not yet Succeeded (Phase: Installing). Waiting... (30/600) [e2e-llm-inference-service] CSV rhcl-operator.v1.3.2 found, but not yet Succeeded (Phase: Installing). Waiting... (35/600) [e2e-llm-inference-service] CSV rhcl-operator.v1.3.2 is ready (Phase: Succeeded). [e2e-llm-inference-service] Waiting for CRD kuadrants.kuadrant.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD kuadrants.kuadrant.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/kuadrants.kuadrant.io condition met [e2e-llm-inference-service] Waiting for apiserver discovery /apis/kuadrant.io/v1beta1 to list kuadrants (timeout: 120s)… [e2e-llm-inference-service] Discovery for kuadrant.io/v1beta1 includes kuadrants. [e2e-llm-inference-service] ⏳ sleeping 30s after discovery (RESTMapper can trail discovery)… [e2e-llm-inference-service] kuadrant.kuadrant.io/kuadrant created [e2e-llm-inference-service] ⏳ waiting for Kuadrant Ready (attempt 1/2, timeout 5m)… [e2e-llm-inference-service] kuadrant.kuadrant.io/kuadrant condition met [e2e-llm-inference-service] Waiting for pod -l "control-plane=authorino-operator" in namespace "kuadrant-system" to be created... [e2e-llm-inference-service] Pod -l "control-plane=authorino-operator" in namespace "kuadrant-system" found. [e2e-llm-inference-service] Current pods for -l "control-plane=authorino-operator" in namespace "kuadrant-system": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] authorino-operator-7587b89b76-4d9ct 1/1 Running 0 74s [e2e-llm-inference-service] Waiting up to 600s for pod(s) -l "control-plane=authorino-operator" in namespace "kuadrant-system" to become ready... [e2e-llm-inference-service] pod/authorino-operator-7587b89b76-4d9ct condition met [e2e-llm-inference-service] Pod(s) -l "control-plane=authorino-operator" in namespace "kuadrant-system" are ready. [e2e-llm-inference-service] ⏳ waiting for authorino service to be created... [e2e-llm-inference-service] service/authorino-authorino-authorization condition met [e2e-llm-inference-service] service/authorino-authorino-authorization annotated [e2e-llm-inference-service] Warning: resource authorinos/authorino is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically. [e2e-llm-inference-service] authorino.operator.authorino.kuadrant.io/authorino configured [e2e-llm-inference-service] Waiting for pod -l "control-plane=authorino-operator" in namespace "kuadrant-system" to be created... [e2e-llm-inference-service] Pod -l "control-plane=authorino-operator" in namespace "kuadrant-system" found. [e2e-llm-inference-service] Current pods for -l "control-plane=authorino-operator" in namespace "kuadrant-system": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] authorino-operator-7587b89b76-4d9ct 1/1 Running 0 82s [e2e-llm-inference-service] Waiting up to 600s for pod(s) -l "control-plane=authorino-operator" in namespace "kuadrant-system" to become ready... [e2e-llm-inference-service] pod/authorino-operator-7587b89b76-4d9ct condition met [e2e-llm-inference-service] Pod(s) -l "control-plane=authorino-operator" in namespace "kuadrant-system" are ready. [e2e-llm-inference-service] ✅ kuadrant(authorino) installed [e2e-llm-inference-service] Now using project "kserve" on server "https://a01d81a2739d8439ab55f0c0fc859d34-54a3aef725acc4ee.elb.us-east-1.amazonaws.com:6443". [e2e-llm-inference-service] [e2e-llm-inference-service] You can add applications to this project with the 'new-app' command. For example, try: [e2e-llm-inference-service] [e2e-llm-inference-service] oc new-app rails-postgresql-example [e2e-llm-inference-service] [e2e-llm-inference-service] to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: [e2e-llm-inference-service] [e2e-llm-inference-service] kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname [e2e-llm-inference-service] [e2e-llm-inference-service] ⏳ Installing KServe with SeaweedFS [e2e-llm-inference-service] # Warning: 'commonLabels' is deprecated. Please use 'labels' instead. Run 'kustomize edit fix' to update your Kustomization automatically. [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/clusterstoragecontainers.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/datascienceclusters.datasciencecluster.opendatahub.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/dscinitializations.dscinitialization.opendatahub.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencegraphs.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencemodelrewrites.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferenceobjectives.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencepoolimports.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencepools.inference.networking.k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencepools.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferenceservices.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/llminferenceserviceconfigs.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/llminferenceservices.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/servingruntimes.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/trainedmodels.serving.kserve.io serverside-applied [e2e-llm-inference-service] ⏳ Waiting for CRDs to be established [e2e-llm-inference-service] Waiting for CRD inferenceservices.serving.kserve.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD inferenceservices.serving.kserve.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferenceservices.serving.kserve.io condition met [e2e-llm-inference-service] Waiting for CRD llminferenceserviceconfigs.serving.kserve.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD llminferenceserviceconfigs.serving.kserve.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/llminferenceserviceconfigs.serving.kserve.io condition met [e2e-llm-inference-service] Waiting for CRD clusterstoragecontainers.serving.kserve.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD clusterstoragecontainers.serving.kserve.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/clusterstoragecontainers.serving.kserve.io condition met [e2e-llm-inference-service] Waiting for CRD datascienceclusters.datasciencecluster.opendatahub.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD datascienceclusters.datasciencecluster.opendatahub.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/datascienceclusters.datasciencecluster.opendatahub.io condition met [e2e-llm-inference-service] ⏳ Applying all resources... [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/clusterstoragecontainers.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/datascienceclusters.datasciencecluster.opendatahub.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/dscinitializations.dscinitialization.opendatahub.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencegraphs.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencemodelrewrites.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferenceobjectives.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencepoolimports.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencepools.inference.networking.k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencepools.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferenceservices.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/llminferenceserviceconfigs.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/llminferenceservices.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/servingruntimes.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/trainedmodels.serving.kserve.io serverside-applied [e2e-llm-inference-service] serviceaccount/kserve-controller-manager serverside-applied [e2e-llm-inference-service] serviceaccount/llmisvc-controller-manager serverside-applied [e2e-llm-inference-service] role.rbac.authorization.k8s.io/kserve-leader-election-role serverside-applied [e2e-llm-inference-service] role.rbac.authorization.k8s.io/llmisvc-leader-election-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-admin serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-edit serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-llmisvc-distro-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-llmisvc-manager-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-manager-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-metrics-reader-cluster-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-proxy-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-view serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/openshift-ai-llminferenceservice-scc serverside-applied [e2e-llm-inference-service] rolebinding.rbac.authorization.k8s.io/kserve-leader-election-rolebinding serverside-applied [e2e-llm-inference-service] rolebinding.rbac.authorization.k8s.io/llmisvc-leader-election-rolebinding serverside-applied [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/kserve-llmisvc-distro-rolebinding serverside-applied [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/kserve-manager-rolebinding serverside-applied [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/kserve-proxy-rolebinding serverside-applied [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/llmisvc-manager-rolebinding serverside-applied [e2e-llm-inference-service] configmap/inferenceservice-config serverside-applied [e2e-llm-inference-service] configmap/kserve-parameters serverside-applied [e2e-llm-inference-service] secret/kserve-webhook-server-secret serverside-applied [e2e-llm-inference-service] secret/mlpipeline-s3-artifact serverside-applied [e2e-llm-inference-service] service/kserve-controller-manager-metrics-service serverside-applied [e2e-llm-inference-service] service/kserve-controller-manager-service serverside-applied [e2e-llm-inference-service] service/kserve-webhook-server-service serverside-applied [e2e-llm-inference-service] service/llmisvc-controller-manager-service serverside-applied [e2e-llm-inference-service] service/llmisvc-webhook-server-service serverside-applied [e2e-llm-inference-service] service/s3-service serverside-applied [e2e-llm-inference-service] deployment.apps/kserve-controller-manager serverside-applied [e2e-llm-inference-service] deployment.apps/llmisvc-controller-manager serverside-applied [e2e-llm-inference-service] deployment.apps/seaweedfs serverside-applied [e2e-llm-inference-service] networkpolicy.networking.k8s.io/kserve-controller-manager serverside-applied [e2e-llm-inference-service] securitycontextconstraints.security.openshift.io/openshift-ai-llminferenceservice-scc serverside-applied [e2e-llm-inference-service] clusterstoragecontainer.serving.kserve.io/default serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-decode-template serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-decode-worker-data-parallel serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-prefill-template serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-prefill-worker-data-parallel serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-router-route serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-scheduler serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-amd-rocm serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-ppc64le serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-s390x serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-x86 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-intel-gaudi serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-nvidia-cuda serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-worker-data-parallel serverside-applied [e2e-llm-inference-service] mutatingwebhookconfiguration.admissionregistration.k8s.io/inferenceservice.serving.kserve.io serverside-applied [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/inferencegraph.serving.kserve.io serverside-applied [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/inferenceservice.serving.kserve.io serverside-applied [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/llminferenceservice.serving.kserve.io serverside-applied [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/llminferenceserviceconfig.serving.kserve.io serverside-applied [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/servingruntime.serving.kserve.io serverside-applied [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/trainedmodel.serving.kserve.io serverside-applied [e2e-llm-inference-service] ⏳ Waiting for llmisvc-controller-manager to be ready... [e2e-llm-inference-service] Waiting for pod -l "control-plane=llmisvc-controller-manager" in namespace "kserve" to be created... [e2e-llm-inference-service] Pod -l "control-plane=llmisvc-controller-manager" in namespace "kserve" found. [e2e-llm-inference-service] Current pods for -l "control-plane=llmisvc-controller-manager" in namespace "kserve": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] llmisvc-controller-manager-6c58f78c97-glpn7 0/1 Running 0 6s [e2e-llm-inference-service] Waiting up to 600s for pod(s) -l "control-plane=llmisvc-controller-manager" in namespace "kserve" to become ready... [e2e-llm-inference-service] pod/llmisvc-controller-manager-6c58f78c97-glpn7 condition met [e2e-llm-inference-service] Pod(s) -l "control-plane=llmisvc-controller-manager" in namespace "kserve" are ready. [e2e-llm-inference-service] ⏳ Re-applying LLMInferenceServiceConfig resources with webhook validation... [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-decode-template is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-decode-template serverside-applied [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-decode-worker-data-parallel is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-decode-worker-data-parallel serverside-applied [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-prefill-template is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-prefill-template serverside-applied [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-prefill-worker-data-parallel is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-prefill-worker-data-parallel serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-router-route serverside-applied [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-scheduler is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-scheduler serverside-applied [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-template is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template serverside-applied [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-worker-data-parallel is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-worker-data-parallel serverside-applied [e2e-llm-inference-service] Installing DSC/DSCI resources... [e2e-llm-inference-service] dscinitialization.dscinitialization.opendatahub.io/test-dsci created [e2e-llm-inference-service] datasciencecluster.datasciencecluster.opendatahub.io/test-dsc created [e2e-llm-inference-service] Patching ingress domain, markers: llminferenceservice and cluster_cpu [e2e-llm-inference-service] configmap/inferenceservice-config patched [e2e-llm-inference-service] pod "kserve-controller-manager-67f77cd7d7-q9b4m" deleted [e2e-llm-inference-service] datasciencecluster.datasciencecluster.opendatahub.io/test-dsc patched [e2e-llm-inference-service] waiting kserve-controller get ready... [e2e-llm-inference-service] pod/kserve-controller-manager-67f77cd7d7-ffx4r condition met [e2e-llm-inference-service] Installing ODH Model Controller manually with PR images [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/accounts.nim.opendatahub.io created [e2e-llm-inference-service] serviceaccount/model-serving-api created [e2e-llm-inference-service] serviceaccount/odh-model-controller created [e2e-llm-inference-service] role.rbac.authorization.k8s.io/leader-election-role created [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-prometheus-k8s created [e2e-llm-inference-service] Warning: resource clusterroles/metrics-reader is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically. [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/metrics-reader configured [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/model-serving-api created [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/odh-model-controller-role created [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/proxy-role created [e2e-llm-inference-service] rolebinding.rbac.authorization.k8s.io/leader-election-rolebinding created [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/model-serving-api created [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/odh-model-controller-rolebinding-opendatahub created [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/proxy-rolebinding created [e2e-llm-inference-service] configmap/odh-model-controller-parameters created [e2e-llm-inference-service] service/model-serving-api created [e2e-llm-inference-service] service/odh-model-controller-metrics-service created [e2e-llm-inference-service] service/odh-model-controller-webhook-service created [e2e-llm-inference-service] deployment.apps/model-serving-api created [e2e-llm-inference-service] deployment.apps/odh-model-controller created [e2e-llm-inference-service] servicemonitor.monitoring.coreos.com/model-serving-api-metrics created [e2e-llm-inference-service] servicemonitor.monitoring.coreos.com/odh-model-controller-metrics-monitor created [e2e-llm-inference-service] template.template.openshift.io/guardrails-detector-huggingface-serving-template created [e2e-llm-inference-service] template.template.openshift.io/kserve-ovms created [e2e-llm-inference-service] template.template.openshift.io/mlserver-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-cpu-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-cpu-x86-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-cuda-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-gaudi-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-multinode-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-rocm-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-ppc64le-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-s390x-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-x86-runtime-template created [e2e-llm-inference-service] mutatingwebhookconfiguration.admissionregistration.k8s.io/mutating.odh-model-controller.opendatahub.io created [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/validating.odh-model-controller.opendatahub.io created [e2e-llm-inference-service] Waiting for deployment "odh-model-controller" rollout to finish: 0 of 1 updated replicas are available... [e2e-llm-inference-service] deployment "odh-model-controller" successfully rolled out [e2e-llm-inference-service] Add testing models to SeaweedFS S3 storage ... [e2e-llm-inference-service] Waiting for SeaweedFS deployment to be ready... [e2e-llm-inference-service] deployment "seaweedfs" successfully rolled out [e2e-llm-inference-service] S3 init job not completed, re-creating... [e2e-llm-inference-service] job.batch/s3-init created [e2e-llm-inference-service] Waiting for S3 init job to complete... [e2e-llm-inference-service] job.batch/s3-init condition met [e2e-llm-inference-service] networkpolicy.networking.k8s.io/allow-all created [e2e-llm-inference-service] Prepare CI namespace and install ServingRuntimes [e2e-llm-inference-service] Setting up CI namespace: kserve-ci-e2e-test [e2e-llm-inference-service] Tearing down CI namespace: kserve-ci-e2e-test [e2e-llm-inference-service] Namespace kserve-ci-e2e-test does not exist, skipping deletion [e2e-llm-inference-service] CI namespace teardown complete [e2e-llm-inference-service] Creating namespace kserve-ci-e2e-test [e2e-llm-inference-service] namespace/kserve-ci-e2e-test created [e2e-llm-inference-service] Applying S3 artifact secret [e2e-llm-inference-service] secret/mlpipeline-s3-artifact created [e2e-llm-inference-service] Applying storage-config secret [e2e-llm-inference-service] secret/storage-config created [e2e-llm-inference-service] Creating odh-trusted-ca-bundle configmap [e2e-llm-inference-service] configmap/odh-trusted-ca-bundle created [e2e-llm-inference-service] Installing ServingRuntimes [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-huggingfaceserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-huggingfaceserver-multinode created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-lgbserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-mlserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-paddleserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-pmmlserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-predictiveserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-sklearnserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-tensorflow-serving created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-torchserve created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-tritonserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-xgbserver created [e2e-llm-inference-service] CI namespace setup complete [e2e-llm-inference-service] Setup complete [e2e-llm-inference-service] === E2E cluster / operator summary === [e2e-llm-inference-service] Client Version: 4.20.11 [e2e-llm-inference-service] Kustomize Version: v5.6.0 [e2e-llm-inference-service] Server Version: 4.20.19 [e2e-llm-inference-service] Kubernetes Version: v1.33.9 [e2e-llm-inference-service] ClusterVersion desired: 4.20.19 [e2e-llm-inference-service] ClusterVersion history (latest): 4.20.19 (Completed) [e2e-llm-inference-service] CSVs in kuadrant-system: [e2e-llm-inference-service] authorino-operator.v1.3.0 Succeeded [e2e-llm-inference-service] cert-manager-operator.v1.19.0 Succeeded [e2e-llm-inference-service] dns-operator.v1.3.0 Succeeded [e2e-llm-inference-service] limitador-operator.v1.3.0 Succeeded [e2e-llm-inference-service] rhcl-operator.v1.3.2 Succeeded [e2e-llm-inference-service] servicemeshoperator3.v3.1.0 Succeeded [e2e-llm-inference-service] CSVs in openshift-keda: [e2e-llm-inference-service] authorino-operator.v1.3.0 Succeeded [e2e-llm-inference-service] cert-manager-operator.v1.19.0 Succeeded [e2e-llm-inference-service] custom-metrics-autoscaler.v2.18.1-2 Succeeded [e2e-llm-inference-service] dns-operator.v1.3.0 Succeeded [e2e-llm-inference-service] limitador-operator.v1.3.0 Succeeded [e2e-llm-inference-service] rhcl-operator.v1.3.2 Succeeded [e2e-llm-inference-service] servicemeshoperator3.v3.1.0 Succeeded [e2e-llm-inference-service] CSVs in cert-manager-operator: [e2e-llm-inference-service] authorino-operator.v1.3.0 Succeeded [e2e-llm-inference-service] cert-manager-operator.v1.19.0 Succeeded [e2e-llm-inference-service] dns-operator.v1.3.0 Succeeded [e2e-llm-inference-service] limitador-operator.v1.3.0 Succeeded [e2e-llm-inference-service] rhcl-operator.v1.3.2 Succeeded [e2e-llm-inference-service] servicemeshoperator3.v3.1.0 Succeeded [e2e-llm-inference-service] CSVs in openshift-lws-operator: [e2e-llm-inference-service] authorino-operator.v1.3.0 Succeeded [e2e-llm-inference-service] cert-manager-operator.v1.19.0 Succeeded [e2e-llm-inference-service] dns-operator.v1.3.0 Succeeded [e2e-llm-inference-service] leader-worker-set.v1.0.0 Succeeded [e2e-llm-inference-service] limitador-operator.v1.3.0 Succeeded [e2e-llm-inference-service] rhcl-operator.v1.3.2 Succeeded [e2e-llm-inference-service] servicemeshoperator3.v3.1.0 Succeeded [e2e-llm-inference-service] CSVs in openshift-operators (ODH / shared operators, filtered): [e2e-llm-inference-service] authorino-operator.v1.3.0 Succeeded [e2e-llm-inference-service] dns-operator.v1.3.0 Succeeded [e2e-llm-inference-service] limitador-operator.v1.3.0 Succeeded [e2e-llm-inference-service] rhcl-operator.v1.3.2 Succeeded [e2e-llm-inference-service] servicemeshoperator3.v3.1.0 Succeeded [e2e-llm-inference-service] Kuadrant / Authorino (diagnostics): [e2e-llm-inference-service] CRD kuadrants.kuadrant.io versions: v1beta1 served=true storage=true [e2e-llm-inference-service] Subscriptions in kuadrant-system: [e2e-llm-inference-service] authorino-operator-stable-redhat-operators-openshift-marketplace stable redhat-operators authorino-operator.v1.3.0 [e2e-llm-inference-service] dns-operator-stable-redhat-operators-openshift-marketplace stable redhat-operators dns-operator.v1.3.0 [e2e-llm-inference-service] limitador-operator-stable-redhat-operators-openshift-marketplace stable redhat-operators limitador-operator.v1.3.0 [e2e-llm-inference-service] rhcl-operator stable redhat-operators rhcl-operator.v1.3.2 [e2e-llm-inference-service] Kuadrant CR conditions (kuadrant/kuadrant-system): [e2e-llm-inference-service] Ready=True (Ready) [e2e-llm-inference-service] === End E2E cluster / operator summary === [e2e-llm-inference-service] /workspace/source [e2e-llm-inference-service] REQUESTS_CA_BUNDLE=-----BEGIN CERTIFICATE----- [e2e-llm-inference-service] MIIDPDCCAiSgAwIBAgIIV1gqJg5RHWowDQYJKoZIhvcNAQELBQAwJjESMBAGA1UE [e2e-llm-inference-service] CxMJb3BlbnNoaWZ0MRAwDgYDVQQDEwdyb290LWNhMB4XDTI2MDQyNDIxMjA0MloX [e2e-llm-inference-service] DTM2MDQyMTIxMjA0MlowJjESMBAGA1UECxMJb3BlbnNoaWZ0MRAwDgYDVQQDEwdy [e2e-llm-inference-service] b290LWNhMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAvMaNwIVYEEnY [e2e-llm-inference-service] wP05rhOLi0NwsE3qJxcPHt0X/+NYfddc0jwtgAj7FY0XW6+It742Dj4yVsQER1LV [e2e-llm-inference-service] IUOEiFSwuWUpxmmIPPJXYGWANB+CncrsCYDuE58toDGB9N96yM3GxYrDM3HghreF [e2e-llm-inference-service] dHJvPmcdsD40nhwR7jOuzfcEokr74+odK+JQ5x1VRRx57SgGf8YeEg37GsYkaNQH [e2e-llm-inference-service] 94NhsTfpOLOUgXzKphX3I7Yz5a3wu5K+jcPQ9j7ynBk/NpTE/thypZHT80cqG7vt [e2e-llm-inference-service] oeJS9IT4LxuR16ob2Y5kRcEedUDhDMH1fHtfImJ3oXoBqgvN0Uhoc+NIfvAuyTmg [e2e-llm-inference-service] 4dVPD74b+QIDAQABo24wbDAOBgNVHQ8BAf8EBAMCAqQwDwYDVR0TAQH/BAUwAwEB [e2e-llm-inference-service] /zBJBgNVHQ4EQgRALV4mI/voyZxkOFzeuA6LGxSyxe3OSt+LgYSRvmrTrlo90ea/ [e2e-llm-inference-service] UxE1RMlmQszI2fMSY4M2VQw1082053gLI9ijjzANBgkqhkiG9w0BAQsFAAOCAQEA [e2e-llm-inference-service] scsiHEw707j4Wm0YEclezT1cCSzQ7Ms57ozp1nDGKwuw+nbK7uA7QCWSxwiTcOWF [e2e-llm-inference-service] M1J9vmYCsT6H09U6Gp2GJWVAP/gupEesFnYJO3y9IRt+OBfIFdFchfXZlV+a0D2g [e2e-llm-inference-service] OGgh841nSIbQB/g6QYcxf8EqZ8gDjlXNs+TjEzafHg9AmkWr3BFaDJWqdoUJmtpi [e2e-llm-inference-service] TeYIHEZZXXFIMUpwVUCtowke3EFQNs231BjV5c4B3r7FYq05jJ15mnmspzTUQvlD [e2e-llm-inference-service] /mTemnArggmlWF9Cu73AVexMqzeMNjEWhk/JkSAhxzpirPYMaroRxpT/kErKEvBP [e2e-llm-inference-service] iUd4UQIaW4wgUGqQ2fnIJg== [e2e-llm-inference-service] -----END CERTIFICATE----- [e2e-llm-inference-service] -----BEGIN CERTIFICATE----- [e2e-llm-inference-service] MIIEADCCAuigAwIBAgIIdX/04EaI82cwDQYJKoZIhvcNAQELBQAwJjESMBAGA1UE [e2e-llm-inference-service] CxMJb3BlbnNoaWZ0MRAwDgYDVQQDEwdyb290LWNhMB4XDTI2MDQyNDIxMjEyN1oX [e2e-llm-inference-service] DTI3MDQyNDIxMjEyN1owMDESMBAGA1UEChMJb3BlbnNoaWZ0MRowGAYDVQQDExFv [e2e-llm-inference-service] cGVuc2hpZnQtaW5ncmVzczCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEB [e2e-llm-inference-service] ANNwT6jX5ADS08ty/o8DbakgOlGk8Vr3kFBjvtcBhMGKb8ue6U+XDsCIiB0JgGCO [e2e-llm-inference-service] Ul43cF+gass16hh94j0XqRmItvVS+L8Z2G5FDdl9QAyMuNCgnSW0SbXecGHF8fGN [e2e-llm-inference-service] JSdrD+Wx8apuXdhuVW0d0IkYHVi4NwyM13dm3I8RiNLgyvfz/xS+GlL1av6mJjUG [e2e-llm-inference-service] 2Rdgxusl40zVjg9e3vctBc88osNJ4TruoJf7eoRK7YNvmikcJbPz8Q4QwmnKZckH [e2e-llm-inference-service] 9TALTgLH4m/8rsrPLhhgL3YnvQhkkZOjnEt6Pt8ZwatBkbUsj/3rX40972z9rlgv [e2e-llm-inference-service] fPFLKeNk/XwQnIsbDxjGlOsCAwEAAaOCASYwggEiMA4GA1UdDwEB/wQEAwIFoDAd [e2e-llm-inference-service] BgNVHSUEFjAUBggrBgEFBQcDAgYIKwYBBQUHAwEwDAYDVR0TAQH/BAIwADBJBgNV [e2e-llm-inference-service] HQ4EQgRAXUO5tDXi6R81fFZrU7MaWLh7qjz0vsN7wRfLjNK5b1mldi6CqPildPcT [e2e-llm-inference-service] xjqZ1ZKS1XU93zZRX4csatPLfqK7MzBLBgNVHSMERDBCgEAtXiYj++jJnGQ4XN64 [e2e-llm-inference-service] DosbFLLF7c5K34uBhJG+atOuWj3R5r9TETVEyWZCzMjZ8xJjgzZVDDXTzbTneAsj [e2e-llm-inference-service] 2KOPMEsGA1UdEQREMEKCQCouYXBwcy43NjliZjc5Mi1lNmEyLTQyYmEtYTI5MC0x [e2e-llm-inference-service] NDdhMzI2YzZmNjUucHJvZC5rb25mbHV4ZWFhcy5jb20wDQYJKoZIhvcNAQELBQAD [e2e-llm-inference-service] ggEBAGtSWPwXqVUy6pKUsUs83CIhNqoioxskXWNdcdOqdMqNYVtky2mKI44X7LSm [e2e-llm-inference-service] Jui8SrVkV+iUNKaQkl9cGlvZOeVu3GfQH2LVxVJDEXDPvanBBjLDJqeb2Br1ZrJy [e2e-llm-inference-service] UVxvsngmUCE1x38kurlBWTrGSiQ3bECBenqF3BIT/eZk2THC+QgnouzBJ2tTs6Oz [e2e-llm-inference-service] t8UeGdW3e/FqYIf5urRg2aXc1ku3iJksABBMt5WLezkmKHzxO1hJoo8QjOSR7Kr1 [e2e-llm-inference-service] haSYwub2GEbnGEdKyhpszB9wi6MQmfGa2pb5D/Z5LY8/a3YzbnvN7Df9Cpl+Rzf0 [e2e-llm-inference-service] 6HLeVFKNfYbKaf+67MLcUMyHIAQ= [e2e-llm-inference-service] -----END CERTIFICATE----- [e2e-llm-inference-service] [e2e-llm-inference-service] -----BEGIN CERTIFICATE----- [e2e-llm-inference-service] MIIDUTCCAjmgAwIBAgIIXCKe7RYYUv4wDQYJKoZIhvcNAQELBQAwNjE0MDIGA1UE [e2e-llm-inference-service] Awwrb3BlbnNoaWZ0LXNlcnZpY2Utc2VydmluZy1zaWduZXJAMTc3NzA2NjA5NzAe [e2e-llm-inference-service] Fw0yNjA0MjQyMTI4MTZaFw0yODA2MjIyMTI4MTdaMDYxNDAyBgNVBAMMK29wZW5z [e2e-llm-inference-service] aGlmdC1zZXJ2aWNlLXNlcnZpbmctc2lnbmVyQDE3NzcwNjYwOTcwggEiMA0GCSqG [e2e-llm-inference-service] SIb3DQEBAQUAA4IBDwAwggEKAoIBAQC11YvNbTsZqvpRJa/Bh/2NilZNmY4UAl/F [e2e-llm-inference-service] G2mdCS/qfP+N2mgpPGA+HKcf57duMIXVzh0F4+mpCOs2AMIlLjLvQDSlEfCRdKa0 [e2e-llm-inference-service] Cfz8VtdqdD5NWCJPEf9xSYG5lNSHzEag09MNgKL82NLaw9xX5OAvJ0go7rVEraPi [e2e-llm-inference-service] vapXFLOtZAXrhzEBaBr2wMIJfqi89c+xpwF0g3HbdRkw95QMvI1M/VtEzFOKN1RD [e2e-llm-inference-service] Kq9Kevg+r5nCq4kKNBgjtRSon8WJ8ypKxdaVZY8gKzEXVGgsxgv1DVgpiHYDgtqA [e2e-llm-inference-service] mPQAMDJHKeGuMgHYYUukwh46ju7ippm4tQTD7D0iaL2Xxd3caZVHAgMBAAGjYzBh [e2e-llm-inference-service] MA4GA1UdDwEB/wQEAwICpDAPBgNVHRMBAf8EBTADAQH/MB0GA1UdDgQWBBTnh4hE [e2e-llm-inference-service] a5XEJEaRTsMU/t74Mve40TAfBgNVHSMEGDAWgBTnh4hEa5XEJEaRTsMU/t74Mve4 [e2e-llm-inference-service] 0TANBgkqhkiG9w0BAQsFAAOCAQEAYWM9UNCJ77uTvInPZE8CACyGnmjsqANBrWSR [e2e-llm-inference-service] AiMK17aXtEwZJ2YXZokWHEtqZp/gSIGovfulvkNwraArSiR5QsXwgcnZG0zxGFlb [e2e-llm-inference-service] IH8jRa4mn/EjWPRDhC1SJnXueW7zXv9zE12Uzl4Iv6mKE/qJh5oaqKwrlvMqPdWz [e2e-llm-inference-service] UunYAQGwID3zMseGlr1qbB8h2fUeSetyLLQbyDJmxxM5MtrJrTGv9T66ntmsjbM1 [e2e-llm-inference-service] KDn4T4j5UZ+3yh4cahV7Og527hu1Yn4AyC6mND0CfRhWHZL9rh654f2S36bvrAzV [e2e-llm-inference-service] GDtgzz9TuX/0txKRigy82Evbfe9ixnO2QDAIctevEw6rxZk3rg== [e2e-llm-inference-service] -----END CERTIFICATE----- [e2e-llm-inference-service] Run E2E tests: llminferenceservice and cluster_cpu [e2e-llm-inference-service] Starting E2E functional tests ... [e2e-llm-inference-service] Parallelism requested for pytest is 2 [e2e-llm-inference-service] ============================= test session starts ============================== [e2e-llm-inference-service] platform linux -- Python 3.11.13, pytest-7.4.4, pluggy-1.5.0 -- /workspace/source/python/kserve/.venv/bin/python [e2e-llm-inference-service] cachedir: .pytest_cache [e2e-llm-inference-service] rootdir: /workspace/source/test/e2e [e2e-llm-inference-service] configfile: pytest.ini [e2e-llm-inference-service] plugins: asyncio-0.23.8, xdist-3.6.1, httpx-0.30.0, anyio-4.9.0, cov-5.0.0 [e2e-llm-inference-service] asyncio: mode=Mode.STRICT [e2e-llm-inference-service] created: 2/2 workers [e2e-llm-inference-service] 2 workers [22 items] [e2e-llm-inference-service] [e2e-llm-inference-service] scheduling tests via WorkStealingScheduling [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_gateway_section_name.py::test_gateway_section_name_propagation[cluster_single_node-cluster_cpu-with-section-name] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-inline-config-workload-llmd-simulator] 2026-04-24 21:39:34.125 5816 kserve INFO [conftest.py:configure_logger():40] Logger configured [e2e-llm-inference-service] 2026-04-24 21:39:34.126 5819 kserve INFO [conftest.py:configure_logger():40] Logger configured [e2e-llm-inference-service] 2026-04-24 21:39:34.138 5816 kserve.trace Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-04-24 21:39:34.138 5816 kserve.trace INFO [gw_api.py:create_or_update_gateway():34] Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-04-24 21:39:34.164 5816 kserve.trace Resource not found, creating Gateway router-gateway-1 [e2e-llm-inference-service] 2026-04-24 21:39:34.164 5816 kserve.trace INFO [gw_api.py:create_or_update_gateway():62] Resource not found, creating Gateway router-gateway-1 [e2e-llm-inference-service] 2026-04-24 21:39:34.171 5816 kserve.trace ✓ Successfully created Gateway router-gateway-1 [e2e-llm-inference-service] 2026-04-24 21:39:34.171 5816 kserve.trace INFO [gw_api.py:create_or_update_gateway():70] ✓ Successfully created Gateway router-gateway-1 [e2e-llm-inference-service] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_gateway_section_name.py::test_gateway_section_name_propagation[cluster_single_node-cluster_cpu-with-section-name] [e2e-llm-inference-service] llmisvc/test_gateway_section_name.py::test_gateway_section_name_propagation[cluster_single_node-cluster_cpu-without-section-name] 2026-04-24 21:39:47.084 5816 kserve.trace Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-04-24 21:39:47.084 5816 kserve.trace INFO [gw_api.py:create_or_update_gateway():34] Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-04-24 21:39:47.151 5816 kserve.trace ✓ Successfully updated Gateway router-gateway-1 [e2e-llm-inference-service] 2026-04-24 21:39:47.151 5816 kserve.trace INFO [gw_api.py:create_or_update_gateway():57] ✓ Successfully updated Gateway router-gateway-1 [e2e-llm-inference-service] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_gateway_section_name.py::test_gateway_section_name_propagation[cluster_single_node-cluster_cpu-without-section-name] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-gateway-ref-router-with-managed-route-model-fb-opt-125m-workload-llmd-simulator] 2026-04-24 21:40:16.970 5816 kserve.trace Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-04-24 21:40:16.970 5816 kserve.trace INFO [gw_api.py:create_or_update_gateway():34] Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-04-24 21:40:17.025 5816 kserve.trace ✓ Successfully updated Gateway router-gateway-1 [e2e-llm-inference-service] 2026-04-24 21:40:17.025 5816 kserve.trace INFO [gw_api.py:create_or_update_gateway():57] ✓ Successfully updated Gateway router-gateway-1 [e2e-llm-inference-service] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-inline-config-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-configmap-ref-workload-llmd-simulator] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-gateway-ref-router-with-managed-route-model-fb-opt-125m-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-configmap-ref-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-replicas-workload-llmd-simulator] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-replicas-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-precise-prefix-cache-inline-config-workload-llmd-simulator-kvcache] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-custom-route-timeout-scheduler-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-precise-prefix-cache-inline-config-workload-llmd-simulator-kvcache] [e2e-llm-inference-service] llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_v1alpha1_to_v1alpha2_conversion [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_v1alpha1_to_v1alpha2_conversion [e2e-llm-inference-service] llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_v1alpha2_to_v1alpha1_conversion [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_v1alpha2_to_v1alpha1_conversion [e2e-llm-inference-service] llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_criticality_preservation_via_annotations [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_criticality_preservation_via_annotations [e2e-llm-inference-service] llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_lora_criticality_preservation [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_lora_criticality_preservation [e2e-llm-inference-service] llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_round_trip_conversion_preserves_fields [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_round_trip_conversion_preserves_fields [e2e-llm-inference-service] llmisvc/test_llm_inference_service_stop.py::test_llm_stop_feature[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-custom-route-timeout-scheduler-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-refs-scheduler-managed-workload-single-cpu-model-fb-opt-125m] 2026-04-24 21:49:37.709 5816 kserve.trace Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-04-24 21:49:37.709 5816 kserve.trace INFO [gw_api.py:create_or_update_gateway():34] Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-04-24 21:49:37.753 5816 kserve.trace ✓ Successfully updated Gateway router-gateway-1 [e2e-llm-inference-service] 2026-04-24 21:49:37.753 5816 kserve.trace INFO [gw_api.py:create_or_update_gateway():57] ✓ Successfully updated Gateway router-gateway-1 [e2e-llm-inference-service] 2026-04-24 21:49:37.753 5816 kserve.trace Checking HttpRoute router-route-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-04-24 21:49:37.753 5816 kserve.trace INFO [gw_api.py:create_or_update_route():121] Checking HttpRoute router-route-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-04-24 21:49:37.760 5816 kserve.trace Resource not found, creating HttpRoute router-route-1 [e2e-llm-inference-service] 2026-04-24 21:49:37.760 5816 kserve.trace INFO [gw_api.py:create_or_update_route():149] Resource not found, creating HttpRoute router-route-1 [e2e-llm-inference-service] 2026-04-24 21:49:37.775 5816 kserve.trace ✓ Successfully created HttpRoute router-route-1 [e2e-llm-inference-service] 2026-04-24 21:49:37.775 5816 kserve.trace INFO [gw_api.py:create_or_update_route():157] ✓ Successfully created HttpRoute router-route-1 [e2e-llm-inference-service] 2026-04-24 21:49:37.776 5816 kserve.trace Checking HttpRoute router-route-2 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-04-24 21:49:37.776 5816 kserve.trace INFO [gw_api.py:create_or_update_route():121] Checking HttpRoute router-route-2 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-04-24 21:49:37.783 5816 kserve.trace Resource not found, creating HttpRoute router-route-2 [e2e-llm-inference-service] 2026-04-24 21:49:37.783 5816 kserve.trace INFO [gw_api.py:create_or_update_route():149] Resource not found, creating HttpRoute router-route-2 [e2e-llm-inference-service] 2026-04-24 21:49:37.794 5816 kserve.trace ✓ Successfully created HttpRoute router-route-2 [e2e-llm-inference-service] 2026-04-24 21:49:37.794 5816 kserve.trace INFO [gw_api.py:create_or_update_route():157] ✓ Successfully created HttpRoute router-route-2 [e2e-llm-inference-service] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-refs-scheduler-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service_stop.py::test_llm_stop_feature[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_storage_version_migration.py::TestStorageVersionMigration::test_storage_version_migration_after_simulated_upgrade [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_storage_version_migration.py::TestStorageVersionMigration::test_storage_version_migration_after_simulated_upgrade [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-no-scheduler-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-custom-route-timeout-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-no-scheduler-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_multi_node-router-managed-workload-simulated-dp-ep-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw0] FAILED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-custom-route-timeout-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-refs-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] 2026-04-24 22:11:24.252 5816 kserve.trace Checking Gateway router-gateway-2 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-04-24 22:11:24.252 5816 kserve.trace INFO [gw_api.py:create_or_update_gateway():34] Checking Gateway router-gateway-2 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-04-24 22:11:24.288 5816 kserve.trace Resource not found, creating Gateway router-gateway-2 [e2e-llm-inference-service] 2026-04-24 22:11:24.288 5816 kserve.trace INFO [gw_api.py:create_or_update_gateway():62] Resource not found, creating Gateway router-gateway-2 [e2e-llm-inference-service] 2026-04-24 22:11:24.296 5816 kserve.trace ✓ Successfully created Gateway router-gateway-2 [e2e-llm-inference-service] 2026-04-24 22:11:24.296 5816 kserve.trace INFO [gw_api.py:create_or_update_gateway():70] ✓ Successfully created Gateway router-gateway-2 [e2e-llm-inference-service] 2026-04-24 22:11:24.297 5816 kserve.trace Checking HttpRoute router-route-3 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-04-24 22:11:24.297 5816 kserve.trace INFO [gw_api.py:create_or_update_route():121] Checking HttpRoute router-route-3 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-04-24 22:11:24.310 5816 kserve.trace Resource not found, creating HttpRoute router-route-3 [e2e-llm-inference-service] 2026-04-24 22:11:24.310 5816 kserve.trace INFO [gw_api.py:create_or_update_route():149] Resource not found, creating HttpRoute router-route-3 [e2e-llm-inference-service] 2026-04-24 22:11:24.327 5816 kserve.trace ✓ Successfully created HttpRoute router-route-3 [e2e-llm-inference-service] 2026-04-24 22:11:24.327 5816 kserve.trace INFO [gw_api.py:create_or_update_route():157] ✓ Successfully created HttpRoute router-route-3 [e2e-llm-inference-service] 2026-04-24 22:11:24.328 5816 kserve.trace Checking HttpRoute router-route-4 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-04-24 22:11:24.328 5816 kserve.trace INFO [gw_api.py:create_or_update_route():121] Checking HttpRoute router-route-4 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-04-24 22:11:24.331 5816 kserve.trace Resource not found, creating HttpRoute router-route-4 [e2e-llm-inference-service] 2026-04-24 22:11:24.331 5816 kserve.trace INFO [gw_api.py:create_or_update_route():149] Resource not found, creating HttpRoute router-route-4 [e2e-llm-inference-service] 2026-04-24 22:11:24.343 5816 kserve.trace ✓ Successfully created HttpRoute router-route-4 [e2e-llm-inference-service] 2026-04-24 22:11:24.343 5816 kserve.trace INFO [gw_api.py:create_or_update_route():157] ✓ Successfully created HttpRoute router-route-4 [e2e-llm-inference-service] [e2e-llm-inference-service] [gw1] FAILED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_multi_node-router-managed-workload-simulated-dp-ep-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-refs-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [e2e-llm-inference-service] =================================== FAILURES =================================== [e2e-llm-inference-service] _ test_llm_inference_service[router-custom-route-timeout-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] _ [e2e-llm-inference-service] [gw0] linux -- Python 3.11.13 /workspace/source/python/kserve/.venv/bin/python [e2e-llm-inference-service] [e2e-llm-inference-service] test_case = TestCase(base_refs=['router-custom-route-timeout-pd', 'scheduler-managed', 'workload-pd-cpu', 'model-fb-opt-125m'], pr... {'name': 'model-fb-opt-125m-custom-route-e92a9ea6'}]}, [e2e-llm-inference-service] 'status': None}, model_name='facebook/opt-125m') [e2e-llm-inference-service] [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] @pytest.mark.asyncio(loop_scope="session") [e2e-llm-inference-service] @pytest.mark.parametrize( [e2e-llm-inference-service] "test_case", [e2e-llm-inference-service] [ [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-with-gateway-ref", [e2e-llm-inference-service] "router-with-managed-route", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] endpoint="/v1/completions", [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] payload_formatter=completions_payload, [e2e-llm-inference-service] response_assertion=create_response_assertion(with_field="choices"), [e2e-llm-inference-service] before_test=[ [e2e-llm-inference-service] lambda: create_router_resources( [e2e-llm-inference-service] gateways=[ROUTER_GATEWAYS[0]], [e2e-llm-inference-service] ) [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] pytest.mark.custom_gateway, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] payload_formatter=completions_payload, [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-custom-route-timeout", [e2e-llm-inference-service] "scheduler-managed", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="custom-route-timeout-test", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-with-refs", [e2e-llm-inference-service] "scheduler-managed", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="router-with-refs-test", [e2e-llm-inference-service] before_test=[ [e2e-llm-inference-service] lambda: create_router_resources( [e2e-llm-inference-service] gateways=[ROUTER_GATEWAYS[0]], [e2e-llm-inference-service] routes=[ROUTER_ROUTES[0], ROUTER_ROUTES[1]], [e2e-llm-inference-service] ) [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.custom_gateway, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=["router-managed", "workload-pd-cpu", "model-fb-opt-125m"], [e2e-llm-inference-service] prompt="You are an expert in Kubernetes-native machine learning serving platforms, with deep knowledge of the KServe project. " [e2e-llm-inference-service] "Explain the challenges of serving large-scale models, GPU scheduling, and how KServe integrates with capabilities like multi-model serving. " [e2e-llm-inference-service] "Provide a detailed comparison with open source alternatives, focusing on operational trade-offs.", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-custom-route-timeout-pd", [e2e-llm-inference-service] "scheduler-managed", [e2e-llm-inference-service] "workload-pd-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="You are an expert in Kubernetes-native machine learning serving platforms, with deep knowledge of the KServe project. " [e2e-llm-inference-service] "Explain the challenges of serving large-scale models, GPU scheduling, and how KServe integrates with capabilities like multi-model serving. " [e2e-llm-inference-service] "Provide a detailed comparison with open source alternatives, focusing on operational trade-offs.", [e2e-llm-inference-service] service_name="custom-route-timeout-pd-test", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-with-refs-pd", [e2e-llm-inference-service] "scheduler-managed", [e2e-llm-inference-service] "workload-pd-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="You are an expert in Kubernetes-native machine learning serving platforms, with deep knowledge of the KServe project. " [e2e-llm-inference-service] "Explain the challenges of serving large-scale models, GPU scheduling, and how KServe integrates with capabilities like multi-model serving. " [e2e-llm-inference-service] "Provide a detailed comparison with open source alternatives, focusing on operational trade-offs.", [e2e-llm-inference-service] service_name="router-with-refs-pd-test", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] before_test=[ [e2e-llm-inference-service] lambda: create_router_resources( [e2e-llm-inference-service] gateways=[ROUTER_GATEWAYS[1]], [e2e-llm-inference-service] routes=[ROUTER_ROUTES[2], ROUTER_ROUTES[3]], [e2e-llm-inference-service] ) [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.custom_gateway, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-dp-ep-gpu", [e2e-llm-inference-service] "workload-dp-ep-prefill-gpu", [e2e-llm-inference-service] "model-deepseek-v2-lite", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="Delve into the multifaceted implications of a fully disaggregated cloud architecture, specifically " [e2e-llm-inference-service] "where the compute plane (P) and the data plane (D) are independently deployed and managed for a " [e2e-llm-inference-service] "geographically distributed, high-throughput, low-latency microservices ecosystem. Beyond the " [e2e-llm-inference-service] "fundamental challenges of network latency and data consistency, elaborate on the advanced " [e2e-llm-inference-service] "considerations and trade-offs inherent in such a setup: 1. Network Architecture and Protocols: " [e2e-llm-inference-service] "How would the network fabric and underlying protocols (e.g., RDMA, custom transport layers) need to " [e2e-llm-inference-service] "evolve to support optimal performance and minimize inter-plane communication overhead, especially for " [e2e-llm-inference-service] "synchronous operations? Discuss the role of network programmability (e.g., SDN, P4) in dynamically " [e2e-llm-inference-service] "optimizing routing and traffic flow between P and D. 2. Advanced Data Consistency and Durability: " [e2e-llm-inference-service] "Explore sophisticated data consistency models (e.g., causal consistency, strong eventual consistency) " [e2e-llm-inference-service] "and their applicability in balancing performance and data integrity across a globally distributed data plane. " [e2e-llm-inference-service] "Detail strategies for ensuring data durability and fault tolerance, including multi-region replication, " [e2e-llm-inference-service] "intelligent partitioning, and recovery mechanisms in the event of partial or full plane failures. " [e2e-llm-inference-service] "3. Dynamic Resource Orchestration and Cost Optimization: Analyze how an orchestration layer would intelligently " [e2e-llm-inference-service] "manage the independent scaling of compute (P) and data (D) resources, considering fluctuating workloads, " [e2e-llm-inference-service] "cost efficiency, and performance targets (e.g., using predictive analytics for resource provisioning). " [e2e-llm-inference-service] "Discuss mechanisms for dynamically reallocating compute nodes to different data partitions based on " [e2e-llm-inference-service] "workload patterns and data locality, potentially involving live migration strategies. " [e2e-llm-inference-service] "4. Security and Compliance in a Distributed Landscape: Address the enhanced security perimeter " [e2e-llm-inference-service] "challenges, including securing communication channels between P and D (encryption in transit, mutual TLS), " [e2e-llm-inference-service] "fine-grained access control to data at rest and in motion, and identity management across disaggregated " [e2e-llm-inference-service] "components. Discuss how such an architecture impacts compliance with regulatory frameworks (e.g., GDPR, HIPAA) " [e2e-llm-inference-service] "concerning data sovereignty, privacy, and auditability. 5. Operational Complexity and Observability: " [e2e-llm-inference-service] "Examine the increased complexity in monitoring, logging, and tracing across highly decoupled compute and " [e2e-llm-inference-service] "data planes. What specialized tooling and practices (e.g., distributed tracing with OpenTelemetry, advanced AIOps) " [e2e-llm-inference-service] "would be essential? How would incident response and troubleshooting differ in this disaggregated environment " [e2e-llm-inference-service] "compared to traditional integrated systems? Consider the challenges of pinpointing root causes across " [e2e-llm-inference-service] "independent failures. 6. Real-world Applicability and Future Trends: Identify specific industries " [e2e-llm-inference-service] "or use cases (e.g., high-frequency trading, IoT edge processing, large language model inference) " [e2e-llm-inference-service] "where the benefits of P/D disaggregation would strongly outweigh its complexities. " [e2e-llm-inference-service] "Conclude by speculating on emerging technologies or paradigms (e.g., serverless compute functions " [e2e-llm-inference-service] "directly interacting with object storage, in-memory disaggregation) that could further drive or " [e2e-llm-inference-service] "transform P/D disaggregation in cloud computing.", [e2e-llm-inference-service] max_tokens=2000, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_gpu, [e2e-llm-inference-service] pytest.mark.cluster_nvidia, [e2e-llm-inference-service] pytest.mark.cluster_nvidia_roce, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-no-scheduler", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="What is KServe?", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.no_scheduler, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-simulated-dp-ep-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="This test simulates DP+EP that can run on CPU, the idea is to test the LWS-based deployment, " [e2e-llm-inference-service] "but without the resources requirements for DP+EP (GPUs and ROCe/IB).", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_multi_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Scheduler config tests [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-with-inline-config", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="scheduler-inline-config-test", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-with-configmap-ref", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="scheduler-configmap-ref-test", [e2e-llm-inference-service] before_test=[create_scheduler_configmap], [e2e-llm-inference-service] after_test=[delete_scheduler_configmap], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-with-replicas", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="scheduler-ha-replicas-test", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Precise prefix KV cache routing test [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-with-precise-prefix-cache-inline-config", [e2e-llm-inference-service] "workload-llmd-simulator-kvcache", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="precise-prefix-cache-test", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] ], [e2e-llm-inference-service] indirect=["test_case"], [e2e-llm-inference-service] ids=generate_test_id, [e2e-llm-inference-service] ) [e2e-llm-inference-service] @log_execution [e2e-llm-inference-service] def test_llm_inference_service(test_case: TestCase): # noqa: F811 [e2e-llm-inference-service] inject_k8s_proxy() [e2e-llm-inference-service] [e2e-llm-inference-service] kserve_client = KServeClient( [e2e-llm-inference-service] config_file=os.environ.get("KUBECONFIG", "~/.kube/config"), [e2e-llm-inference-service] client_configuration=client.Configuration(), [e2e-llm-inference-service] ) [e2e-llm-inference-service] [e2e-llm-inference-service] service_name = test_case.llm_service.metadata.name [e2e-llm-inference-service] if not test_case.llm_service.metadata.annotations: [e2e-llm-inference-service] test_case.llm_service.metadata.annotations = {} [e2e-llm-inference-service] [e2e-llm-inference-service] test_case.llm_service.metadata.annotations[ [e2e-llm-inference-service] "security.opendatahub.io/enable-auth" [e2e-llm-inference-service] ] = "false" [e2e-llm-inference-service] [e2e-llm-inference-service] try: [e2e-llm-inference-service] create_llmisvc(kserve_client, test_case.llm_service) [e2e-llm-inference-service] > wait_for_llm_isvc_ready( [e2e-llm-inference-service] kserve_client, test_case.llm_service, test_case.wait_timeout [e2e-llm-inference-service] ) [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:410: [e2e-llm-inference-service] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [e2e-llm-inference-service] [e2e-llm-inference-service] args = (, {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kin...ute-ti-2766b49d'}, [e2e-llm-inference-service] {'name': 'model-fb-opt-125m-custom-route-e92a9ea6'}]}, [e2e-llm-inference-service] 'status': None}, 900) [e2e-llm-inference-service] kwargs = {}, func_name = 'wait_for_llm_isvc_ready' [e2e-llm-inference-service] timestamp_start = '2026-04-24T21:56:21.705858', start_time = 1777067781.706082 [e2e-llm-inference-service] duration = 900.1039609909058, timestamp_end = '2026-04-24T22:11:21.810046' [e2e-llm-inference-service] [e2e-llm-inference-service] @functools.wraps(func) [e2e-llm-inference-service] def wrapper(*args, **kwargs): [e2e-llm-inference-service] func_name = func.__name__ [e2e-llm-inference-service] [e2e-llm-inference-service] timestamp_start = datetime.now().isoformat() [e2e-llm-inference-service] logger.info( [e2e-llm-inference-service] f"[{func_name}] [{timestamp_start}] start - args={args}, kwargs={kwargs}" [e2e-llm-inference-service] ) [e2e-llm-inference-service] start_time = time.time() [e2e-llm-inference-service] [e2e-llm-inference-service] try: [e2e-llm-inference-service] > result = func(*args, **kwargs) [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/logging.py:40: [e2e-llm-inference-service] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [e2e-llm-inference-service] [e2e-llm-inference-service] kserve_client = [e2e-llm-inference-service] given = {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security....tom-route-ti-2766b49d'}, [e2e-llm-inference-service] {'name': 'model-fb-opt-125m-custom-route-e92a9ea6'}]}, [e2e-llm-inference-service] 'status': None} [e2e-llm-inference-service] timeout_seconds = 900 [e2e-llm-inference-service] [e2e-llm-inference-service] @log_execution [e2e-llm-inference-service] def wait_for_llm_isvc_ready( [e2e-llm-inference-service] kserve_client: KServeClient, [e2e-llm-inference-service] given: V1alpha1LLMInferenceService, [e2e-llm-inference-service] timeout_seconds: int = 900, [e2e-llm-inference-service] ) -> str: [e2e-llm-inference-service] def assert_llm_isvc_ready(): [e2e-llm-inference-service] out = get_llmisvc( [e2e-llm-inference-service] kserve_client, [e2e-llm-inference-service] given.metadata.name, [e2e-llm-inference-service] given.metadata.namespace, [e2e-llm-inference-service] given.api_version.split("/")[1], [e2e-llm-inference-service] ) [e2e-llm-inference-service] [e2e-llm-inference-service] if "status" not in out: [e2e-llm-inference-service] raise AssertionError("No status found in LLM inference service") [e2e-llm-inference-service] [e2e-llm-inference-service] status = out["status"] [e2e-llm-inference-service] if "conditions" not in status: [e2e-llm-inference-service] raise AssertionError("No conditions found in status") [e2e-llm-inference-service] [e2e-llm-inference-service] expected_true_conditions = {"Ready", "WorkloadsReady", "RouterReady"} [e2e-llm-inference-service] got_true_conditions = set() [e2e-llm-inference-service] [e2e-llm-inference-service] conditions = status["conditions"] [e2e-llm-inference-service] [e2e-llm-inference-service] for condition in conditions: [e2e-llm-inference-service] if condition.get("status") == "True": [e2e-llm-inference-service] got_true_conditions.add(condition.get("type")) [e2e-llm-inference-service] [e2e-llm-inference-service] missing_conditions = expected_true_conditions - got_true_conditions [e2e-llm-inference-service] if missing_conditions: [e2e-llm-inference-service] raise AssertionError( [e2e-llm-inference-service] f"Missing true conditions: {missing_conditions}, expected {expected_true_conditions}, got {conditions}" [e2e-llm-inference-service] ) [e2e-llm-inference-service] return True [e2e-llm-inference-service] [e2e-llm-inference-service] > return wait_for(assert_llm_isvc_ready, timeout=timeout_seconds, interval=1.0) [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:618: [e2e-llm-inference-service] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [e2e-llm-inference-service] [e2e-llm-inference-service] assertion_fn = .assert_llm_isvc_ready at 0x7f08cc7c3380> [e2e-llm-inference-service] timeout = 900, interval = 1.0 [e2e-llm-inference-service] [e2e-llm-inference-service] def wait_for( [e2e-llm-inference-service] assertion_fn: Callable[[], Any], timeout: float = 5.0, interval: float = 0.1 [e2e-llm-inference-service] ) -> Any: [e2e-llm-inference-service] """Wait for the assertion to succeed within timeout.""" [e2e-llm-inference-service] deadline = time.time() + timeout [e2e-llm-inference-service] while True: [e2e-llm-inference-service] try: [e2e-llm-inference-service] > return assertion_fn() [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:628: [e2e-llm-inference-service] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [e2e-llm-inference-service] [e2e-llm-inference-service] def assert_llm_isvc_ready(): [e2e-llm-inference-service] out = get_llmisvc( [e2e-llm-inference-service] kserve_client, [e2e-llm-inference-service] given.metadata.name, [e2e-llm-inference-service] given.metadata.namespace, [e2e-llm-inference-service] given.api_version.split("/")[1], [e2e-llm-inference-service] ) [e2e-llm-inference-service] [e2e-llm-inference-service] if "status" not in out: [e2e-llm-inference-service] raise AssertionError("No status found in LLM inference service") [e2e-llm-inference-service] [e2e-llm-inference-service] status = out["status"] [e2e-llm-inference-service] if "conditions" not in status: [e2e-llm-inference-service] raise AssertionError("No conditions found in status") [e2e-llm-inference-service] [e2e-llm-inference-service] expected_true_conditions = {"Ready", "WorkloadsReady", "RouterReady"} [e2e-llm-inference-service] got_true_conditions = set() [e2e-llm-inference-service] [e2e-llm-inference-service] conditions = status["conditions"] [e2e-llm-inference-service] [e2e-llm-inference-service] for condition in conditions: [e2e-llm-inference-service] if condition.get("status") == "True": [e2e-llm-inference-service] got_true_conditions.add(condition.get("type")) [e2e-llm-inference-service] [e2e-llm-inference-service] missing_conditions = expected_true_conditions - got_true_conditions [e2e-llm-inference-service] if missing_conditions: [e2e-llm-inference-service] > raise AssertionError( [e2e-llm-inference-service] f"Missing true conditions: {missing_conditions}, expected {expected_true_conditions}, got {conditions}" [e2e-llm-inference-service] ) [e2e-llm-inference-service] E AssertionError: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:613: AssertionError [e2e-llm-inference-service] ------------------------------ Captured log setup ------------------------------ [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1107 No HTTP proxy configured for k8s client [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1056 Checking LLMInferenceServiceConfig router-custom-route-timeout-pd-8b408578 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1082 Resource not found, creating LLMInferenceServiceConfig router-custom-route-timeout-pd-8b408578 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1092 ✓ Successfully created LLMInferenceServiceConfig router-custom-route-timeout-pd-8b408578 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1056 Checking LLMInferenceServiceConfig scheduler-managed-custom-route-35ef63b2 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1082 Resource not found, creating LLMInferenceServiceConfig scheduler-managed-custom-route-35ef63b2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1092 ✓ Successfully created LLMInferenceServiceConfig scheduler-managed-custom-route-35ef63b2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1056 Checking LLMInferenceServiceConfig workload-pd-cpu-custom-route-ti-2766b49d in namespace kserve-ci-e2e-test [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1082 Resource not found, creating LLMInferenceServiceConfig workload-pd-cpu-custom-route-ti-2766b49d [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1092 ✓ Successfully created LLMInferenceServiceConfig workload-pd-cpu-custom-route-ti-2766b49d [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1056 Checking LLMInferenceServiceConfig model-fb-opt-125m-custom-route-e92a9ea6 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1082 Resource not found, creating LLMInferenceServiceConfig model-fb-opt-125m-custom-route-e92a9ea6 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1092 ✓ Successfully created LLMInferenceServiceConfig model-fb-opt-125m-custom-route-e92a9ea6 [e2e-llm-inference-service] ------------------------------ Captured log call ------------------------------- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [test_llm_inference_service] [2026-04-24T21:56:21.630601] start - args=(), kwargs={'test_case': TestCase(base_refs=['router-custom-route-timeout-pd', 'scheduler-managed', 'workload-pd-cpu', 'model-fb-opt-125m'], prompt='You are an expert in Kubernetes-native machine learning serving platforms, with deep knowledge of the KServe project. Explain the challenges of serving large-scale models, GPU scheduling, and how KServe integrates with capabilities like multi-model serving. Provide a detailed comparison with open source alternatives, focusing on operational trade-offs.', service_name='custom-route-timeout-pd-test', endpoint='/v1/completions', max_tokens=100, payload_formatter=None, response_assertion=, wait_timeout=900, response_timeout=60, before_test=[], after_test=[], llm_service={'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': None, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'custom-route-timeout-pd-test', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-custom-route-timeout-pd-8b408578'}, [e2e-llm-inference-service] {'name': 'scheduler-managed-custom-route-35ef63b2'}, [e2e-llm-inference-service] {'name': 'workload-pd-cpu-custom-route-ti-2766b49d'}, [e2e-llm-inference-service] {'name': 'model-fb-opt-125m-custom-route-e92a9ea6'}]}, [e2e-llm-inference-service] 'status': None}, model_name='facebook/opt-125m')} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1107 No HTTP proxy configured for k8s client [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [create_llmisvc] [2026-04-24T21:56:21.643365] start - args=(, {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security.opendatahub.io/enable-auth': 'false'}, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'custom-route-timeout-pd-test', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-custom-route-timeout-pd-8b408578'}, [e2e-llm-inference-service] {'name': 'scheduler-managed-custom-route-35ef63b2'}, [e2e-llm-inference-service] {'name': 'workload-pd-cpu-custom-route-ti-2766b49d'}, [e2e-llm-inference-service] {'name': 'model-fb-opt-125m-custom-route-e92a9ea6'}]}, [e2e-llm-inference-service] 'status': None}), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [create_llmisvc] [2026-04-24T21:56:21.705791] end - ✅ in 0.062s [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [wait_for_llm_isvc_ready] [2026-04-24T21:56:21.705858] start - args=(, {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security.opendatahub.io/enable-auth': 'false'}, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'custom-route-timeout-pd-test', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-custom-route-timeout-pd-8b408578'}, [e2e-llm-inference-service] {'name': 'scheduler-managed-custom-route-35ef63b2'}, [e2e-llm-inference-service] {'name': 'workload-pd-cpu-custom-route-ti-2766b49d'}, [e2e-llm-inference-service] {'name': 'model-fb-opt-125m-custom-route-e92a9ea6'}]}, [e2e-llm-inference-service] 'status': None}, 900), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:21.706086] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:21.717686] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:22.717918] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:22.728691] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:23.728957] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:23.737000] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:24.737372] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:24.796535] end - ✅ in 0.059s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:25.796958] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:25.807712] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:26.808162] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:26.823861] end - ✅ in 0.015s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:27.824098] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:27.832361] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:28.832631] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:28.843726] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:29.844013] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:29.896174] end - ✅ in 0.052s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:30.896483] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:30.904319] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:31.904604] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:31.996133] end - ✅ in 0.091s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:32.996444] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:33.096969] end - ✅ in 0.100s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:34.097545] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:34.196926] end - ✅ in 0.099s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:35.197306] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:35.296927] end - ✅ in 0.099s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:36.297342] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:36.311306] end - ✅ in 0.014s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:37.311586] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:37.321312] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:38.321577] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:38.331852] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:39.332292] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:39.343665] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:40.344059] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:40.396150] end - ✅ in 0.052s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:41.396551] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:41.405771] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:42.406206] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:42.416463] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:43.416744] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:43.425722] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:44.426105] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:44.434489] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:45.434769] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:45.444095] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:46.444572] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:46.453620] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:47.453893] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:47.496476] end - ✅ in 0.042s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:48.496791] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:48.505483] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:49.505759] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:49.516960] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:50.517317] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:50.526676] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:51.526958] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:51.536630] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:52.537128] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:52.546509] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:53.546964] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:53.555987] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:54.556308] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:54.576077] end - ✅ in 0.019s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:55.576925] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:55.585553] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:32Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:56.585843] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:56.595672] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:57.596046] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:57.610742] end - ✅ in 0.014s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:58.611144] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:58.620415] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:56:59.620718] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:56:59.629871] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:00.630183] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:00.639207] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:01.639601] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:01.648289] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:02.648608] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:02.658909] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:03.659194] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:03.667930] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'RouterReady', 'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:04.668194] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:04.677100] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:05.677393] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:05.687288] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:06.687555] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:06.696624] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:07.696920] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:07.706567] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:08.706861] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:08.715701] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:09.716027] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:09.725893] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:10.726361] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:10.736927] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:11.737224] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:11.748358] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:12.748660] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:12.757904] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:13.758341] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:13.767777] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:14.768135] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:14.777089] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:15.777518] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:15.786876] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:16.787138] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:16.796521] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:17.796811] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:17.810863] end - ✅ in 0.014s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:18.811328] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:18.821442] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:19.821732] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:19.831217] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:20.831662] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:20.842611] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:21.842887] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:21.851758] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:22.852021] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:22.861421] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:23.861680] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:23.871334] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:24.871609] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:24.881715] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:25.881990] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:25.894010] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:26.894305] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:26.996628] end - ✅ in 0.102s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:27.997017] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:28.005633] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:29.005899] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:29.019712] end - ✅ in 0.014s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:30.020017] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:30.096544] end - ✅ in 0.076s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:31.096878] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:31.105774] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:32.106052] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:32.116721] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:33.117004] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:33.128604] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:34.129116] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:34.138806] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:35.139075] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:35.149388] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:36.149687] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:36.160116] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:37.160424] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:37.169556] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:38.169883] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:38.179541] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:39.179924] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:39.188880] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:40.189176] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:40.199987] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:41.200275] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:41.209687] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:42.210054] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:42.222512] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:43.222834] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:43.231869] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:44.232174] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:44.247011] end - ✅ in 0.015s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:45.247294] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:45.260108] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:46.260683] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:46.270624] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:47.270867] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:47.281124] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:48.281468] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:48.291199] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:49.291469] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:49.300742] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:50.301045] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:50.310116] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:51.310407] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:51.319308] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:52.319594] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:52.329703] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:53.330052] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:53.338943] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:54.339303] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:54.351075] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:55.351519] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:55.363078] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:56.363395] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:56.372225] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:57.372527] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:57.382326] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:58.382766] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:58.392199] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:59.392709] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:59.401912] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:00.402179] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:00.419001] end - ✅ in 0.017s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:01.419281] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:01.499925] end - ✅ in 0.080s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:02.500296] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:02.700136] end - ✅ in 0.200s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:03.700456] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:03.709680] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:04.710179] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:04.719838] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:05.720326] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:05.729476] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:06.729924] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:06.739771] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:07.740207] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:07.751642] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:08.752034] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:08.761270] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:09.761526] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:09.770577] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:10.770957] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:10.780339] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:11.780626] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:11.790217] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:12.790575] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:12.799482] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:13.799962] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:13.808586] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:14.808883] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:14.818761] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:15.819074] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:15.827766] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:16.828065] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:16.837295] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:17.837672] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:17.846701] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:18.847093] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:18.856308] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:19.856636] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:19.866218] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:20.866545] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:20.875705] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:21.876024] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:21.886202] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:22.886634] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:22.899803] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:23.900274] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:23.910536] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:24.910888] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:24.920081] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:25.920599] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:25.930056] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:26.930476] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:26.940528] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:27.940953] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:27.950888] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:28.951184] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:28.964394] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:29.964835] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:29.975081] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:30.975457] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:30.984203] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:31.984609] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:31.994671] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:32.995135] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:33.004409] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:34.004739] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:34.014084] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:35.014364] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:35.025067] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:36.025442] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:36.035039] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:37.035634] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:37.044875] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:38.045286] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:38.056817] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:39.057198] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:39.066892] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:40.067322] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:40.077815] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:41.078281] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:41.089868] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:42.090304] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:42.100418] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:43.100674] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:43.113429] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:44.113719] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:44.124009] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:45.124311] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:45.133959] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:46.134529] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:46.145378] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:47.145665] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:47.166327] end - ✅ in 0.020s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:48.166610] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:48.175424] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:49.175826] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:49.186548] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:50.186922] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:50.195849] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:51.197161] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:51.208931] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:52.209452] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:52.220521] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:53.220806] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:53.234346] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:54.234615] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:54.244184] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:55.244599] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:55.253667] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:56.254100] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:56.263001] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:57.263535] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:57.272562] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:58.272820] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:58.281734] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:59.282018] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:59.292488] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:00.292787] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:00.302144] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:01.302634] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:01.312476] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:02.312821] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:02.322225] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:03.322753] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:03.332302] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:04.332728] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:04.341849] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:05.342156] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:05.350931] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:06.351291] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:06.366326] end - ✅ in 0.015s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:07.366791] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:07.376069] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:08.376501] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:08.385741] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:09.386089] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:09.395439] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:10.395999] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:10.405538] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:11.405846] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:11.415395] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:12.415724] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:12.424876] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:13.425209] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:13.434222] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:14.434653] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:14.444108] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:15.444382] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:15.453673] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:16.454051] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:16.463929] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:17.464309] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:17.480120] end - ✅ in 0.016s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:18.480432] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:18.490958] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:19.491487] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:19.501296] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:20.501574] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:20.510808] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:21.511120] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:21.520428] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:22.520729] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:22.530205] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:23.530702] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:23.539838] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:24.540321] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:24.556643] end - ✅ in 0.016s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:25.556928] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:25.566549] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:26.566946] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:26.576028] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:27.576513] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:27.585205] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:28.585687] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:28.594192] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:29.594593] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:29.604031] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:30.604660] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:30.614020] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:31.614341] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:31.629207] end - ✅ in 0.015s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:32.629684] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:32.638800] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:33.639093] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:33.648563] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:34.648871] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:34.658387] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:35.658816] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:35.668603] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:36.668921] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:36.678670] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:37.678991] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:37.688730] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:38.689027] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:38.698549] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:39.698954] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:39.708423] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:40.708855] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:40.718890] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:41.719208] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:41.729177] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:42.729487] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:42.738102] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:43.738428] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:43.751722] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:44.751986] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:44.760712] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:45.761045] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:45.769873] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:46.770142] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:46.778967] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:47.779310] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:47.788568] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:48.788954] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:48.797952] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:49.798288] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:49.806815] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:50.807141] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:50.816400] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:51.816643] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:51.825947] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:52.826208] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:52.835545] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:53.835801] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:53.845985] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:54.846558] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:54.858388] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:55.858677] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:55.869633] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:56.869933] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:56.879587] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:57.879838] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:57.890835] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:58.891120] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:58.899729] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:59.900006] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:59.909098] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:00.909594] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:00.918775] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:01.919008] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:01.928011] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:02.928281] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:02.937578] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:03.937931] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:03.946736] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:04.947036] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:04.955731] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:05.956074] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:05.966035] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:06.966568] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:06.975917] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:07.976250] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:07.987952] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:08.988285] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:08.999608] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:09.999907] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:10.009753] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:11.010284] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:11.021832] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:12.022258] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:12.031619] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:13.032063] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:13.040744] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:14.041020] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:14.050796] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:15.051264] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:15.060214] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:16.060529] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:16.069808] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:17.070299] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:17.082909] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:18.083325] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:18.092604] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:19.092903] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:19.104692] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:20.104966] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:20.124831] end - ✅ in 0.020s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:21.125115] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:21.134854] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:22.135156] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:22.146772] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:23.147035] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:23.156489] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:24.156775] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:24.165516] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:25.165807] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:25.175508] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:26.175820] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:26.184366] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:27.184740] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:27.194188] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:28.194496] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:28.207994] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:29.208506] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:29.217815] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:30.218125] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:30.233854] end - ✅ in 0.015s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:31.234175] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:31.244781] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:32.245061] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:32.256682] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:33.256967] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:33.269381] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:34.269666] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:34.278918] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:35.279192] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:35.289866] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:36.290145] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:36.299396] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:37.299702] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:37.308611] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:38.309066] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:38.318563] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:39.318843] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:39.329069] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:40.329310] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:40.339619] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:41.340062] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:41.351425] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:42.351826] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:42.361584] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:43.361832] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:43.370707] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:44.370993] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:44.382874] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:45.383261] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:45.393465] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:46.393769] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:46.403625] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:47.403910] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:47.412714] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:48.412995] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:48.421849] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:49.422162] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:49.434724] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:50.435174] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:50.445343] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:51.445622] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:51.455130] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:52.455718] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:52.464290] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:53.464557] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:53.476847] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:54.477158] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:54.490798] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:55.491206] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:55.504126] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:56.504656] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:56.513700] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:57.514007] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:57.523511] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:58.523932] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:58.535022] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:59.535540] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:59.545070] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:00.545353] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:00.553953] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:01.554413] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:01.563296] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:02.563575] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:02.574463] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:03.574795] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:03.584892] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:04.585165] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:04.594730] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:05.595019] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:05.606346] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:06.606786] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:06.615891] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:07.616216] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:07.625463] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:08.625735] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:08.635288] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:09.635692] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:09.645049] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:10.645298] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:10.655443] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:11.655847] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:11.665826] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:12.666150] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:12.675071] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:13.675312] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:13.684836] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:14.685210] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:14.694802] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:15.695300] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:15.704371] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:16.704644] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:16.713924] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:17.714296] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:17.734007] end - ✅ in 0.019s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:18.734293] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:18.743532] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:19.743879] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:19.758640] end - ✅ in 0.014s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:20.759026] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:20.767530] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:21.767819] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:21.778184] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:22.778524] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:22.788005] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:23.788467] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:23.809453] end - ✅ in 0.021s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:24.809741] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:24.819465] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:25.819748] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:25.831599] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:26.831871] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:26.841322] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:27.841614] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:27.851569] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:28.851821] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:28.860381] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:29.860673] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:29.870566] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:30.870822] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:30.879691] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:31.880038] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:31.892495] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:32.892815] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:32.902586] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:33.902866] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:33.911717] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:34.912164] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:34.920465] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:35.920728] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:35.929483] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:36.929783] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:36.938994] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:37.939466] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:37.948416] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:38.948747] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:38.957447] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:39.957722] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:39.966785] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:40.967072] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:40.976774] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:41.977055] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:41.986179] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:42.986511] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:42.995578] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:43.995937] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:44.004352] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:45.004648] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:45.012995] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:46.013308] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:46.022447] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:47.022760] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:47.033050] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:48.033403] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:48.042749] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:49.043322] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:49.051987] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:50.052291] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:50.060809] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:51.061132] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:51.069768] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:52.070036] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:52.078459] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:53.078765] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:53.088132] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:54.088397] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:54.096986] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:55.097311] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:55.106306] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:56.106631] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:56.115066] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:57.115376] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:57.124133] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:58.124443] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:58.133185] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:59.133557] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:59.142219] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:00.142497] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:00.153780] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:01.154062] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:01.163053] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:02.163327] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:02.172567] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:03.172849] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:03.182640] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:04.182922] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:04.192590] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:05.192836] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:05.201395] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:06.201688] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:06.211794] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:07.212154] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:07.221270] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:08.221568] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:08.231507] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:09.231855] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:09.241670] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:10.241941] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:10.251568] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:11.251837] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:11.262491] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:12.262830] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:12.271840] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:13.272155] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:13.281407] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:14.281848] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:14.291499] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:15.292062] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:15.301557] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:16.301984] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:16.311780] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:17.312283] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:17.321754] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:18.322013] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:18.331211] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:19.331667] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:19.340589] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:20.341149] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:20.350342] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:21.350642] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:21.359297] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:22.359630] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:22.368168] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:23.368458] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:23.378058] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:24.378350] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:24.387848] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:25.388248] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:25.397689] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:26.398126] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:26.407382] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:27.407807] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:27.417214] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:28.417510] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:28.429903] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:29.430314] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:29.439177] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:30.439502] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:30.451499] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:31.451781] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:31.460643] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:32.460976] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:32.471033] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:33.471529] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:33.481399] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:34.481676] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:34.492488] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:35.492804] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:35.503660] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:36.504029] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:36.517675] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:37.517949] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:37.526000] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:38.526309] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:38.534970] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:39.535323] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:39.544687] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:40.544982] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:40.554357] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:41.554833] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:41.564620] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:42.564899] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:42.574623] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:43.574902] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:43.584648] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:44.584930] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:44.594589] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:45.594928] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:45.604287] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:46.604778] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:46.614324] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:47.614792] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:47.623817] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:48.624092] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:48.634080] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:49.634462] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:49.643861] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:50.644120] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:50.653963] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:51.654216] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:51.662746] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:52.663014] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:52.671700] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:53.672050] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:53.680999] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:54.681391] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:54.691958] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:55.692649] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:55.708616] end - ✅ in 0.016s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:56.708925] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:56.719712] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:57.720178] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:57.730196] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:58.730608] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:58.744289] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:59.744733] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:59.754498] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:00.754787] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:00.763482] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:01.763755] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:01.773467] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:02.773786] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:02.782845] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:03.783214] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:03.798513] end - ✅ in 0.015s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:04.798804] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:04.808558] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:05.808904] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:05.818612] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:06.818890] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:06.829340] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:07.829659] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:07.839690] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:08.839997] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:08.854713] end - ✅ in 0.014s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:09.855029] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:09.863673] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:10.863961] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:10.873303] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:11.873580] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:11.883348] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:12.883621] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:12.893163] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:13.893491] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:13.902012] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:14.902317] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:14.910950] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:15.911315] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:15.921941] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:16.922223] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:16.939602] end - ✅ in 0.017s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:17.939877] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:17.950975] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:18.951254] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:18.961368] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:19.961862] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:19.970845] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:20.971113] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:20.980791] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:21.981065] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:21.989755] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:22.990022] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:22.999497] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:23.999808] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:24.009919] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:25.010253] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:25.021076] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:26.021434] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:26.030223] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:27.030616] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:27.039584] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:28.039855] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:28.051639] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:29.051937] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:29.061125] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:30.061394] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:30.074586] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:31.075002] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:31.083633] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:32.083932] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:32.092520] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:33.092831] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:33.101983] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:34.102592] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:34.111206] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:35.111482] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:35.120194] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:36.120477] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:36.129640] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:37.129933] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:37.139370] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:38.139722] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:38.148994] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:39.149457] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:39.158356] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:40.158636] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:40.169719] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:41.170021] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:41.180852] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:42.181246] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:42.196296] end - ✅ in 0.015s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:43.196551] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:43.208017] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:44.208269] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:44.220014] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:45.220313] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:45.231881] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:46.232177] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:46.251637] end - ✅ in 0.019s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:47.251930] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:47.267411] end - ✅ in 0.015s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:48.267706] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:48.280616] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:49.280937] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:49.293894] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:50.294204] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:50.303585] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:51.303937] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:51.313357] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:52.313657] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:52.322448] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:53.322749] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:53.332559] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:54.332874] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:54.342088] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:55.342411] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:55.353343] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:56.353642] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:56.362842] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:57.363129] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:57.372405] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:58.372782] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:58.382178] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:59.382541] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:59.391862] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:00.392220] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:00.405185] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:01.405484] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:01.416683] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:02.417137] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:02.427873] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:03.428249] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:03.436791] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:04.437113] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:04.446280] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:05.446608] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:05.456602] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:06.456922] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:06.467697] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:07.468104] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:07.477916] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:08.478396] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:08.488318] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:09.488758] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:09.497947] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:10.498514] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:10.507873] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:11.508285] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:11.517469] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:12.517727] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:12.527440] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:13.527734] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:13.536581] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:14.536856] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:14.545944] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:15.546314] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:15.557596] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:16.557841] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:16.571088] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:17.571535] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:17.581899] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:18.582309] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:18.593385] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:19.593772] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:19.605070] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:20.605546] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:20.616227] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:21.616727] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:21.626855] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:22.627134] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:22.637515] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:23.637816] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:23.647862] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:24.648135] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:24.657880] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:25.658302] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:25.667874] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:26.668148] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:26.677473] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:27.677923] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:27.687773] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:28.688083] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:28.697471] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:29.697896] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:29.706502] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:30.706852] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:30.715844] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:31.716328] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:31.726403] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:32.726706] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:32.736821] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:33.737196] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:33.748750] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:34.749025] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:34.758392] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:35.758712] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:35.768731] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:36.769161] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:36.783011] end - ✅ in 0.014s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:37.783290] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:37.792221] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:38.792530] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:38.801879] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:39.802401] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:39.811049] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:40.811485] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:40.820358] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:41.820657] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:41.829973] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:42.830440] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:42.839550] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:43.839871] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:43.849214] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:44.849590] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:44.860462] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:45.860771] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:45.869849] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:46.870300] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:46.880493] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:47.880775] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:47.891783] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:48.892046] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:48.901462] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:49.901739] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:49.911074] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:50.911584] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:50.920429] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:51.920734] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:51.930906] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:52.931333] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:52.940525] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:53.940812] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:53.949730] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:54.949965] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:54.960003] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:55.960394] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:55.969788] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:56.970046] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:56.981957] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:57.982215] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:57.990879] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:58.991179] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:59.000936] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:00.001284] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:00.010497] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:01.010885] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:01.020565] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:02.021030] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:02.030109] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:03.030406] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:03.039527] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:04.039867] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:04.048159] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:05.048497] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:05.057854] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:06.058345] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:06.067362] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:07.067677] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:07.076052] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:08.076539] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:08.085741] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:09.086178] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:09.095220] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:10.095682] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:10.104556] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:11.104832] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:11.113483] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:12.113796] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:12.122274] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:13.122579] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:13.131832] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:14.132301] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:14.141824] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:15.142301] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:15.151650] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:16.152138] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:16.160156] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:17.160507] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:17.170747] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:18.171207] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:18.180558] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:19.180828] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:19.189700] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:20.189980] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:20.198612] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:21.198884] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:21.211283] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:22.211795] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:22.227964] end - ✅ in 0.016s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:23.228218] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:23.236032] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:24.236403] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:24.246191] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:25.246495] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:25.255037] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:26.255398] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:26.264688] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:27.264960] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:27.275616] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:28.275958] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:28.284744] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:29.285027] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:29.294691] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:30.295027] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:30.304131] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:31.304596] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:31.313871] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:32.314208] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:32.323056] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:33.323537] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:33.332132] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:34.332437] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:34.341451] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:35.341885] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:35.350540] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:36.350794] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:36.360967] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:37.361289] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:37.370886] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:38.371266] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:38.380896] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:39.381288] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:39.390377] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:40.390777] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:40.401391] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:41.401701] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:41.410921] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:42.411388] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:42.420961] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:43.421392] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:43.430158] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:44.430482] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:44.439478] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:45.439743] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:45.449381] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:46.449667] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:46.459653] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:47.460027] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:47.468989] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:48.469500] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:48.478725] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:49.479216] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:49.488078] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:50.488539] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:50.497217] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:51.497624] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:51.505957] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:52.506205] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:52.515372] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:53.515749] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:53.524728] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:54.525006] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:54.533798] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:55.534127] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:55.543646] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:56.543937] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:56.553980] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:57.554309] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:57.564170] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:58.564689] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:58.574594] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:59.574907] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:59.583814] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:00.584292] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:00.592867] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:01.593152] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:01.602830] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:02.603118] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:02.614486] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:03.614965] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:03.623722] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:04.624018] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:04.633393] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:05.633845] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:05.643112] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:06.643465] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:06.652278] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:07.652608] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:07.661867] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:08.662203] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:08.671287] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:09.671601] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:09.680261] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:10.680610] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:10.689430] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:11.689838] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:11.698870] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:12.699317] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:12.708143] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:13.708447] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:13.717153] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:14.717462] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:14.731435] end - ✅ in 0.014s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:15.731749] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:15.747083] end - ✅ in 0.015s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:16.747540] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:16.757094] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:17.757378] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:17.766549] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:18.766914] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:18.776128] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:19.776546] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:19.785921] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:20.786285] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:20.795382] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:21.795661] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:21.804525] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:22.804799] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:22.814399] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:23.814766] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:23.824354] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:24.824848] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:24.833972] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:25.834448] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:25.844332] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:26.844714] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:26.853489] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:27.853755] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:27.863646] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:28.864167] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:28.873104] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:29.873609] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:29.883113] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:30.883424] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:30.892137] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:31.892447] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:31.901506] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:32.901838] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:32.911805] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:33.912058] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:33.921866] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:34.922155] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:34.931220] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:35.931554] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:35.940482] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:36.940757] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:36.949939] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:37.950286] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:37.958600] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:38.958952] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:38.968297] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:39.968589] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:39.977357] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:40.977771] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:40.991374] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:41.991679] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:42.000697] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:43.001081] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:43.009761] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:44.010299] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:44.019780] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:45.020208] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:45.031333] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:46.031653] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:46.041227] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:47.041506] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:47.058195] end - ✅ in 0.016s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:48.058767] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:48.068161] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:49.068741] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:49.077753] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:50.078206] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:50.087130] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:51.087611] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:51.096617] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:52.096929] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:52.105528] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:53.105807] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:53.114711] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:54.115122] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:54.124011] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:55.124548] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:55.134161] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:56.134613] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:56.143623] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:57.143884] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:57.152224] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:58.152555] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:58.161016] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:59.161315] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:59.170604] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:00.170894] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:00.179902] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:01.180411] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:01.189438] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:02.189854] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:02.200377] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:03.200649] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:03.210360] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:04.210847] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:04.219755] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:05.220021] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:05.229514] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:06.230020] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:06.241640] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:07.241952] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:07.250392] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:08.250858] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:08.260105] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:09.260406] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:09.268920] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:10.269191] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:10.278116] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:11.278414] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:11.287668] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:12.288066] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:12.296899] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:13.297223] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:13.306372] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:14.306794] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:14.315854] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:15.316256] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:15.324669] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:16.324963] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:16.334185] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:17.334502] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:17.343540] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:18.343915] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:18.352625] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:19.352887] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:19.361753] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:20.362225] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:20.371753] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:21.372018] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:21.381394] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:22.381650] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:22.390371] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:23.390660] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:23.399492] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:24.399770] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:24.408724] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:25.409020] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:25.418685] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:26.419018] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:26.428599] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:27.428875] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:27.439668] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:28.439983] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:28.449061] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:29.449605] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:29.459400] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:30.459930] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:30.469882] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:31.470297] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:31.480050] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:32.480539] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:32.489761] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:33.490067] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:33.499154] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:34.499657] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:34.508997] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:35.509432] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:35.518563] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:36.518923] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:36.529570] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:37.529866] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:37.539703] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:38.540056] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:38.548754] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:39.549073] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:39.558086] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:40.558589] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:40.567753] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:41.568304] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:41.577623] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:42.578068] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:42.587067] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:43.587351] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:43.596172] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:44.596494] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:44.605358] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:45.605669] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:45.615725] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:46.616029] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:46.626842] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:47.627250] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:47.635792] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:48.636265] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:48.645189] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:49.645487] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:49.654319] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:50.654598] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:50.663312] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:51.663591] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:51.675854] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:52.676297] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:52.685616] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:53.685925] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:53.694621] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:54.695001] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:54.703873] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:55.704312] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:55.714948] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:56.715500] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:56.724522] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:57.724799] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:57.733926] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:58.734428] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:58.743365] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:59.743707] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:59.752730] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:00.753025] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:00.762395] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:01.762855] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:01.771814] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:02.772124] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:02.781141] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:03.781477] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:03.790917] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:04.791304] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:04.799342] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:05.799654] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:05.808918] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:06.809221] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:06.818101] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:07.818535] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:07.827432] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:08.827894] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:08.837205] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:09.837645] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:09.846903] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:10.847191] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:10.856119] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:11.856446] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:11.865802] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:12.866138] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:12.875218] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:13.875558] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:13.884077] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:14.884388] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:14.893607] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:15.894079] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:15.904307] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:16.904612] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:16.914030] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:17.914309] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:17.923168] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:18.923502] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:18.931978] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:19.932314] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:19.941482] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:20.941886] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:20.951205] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:21.951498] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:21.962931] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:22.963410] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:22.977869] end - ✅ in 0.014s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:23.978190] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:23.987286] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:24.987575] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:24.998463] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:25.998742] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:26.012310] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:27.012576] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:27.025072] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:28.025414] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:28.034466] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:29.034752] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:29.044425] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:30.044696] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:30.055810] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:31.056135] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:31.149328] end - ✅ in 0.093s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:32.149641] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:32.158942] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:33.159495] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:33.168359] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:34.168666] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:34.178390] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:35.178774] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:35.188329] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:36.188796] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:36.198348] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:37.198825] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:37.208370] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:38.208784] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:38.217820] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:39.218107] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:39.231357] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:40.231820] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:40.242199] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:41.242707] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:41.251597] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:42.252089] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:42.261104] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:43.261435] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:43.270589] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:44.271000] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:44.279976] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:45.280224] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:45.289080] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:46.289425] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:46.298021] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:47.298316] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:47.307084] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:48.307397] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:48.316574] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:49.317026] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:49.330869] end - ✅ in 0.014s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:50.331461] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:50.341053] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:51.341350] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:51.352045] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:52.352349] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:52.361130] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:53.361403] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:53.372069] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:54.372431] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:54.381444] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:55.381726] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:55.391439] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:56.391728] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:56.400567] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:57.400832] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:57.409513] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:58.409960] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:58.419223] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:59.419560] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:59.428491] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:00.428772] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:00.438322] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:01.438665] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:01.447963] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:02.448482] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:02.458768] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:03.459171] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:03.468589] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:04.468869] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:04.477906] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:05.478226] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:05.487363] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:06.487688] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:06.496868] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:07.497279] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:07.506277] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:08.506596] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:08.516342] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:09.516789] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:09.526068] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:10.526559] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:10.535810] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:11.536061] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:11.545338] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:12.545820] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:12.555114] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:13.555564] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:13.564342] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:14.564826] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:14.574542] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:15.574975] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:15.584044] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:16.584298] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:16.593211] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:17.593537] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:17.602031] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:18.602303] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:18.613226] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:19.613664] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:19.622848] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:20.623271] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:20.633061] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:21.633333] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:21.642899] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:22.643279] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:22.651773] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:23.652077] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:23.661068] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:24.661452] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:24.670486] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:25.670886] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:25.680278] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:26.680559] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:26.689316] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:27.689586] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:27.699173] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:28.699583] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:28.708446] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:29.708724] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:29.717922] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:30.718421] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:30.730141] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:31.730597] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:31.739671] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:32.740038] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:32.748652] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:33.749096] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:33.757848] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:34.758270] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:34.767556] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:35.767822] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:35.776616] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:36.776887] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:36.785467] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:37.785734] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:37.794307] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:38.794812] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:38.803698] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:39.803995] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:39.813140] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:40.813642] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:40.822664] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:41.822941] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:41.831944] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:42.832274] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:42.841359] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:43.841635] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:43.850820] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:44.851104] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:44.859970] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:45.860282] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:45.868977] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:46.869293] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:46.878527] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:47.879029] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:47.888151] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:48.888489] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:48.897111] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:49.897435] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:49.906556] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:50.907032] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:50.916892] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:51.917195] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:51.926065] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:52.926358] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:52.935092] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:53.935405] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:53.946847] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:54.947214] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:54.956120] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:55.956431] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:55.965368] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:56.965686] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:56.974786] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:57.975270] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:57.984122] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:58.984397] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:58.992964] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:59.993257] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:00.001643] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:01.001950] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:01.012475] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:02.012755] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:02.021665] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:03.022060] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:03.030448] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:04.030715] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:04.039559] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:05.039845] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:05.048579] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:06.048868] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:06.057951] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:07.058296] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:07.067536] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:08.067816] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:08.084153] end - ✅ in 0.016s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:09.084468] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:09.093507] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:10.093772] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:10.106356] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:11.106715] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:11.115726] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:12.116011] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:12.124792] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:13.125207] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:13.134155] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:14.134666] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:14.143810] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:15.144066] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:15.153031] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:16.153337] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:16.163508] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:17.163917] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:17.174182] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:18.174682] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:18.183856] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:19.184128] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:19.194459] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:20.194909] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:20.203848] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:21.204132] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:21.213472] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:22.213923] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:22.224420] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:23.224847] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:23.233414] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:24.233721] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:24.243650] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:25.244072] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:25.254770] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:26.255182] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:26.265023] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:27.265308] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:27.277212] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:28.277517] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:28.286998] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:29.287315] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:29.299405] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:30.300031] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:30.310196] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:31.310505] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:31.319859] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:32.320189] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:32.329285] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:33.329577] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:33.339795] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:34.340071] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:34.348335] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:35.348605] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:35.357669] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:36.357947] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:36.366767] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:37.367065] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:37.375669] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:38.375998] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:38.384949] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:39.385225] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:39.393464] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:40.393735] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:40.402273] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:41.402539] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:41.410731] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:42.411016] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:42.419627] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:43.419932] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:43.428582] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:44.428855] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:44.438773] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:45.439168] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:45.451648] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:46.451953] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:46.461174] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:47.461729] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:47.470972] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:48.471434] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:48.480484] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:49.480862] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:49.490723] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:50.491005] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:50.500551] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:51.500913] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:51.513544] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:52.513862] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:52.522845] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:53.523171] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:53.532426] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:54.532861] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:54.542384] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:55.542709] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:55.550615] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:56.550886] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:56.559792] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:57.560083] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:57.569543] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:58.569956] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:58.581860] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:59.582150] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:59.590994] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:00.591281] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:00.600100] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:01.600406] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:01.610292] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:02.610598] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:02.619413] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:03.619736] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:03.628265] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:04.628547] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:04.638334] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:05.638649] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:05.648284] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:06.648562] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:06.657257] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:07.657552] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:07.666719] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:08.667087] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:08.677703] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:09.678082] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:09.687049] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:10.687565] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:10.697201] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:11.697624] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:11.706667] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:12.707098] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:12.716656] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:13.716954] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:13.726063] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:14.726580] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:14.735561] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:15.735848] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:15.745128] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:16.745631] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:16.754647] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:17.754895] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:17.765223] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:18.765558] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:18.781305] end - ✅ in 0.015s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:19.781763] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:19.790328] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:20.790759] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:20.800395] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:21.800806] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:21.809921] end - ✅ in 0.009s [e2e-llm-inference-service] ERROR e2e.llmisvc.logging:logging.py:48 [wait_for_llm_isvc_ready] [2026-04-24T22:11:21.810046] end - ❌ 900.104s: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:21.810172] start - args=(, 'custom-route-timeout-pd-test', 'kserve-ci-e2e-test'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:21.818164] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [delete_llmisvc] [2026-04-24T22:11:24.006447] start - args=(, {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security.opendatahub.io/enable-auth': 'false'}, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'custom-route-timeout-pd-test', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-custom-route-timeout-pd-8b408578'}, [e2e-llm-inference-service] {'name': 'scheduler-managed-custom-route-35ef63b2'}, [e2e-llm-inference-service] {'name': 'workload-pd-cpu-custom-route-ti-2766b49d'}, [e2e-llm-inference-service] {'name': 'model-fb-opt-125m-custom-route-e92a9ea6'}]}, [e2e-llm-inference-service] 'status': None}), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [delete_llmisvc] [2026-04-24T22:11:24.037569] end - ✅ in 0.030s [e2e-llm-inference-service] ERROR e2e.llmisvc.logging:logging.py:48 [test_llm_inference_service] [2026-04-24T22:11:24.037752] end - ❌ 902.407s: Missing true conditions: {'WorkloadsReady', 'Ready'}, expected {'RouterReady', 'WorkloadsReady', 'Ready'}, got [{'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:59:11Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:57:04Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:56:55Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] _ test_llm_inference_service[router-managed-workload-simulated-dp-ep-cpu-model-fb-opt-125m] _ [e2e-llm-inference-service] [gw1] linux -- Python 3.11.13 /workspace/source/python/kserve/.venv/bin/python [e2e-llm-inference-service] [e2e-llm-inference-service] test_case = TestCase(base_refs=['router-managed', 'workload-simulated-dp-ep-cpu', 'model-fb-opt-125m'], prompt='This test simulate... {'name': 'model-fb-opt-125m-llmisvc-model-e16aaf34'}]}, [e2e-llm-inference-service] 'status': None}, model_name='facebook/opt-125m') [e2e-llm-inference-service] [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] @pytest.mark.asyncio(loop_scope="session") [e2e-llm-inference-service] @pytest.mark.parametrize( [e2e-llm-inference-service] "test_case", [e2e-llm-inference-service] [ [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-with-gateway-ref", [e2e-llm-inference-service] "router-with-managed-route", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] endpoint="/v1/completions", [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] payload_formatter=completions_payload, [e2e-llm-inference-service] response_assertion=create_response_assertion(with_field="choices"), [e2e-llm-inference-service] before_test=[ [e2e-llm-inference-service] lambda: create_router_resources( [e2e-llm-inference-service] gateways=[ROUTER_GATEWAYS[0]], [e2e-llm-inference-service] ) [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] pytest.mark.custom_gateway, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] payload_formatter=completions_payload, [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-custom-route-timeout", [e2e-llm-inference-service] "scheduler-managed", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="custom-route-timeout-test", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-with-refs", [e2e-llm-inference-service] "scheduler-managed", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="router-with-refs-test", [e2e-llm-inference-service] before_test=[ [e2e-llm-inference-service] lambda: create_router_resources( [e2e-llm-inference-service] gateways=[ROUTER_GATEWAYS[0]], [e2e-llm-inference-service] routes=[ROUTER_ROUTES[0], ROUTER_ROUTES[1]], [e2e-llm-inference-service] ) [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.custom_gateway, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=["router-managed", "workload-pd-cpu", "model-fb-opt-125m"], [e2e-llm-inference-service] prompt="You are an expert in Kubernetes-native machine learning serving platforms, with deep knowledge of the KServe project. " [e2e-llm-inference-service] "Explain the challenges of serving large-scale models, GPU scheduling, and how KServe integrates with capabilities like multi-model serving. " [e2e-llm-inference-service] "Provide a detailed comparison with open source alternatives, focusing on operational trade-offs.", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-custom-route-timeout-pd", [e2e-llm-inference-service] "scheduler-managed", [e2e-llm-inference-service] "workload-pd-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="You are an expert in Kubernetes-native machine learning serving platforms, with deep knowledge of the KServe project. " [e2e-llm-inference-service] "Explain the challenges of serving large-scale models, GPU scheduling, and how KServe integrates with capabilities like multi-model serving. " [e2e-llm-inference-service] "Provide a detailed comparison with open source alternatives, focusing on operational trade-offs.", [e2e-llm-inference-service] service_name="custom-route-timeout-pd-test", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-with-refs-pd", [e2e-llm-inference-service] "scheduler-managed", [e2e-llm-inference-service] "workload-pd-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="You are an expert in Kubernetes-native machine learning serving platforms, with deep knowledge of the KServe project. " [e2e-llm-inference-service] "Explain the challenges of serving large-scale models, GPU scheduling, and how KServe integrates with capabilities like multi-model serving. " [e2e-llm-inference-service] "Provide a detailed comparison with open source alternatives, focusing on operational trade-offs.", [e2e-llm-inference-service] service_name="router-with-refs-pd-test", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] before_test=[ [e2e-llm-inference-service] lambda: create_router_resources( [e2e-llm-inference-service] gateways=[ROUTER_GATEWAYS[1]], [e2e-llm-inference-service] routes=[ROUTER_ROUTES[2], ROUTER_ROUTES[3]], [e2e-llm-inference-service] ) [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.custom_gateway, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-dp-ep-gpu", [e2e-llm-inference-service] "workload-dp-ep-prefill-gpu", [e2e-llm-inference-service] "model-deepseek-v2-lite", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="Delve into the multifaceted implications of a fully disaggregated cloud architecture, specifically " [e2e-llm-inference-service] "where the compute plane (P) and the data plane (D) are independently deployed and managed for a " [e2e-llm-inference-service] "geographically distributed, high-throughput, low-latency microservices ecosystem. Beyond the " [e2e-llm-inference-service] "fundamental challenges of network latency and data consistency, elaborate on the advanced " [e2e-llm-inference-service] "considerations and trade-offs inherent in such a setup: 1. Network Architecture and Protocols: " [e2e-llm-inference-service] "How would the network fabric and underlying protocols (e.g., RDMA, custom transport layers) need to " [e2e-llm-inference-service] "evolve to support optimal performance and minimize inter-plane communication overhead, especially for " [e2e-llm-inference-service] "synchronous operations? Discuss the role of network programmability (e.g., SDN, P4) in dynamically " [e2e-llm-inference-service] "optimizing routing and traffic flow between P and D. 2. Advanced Data Consistency and Durability: " [e2e-llm-inference-service] "Explore sophisticated data consistency models (e.g., causal consistency, strong eventual consistency) " [e2e-llm-inference-service] "and their applicability in balancing performance and data integrity across a globally distributed data plane. " [e2e-llm-inference-service] "Detail strategies for ensuring data durability and fault tolerance, including multi-region replication, " [e2e-llm-inference-service] "intelligent partitioning, and recovery mechanisms in the event of partial or full plane failures. " [e2e-llm-inference-service] "3. Dynamic Resource Orchestration and Cost Optimization: Analyze how an orchestration layer would intelligently " [e2e-llm-inference-service] "manage the independent scaling of compute (P) and data (D) resources, considering fluctuating workloads, " [e2e-llm-inference-service] "cost efficiency, and performance targets (e.g., using predictive analytics for resource provisioning). " [e2e-llm-inference-service] "Discuss mechanisms for dynamically reallocating compute nodes to different data partitions based on " [e2e-llm-inference-service] "workload patterns and data locality, potentially involving live migration strategies. " [e2e-llm-inference-service] "4. Security and Compliance in a Distributed Landscape: Address the enhanced security perimeter " [e2e-llm-inference-service] "challenges, including securing communication channels between P and D (encryption in transit, mutual TLS), " [e2e-llm-inference-service] "fine-grained access control to data at rest and in motion, and identity management across disaggregated " [e2e-llm-inference-service] "components. Discuss how such an architecture impacts compliance with regulatory frameworks (e.g., GDPR, HIPAA) " [e2e-llm-inference-service] "concerning data sovereignty, privacy, and auditability. 5. Operational Complexity and Observability: " [e2e-llm-inference-service] "Examine the increased complexity in monitoring, logging, and tracing across highly decoupled compute and " [e2e-llm-inference-service] "data planes. What specialized tooling and practices (e.g., distributed tracing with OpenTelemetry, advanced AIOps) " [e2e-llm-inference-service] "would be essential? How would incident response and troubleshooting differ in this disaggregated environment " [e2e-llm-inference-service] "compared to traditional integrated systems? Consider the challenges of pinpointing root causes across " [e2e-llm-inference-service] "independent failures. 6. Real-world Applicability and Future Trends: Identify specific industries " [e2e-llm-inference-service] "or use cases (e.g., high-frequency trading, IoT edge processing, large language model inference) " [e2e-llm-inference-service] "where the benefits of P/D disaggregation would strongly outweigh its complexities. " [e2e-llm-inference-service] "Conclude by speculating on emerging technologies or paradigms (e.g., serverless compute functions " [e2e-llm-inference-service] "directly interacting with object storage, in-memory disaggregation) that could further drive or " [e2e-llm-inference-service] "transform P/D disaggregation in cloud computing.", [e2e-llm-inference-service] max_tokens=2000, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_gpu, [e2e-llm-inference-service] pytest.mark.cluster_nvidia, [e2e-llm-inference-service] pytest.mark.cluster_nvidia_roce, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-no-scheduler", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="What is KServe?", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.no_scheduler, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-simulated-dp-ep-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="This test simulates DP+EP that can run on CPU, the idea is to test the LWS-based deployment, " [e2e-llm-inference-service] "but without the resources requirements for DP+EP (GPUs and ROCe/IB).", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_multi_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Scheduler config tests [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-with-inline-config", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="scheduler-inline-config-test", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-with-configmap-ref", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="scheduler-configmap-ref-test", [e2e-llm-inference-service] before_test=[create_scheduler_configmap], [e2e-llm-inference-service] after_test=[delete_scheduler_configmap], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-with-replicas", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="scheduler-ha-replicas-test", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Precise prefix KV cache routing test [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-with-precise-prefix-cache-inline-config", [e2e-llm-inference-service] "workload-llmd-simulator-kvcache", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="precise-prefix-cache-test", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] ], [e2e-llm-inference-service] indirect=["test_case"], [e2e-llm-inference-service] ids=generate_test_id, [e2e-llm-inference-service] ) [e2e-llm-inference-service] @log_execution [e2e-llm-inference-service] def test_llm_inference_service(test_case: TestCase): # noqa: F811 [e2e-llm-inference-service] inject_k8s_proxy() [e2e-llm-inference-service] [e2e-llm-inference-service] kserve_client = KServeClient( [e2e-llm-inference-service] config_file=os.environ.get("KUBECONFIG", "~/.kube/config"), [e2e-llm-inference-service] client_configuration=client.Configuration(), [e2e-llm-inference-service] ) [e2e-llm-inference-service] [e2e-llm-inference-service] service_name = test_case.llm_service.metadata.name [e2e-llm-inference-service] if not test_case.llm_service.metadata.annotations: [e2e-llm-inference-service] test_case.llm_service.metadata.annotations = {} [e2e-llm-inference-service] [e2e-llm-inference-service] test_case.llm_service.metadata.annotations[ [e2e-llm-inference-service] "security.opendatahub.io/enable-auth" [e2e-llm-inference-service] ] = "false" [e2e-llm-inference-service] [e2e-llm-inference-service] try: [e2e-llm-inference-service] create_llmisvc(kserve_client, test_case.llm_service) [e2e-llm-inference-service] > wait_for_llm_isvc_ready( [e2e-llm-inference-service] kserve_client, test_case.llm_service, test_case.wait_timeout [e2e-llm-inference-service] ) [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:410: [e2e-llm-inference-service] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [e2e-llm-inference-service] [e2e-llm-inference-service] args = (, {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kin...pu-ll-8bd4fbf5'}, [e2e-llm-inference-service] {'name': 'model-fb-opt-125m-llmisvc-model-e16aaf34'}]}, [e2e-llm-inference-service] 'status': None}, 900) [e2e-llm-inference-service] kwargs = {}, func_name = 'wait_for_llm_isvc_ready' [e2e-llm-inference-service] timestamp_start = '2026-04-24T21:57:27.165516', start_time = 1777067847.1657755 [e2e-llm-inference-service] duration = 900.2086465358734, timestamp_end = '2026-04-24T22:12:27.374426' [e2e-llm-inference-service] [e2e-llm-inference-service] @functools.wraps(func) [e2e-llm-inference-service] def wrapper(*args, **kwargs): [e2e-llm-inference-service] func_name = func.__name__ [e2e-llm-inference-service] [e2e-llm-inference-service] timestamp_start = datetime.now().isoformat() [e2e-llm-inference-service] logger.info( [e2e-llm-inference-service] f"[{func_name}] [{timestamp_start}] start - args={args}, kwargs={kwargs}" [e2e-llm-inference-service] ) [e2e-llm-inference-service] start_time = time.time() [e2e-llm-inference-service] [e2e-llm-inference-service] try: [e2e-llm-inference-service] > result = func(*args, **kwargs) [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/logging.py:40: [e2e-llm-inference-service] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [e2e-llm-inference-service] [e2e-llm-inference-service] kserve_client = [e2e-llm-inference-service] given = {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security....p-ep-cpu-ll-8bd4fbf5'}, [e2e-llm-inference-service] {'name': 'model-fb-opt-125m-llmisvc-model-e16aaf34'}]}, [e2e-llm-inference-service] 'status': None} [e2e-llm-inference-service] timeout_seconds = 900 [e2e-llm-inference-service] [e2e-llm-inference-service] @log_execution [e2e-llm-inference-service] def wait_for_llm_isvc_ready( [e2e-llm-inference-service] kserve_client: KServeClient, [e2e-llm-inference-service] given: V1alpha1LLMInferenceService, [e2e-llm-inference-service] timeout_seconds: int = 900, [e2e-llm-inference-service] ) -> str: [e2e-llm-inference-service] def assert_llm_isvc_ready(): [e2e-llm-inference-service] out = get_llmisvc( [e2e-llm-inference-service] kserve_client, [e2e-llm-inference-service] given.metadata.name, [e2e-llm-inference-service] given.metadata.namespace, [e2e-llm-inference-service] given.api_version.split("/")[1], [e2e-llm-inference-service] ) [e2e-llm-inference-service] [e2e-llm-inference-service] if "status" not in out: [e2e-llm-inference-service] raise AssertionError("No status found in LLM inference service") [e2e-llm-inference-service] [e2e-llm-inference-service] status = out["status"] [e2e-llm-inference-service] if "conditions" not in status: [e2e-llm-inference-service] raise AssertionError("No conditions found in status") [e2e-llm-inference-service] [e2e-llm-inference-service] expected_true_conditions = {"Ready", "WorkloadsReady", "RouterReady"} [e2e-llm-inference-service] got_true_conditions = set() [e2e-llm-inference-service] [e2e-llm-inference-service] conditions = status["conditions"] [e2e-llm-inference-service] [e2e-llm-inference-service] for condition in conditions: [e2e-llm-inference-service] if condition.get("status") == "True": [e2e-llm-inference-service] got_true_conditions.add(condition.get("type")) [e2e-llm-inference-service] [e2e-llm-inference-service] missing_conditions = expected_true_conditions - got_true_conditions [e2e-llm-inference-service] if missing_conditions: [e2e-llm-inference-service] raise AssertionError( [e2e-llm-inference-service] f"Missing true conditions: {missing_conditions}, expected {expected_true_conditions}, got {conditions}" [e2e-llm-inference-service] ) [e2e-llm-inference-service] return True [e2e-llm-inference-service] [e2e-llm-inference-service] > return wait_for(assert_llm_isvc_ready, timeout=timeout_seconds, interval=1.0) [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:618: [e2e-llm-inference-service] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [e2e-llm-inference-service] [e2e-llm-inference-service] assertion_fn = .assert_llm_isvc_ready at 0x7f34d6444a40> [e2e-llm-inference-service] timeout = 900, interval = 1.0 [e2e-llm-inference-service] [e2e-llm-inference-service] def wait_for( [e2e-llm-inference-service] assertion_fn: Callable[[], Any], timeout: float = 5.0, interval: float = 0.1 [e2e-llm-inference-service] ) -> Any: [e2e-llm-inference-service] """Wait for the assertion to succeed within timeout.""" [e2e-llm-inference-service] deadline = time.time() + timeout [e2e-llm-inference-service] while True: [e2e-llm-inference-service] try: [e2e-llm-inference-service] > return assertion_fn() [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:628: [e2e-llm-inference-service] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [e2e-llm-inference-service] [e2e-llm-inference-service] def assert_llm_isvc_ready(): [e2e-llm-inference-service] out = get_llmisvc( [e2e-llm-inference-service] kserve_client, [e2e-llm-inference-service] given.metadata.name, [e2e-llm-inference-service] given.metadata.namespace, [e2e-llm-inference-service] given.api_version.split("/")[1], [e2e-llm-inference-service] ) [e2e-llm-inference-service] [e2e-llm-inference-service] if "status" not in out: [e2e-llm-inference-service] raise AssertionError("No status found in LLM inference service") [e2e-llm-inference-service] [e2e-llm-inference-service] status = out["status"] [e2e-llm-inference-service] if "conditions" not in status: [e2e-llm-inference-service] raise AssertionError("No conditions found in status") [e2e-llm-inference-service] [e2e-llm-inference-service] expected_true_conditions = {"Ready", "WorkloadsReady", "RouterReady"} [e2e-llm-inference-service] got_true_conditions = set() [e2e-llm-inference-service] [e2e-llm-inference-service] conditions = status["conditions"] [e2e-llm-inference-service] [e2e-llm-inference-service] for condition in conditions: [e2e-llm-inference-service] if condition.get("status") == "True": [e2e-llm-inference-service] got_true_conditions.add(condition.get("type")) [e2e-llm-inference-service] [e2e-llm-inference-service] missing_conditions = expected_true_conditions - got_true_conditions [e2e-llm-inference-service] if missing_conditions: [e2e-llm-inference-service] > raise AssertionError( [e2e-llm-inference-service] f"Missing true conditions: {missing_conditions}, expected {expected_true_conditions}, got {conditions}" [e2e-llm-inference-service] ) [e2e-llm-inference-service] E AssertionError: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:613: AssertionError [e2e-llm-inference-service] ------------------------------ Captured log setup ------------------------------ [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1107 No HTTP proxy configured for k8s client [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1056 Checking LLMInferenceServiceConfig router-managed-llmisvc-model-fb-8a7adbfb in namespace kserve-ci-e2e-test [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1082 Resource not found, creating LLMInferenceServiceConfig router-managed-llmisvc-model-fb-8a7adbfb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1092 ✓ Successfully created LLMInferenceServiceConfig router-managed-llmisvc-model-fb-8a7adbfb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1056 Checking LLMInferenceServiceConfig workload-simulated-dp-ep-cpu-ll-8bd4fbf5 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1082 Resource not found, creating LLMInferenceServiceConfig workload-simulated-dp-ep-cpu-ll-8bd4fbf5 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1092 ✓ Successfully created LLMInferenceServiceConfig workload-simulated-dp-ep-cpu-ll-8bd4fbf5 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1056 Checking LLMInferenceServiceConfig model-fb-opt-125m-llmisvc-model-e16aaf34 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1082 Resource not found, creating LLMInferenceServiceConfig model-fb-opt-125m-llmisvc-model-e16aaf34 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1092 ✓ Successfully created LLMInferenceServiceConfig model-fb-opt-125m-llmisvc-model-e16aaf34 [e2e-llm-inference-service] ------------------------------ Captured log call ------------------------------- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [test_llm_inference_service] [2026-04-24T21:57:27.104455] start - args=(), kwargs={'test_case': TestCase(base_refs=['router-managed', 'workload-simulated-dp-ep-cpu', 'model-fb-opt-125m'], prompt='This test simulates DP+EP that can run on CPU, the idea is to test the LWS-based deployment, but without the resources requirements for DP+EP (GPUs and ROCe/IB).', service_name='llmisvc-model-fb-opt-125m-route-f312f5ec', endpoint='/v1/completions', max_tokens=100, payload_formatter=None, response_assertion=, wait_timeout=900, response_timeout=60, before_test=[], after_test=[], llm_service={'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': None, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'llmisvc-model-fb-opt-125m-route-f312f5ec', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-managed-llmisvc-model-fb-8a7adbfb'}, [e2e-llm-inference-service] {'name': 'workload-simulated-dp-ep-cpu-ll-8bd4fbf5'}, [e2e-llm-inference-service] {'name': 'model-fb-opt-125m-llmisvc-model-e16aaf34'}]}, [e2e-llm-inference-service] 'status': None}, model_name='facebook/opt-125m')} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1107 No HTTP proxy configured for k8s client [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [create_llmisvc] [2026-04-24T21:57:27.117347] start - args=(, {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security.opendatahub.io/enable-auth': 'false'}, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'llmisvc-model-fb-opt-125m-route-f312f5ec', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-managed-llmisvc-model-fb-8a7adbfb'}, [e2e-llm-inference-service] {'name': 'workload-simulated-dp-ep-cpu-ll-8bd4fbf5'}, [e2e-llm-inference-service] {'name': 'model-fb-opt-125m-llmisvc-model-e16aaf34'}]}, [e2e-llm-inference-service] 'status': None}), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [create_llmisvc] [2026-04-24T21:57:27.165436] end - ✅ in 0.048s [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [wait_for_llm_isvc_ready] [2026-04-24T21:57:27.165516] start - args=(, {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security.opendatahub.io/enable-auth': 'false'}, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'llmisvc-model-fb-opt-125m-route-f312f5ec', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-managed-llmisvc-model-fb-8a7adbfb'}, [e2e-llm-inference-service] {'name': 'workload-simulated-dp-ep-cpu-ll-8bd4fbf5'}, [e2e-llm-inference-service] {'name': 'model-fb-opt-125m-llmisvc-model-e16aaf34'}]}, [e2e-llm-inference-service] 'status': None}, 900), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:27.165782] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:27.174412] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:28.174778] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:28.196152] end - ✅ in 0.021s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:29.196568] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:29.204866] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:30.205123] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:30.213971] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:31.214316] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:31.296472] end - ✅ in 0.082s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:32.296958] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:32.305152] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:33.305520] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:33.396728] end - ✅ in 0.091s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:34.397195] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:34.496770] end - ✅ in 0.099s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:35.497139] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:35.505381] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:36.505819] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:36.596072] end - ✅ in 0.090s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:37.596451] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:37.604628] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:38.604905] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:38.696353] end - ✅ in 0.091s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:39.696701] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:39.704716] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:40.704988] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:40.714968] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:41.715285] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:41.728153] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:42.728544] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:42.738810] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:43.739117] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:43.747619] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:44.747898] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:44.756299] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:45.756545] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:45.764716] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:46.765007] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:46.773656] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:47.773900] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:47.782476] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:48.782728] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:48.795704] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:49.795951] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:49.804311] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:50.804589] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:50.813125] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:51.813490] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:51.831060] end - ✅ in 0.017s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:52.831385] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:52.840082] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:53.840566] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:53.849425] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:54.849818] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:54.860627] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:55.860953] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:55.869214] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:56.869534] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:56.896154] end - ✅ in 0.026s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:57.896450] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:57.904485] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:58.904752] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:58.913449] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:57:59.913847] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:57:59.997023] end - ✅ in 0.083s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:00.997536] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:01.102728] end - ✅ in 0.105s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:02.103031] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:02.197822] end - ✅ in 0.095s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:03.198134] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:03.210689] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:04.211131] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:04.297114] end - ✅ in 0.086s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:05.297435] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:05.307155] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:06.307467] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:06.317256] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:07.317545] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:07.327435] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:08.327836] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:08.338544] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:09.338941] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:09.349534] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:10.349949] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:10.366551] end - ✅ in 0.016s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:11.366973] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:11.376831] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:12.377284] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:12.387791] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:13.388267] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:13.397584] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:14.397986] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:14.407690] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:15.407945] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:15.417177] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:16.417504] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:16.426355] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:17.426670] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:17.436460] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:18.436773] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:18.446143] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:19.446627] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:19.455085] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:20.455424] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:20.465025] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:21.465386] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:21.477469] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:22.477871] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:22.489358] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:23.489663] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:23.499492] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:24.499960] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:24.510213] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:25.510683] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:25.519815] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:26.520073] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:26.530797] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:27.531077] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:27.540506] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:28.540921] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:28.549784] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:29.550102] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:29.559873] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:30.560418] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:30.569952] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:31.570267] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:31.579540] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:32.579839] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:32.589511] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady', 'RouterReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:05Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:33.589955] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:33.599135] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:34.599525] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:34.609487] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:35.609929] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:35.619448] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:36.619756] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:36.629059] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:37.629487] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:37.639028] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:38.639363] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:38.654786] end - ✅ in 0.015s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:39.655272] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:39.664988] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:40.665325] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:40.676776] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:41.677277] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:41.692121] end - ✅ in 0.015s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:42.692517] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:42.702616] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:43.703032] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:43.712757] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:44.713200] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:44.722935] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:45.723261] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:45.742224] end - ✅ in 0.019s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:46.742559] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:46.753141] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:47.753465] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:47.762698] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:48.763110] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:48.774457] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:49.774827] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:49.784054] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:50.784480] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:50.794413] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:51.794682] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:51.804643] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:52.805013] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:52.814320] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:53.814685] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:53.823931] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:54.824266] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:54.833480] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:55.833754] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:55.842895] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:56.843220] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:56.853771] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:57.854025] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:57.863078] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:58.863407] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:58.878173] end - ✅ in 0.014s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:58:59.878701] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:58:59.888411] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:00.888802] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:00.898834] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:01.899167] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:01.908916] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:02.909420] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:02.918859] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:03.919280] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:03.927596] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:04.927908] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:04.937277] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:05.937730] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:05.946711] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:06.947310] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:06.956601] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:07.957053] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:07.966466] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:08.966896] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:08.975840] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:09.976157] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:09.987487] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:10.987791] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:10.997619] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:11.998059] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:12.012613] end - ✅ in 0.014s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:13.013066] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:13.022642] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:14.023094] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:14.032560] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:15.033031] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:15.042384] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:16.042773] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:16.052839] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:17.053248] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:17.063868] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:18.064283] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:18.073706] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:19.074169] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:19.083842] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:20.084295] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:20.093744] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:21.094189] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:21.103615] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:22.103887] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:22.114142] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:23.114474] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:23.124843] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:24.125120] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:24.133951] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:25.134444] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:25.146283] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:26.146526] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:26.159444] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:27.159709] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:27.169001] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:28.169519] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:28.182518] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:29.182783] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:29.192461] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:30.192759] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:30.204164] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:31.204485] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:31.213987] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:32.214286] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:32.232736] end - ✅ in 0.018s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:33.233027] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:33.244487] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:34.244861] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:34.254191] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:35.254697] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:35.264552] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:36.264921] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:36.274132] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:37.274625] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:37.284420] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:38.284864] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:38.293825] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:39.294100] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:39.304019] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:40.304279] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:40.314763] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:41.315098] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:41.324477] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:42.324747] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:42.334222] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:43.334527] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:43.343277] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:44.343578] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:44.352127] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:45.352404] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:45.360772] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:46.361078] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:46.370406] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:47.370806] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:47.387154] end - ✅ in 0.016s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:48.387453] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:48.396441] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:49.396707] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:49.405889] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:50.406158] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:50.415330] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:51.415691] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:51.424686] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:52.425001] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:52.434606] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:53.434973] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:53.445629] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:54.445941] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:54.455680] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:55.455985] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:55.466969] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:56.467296] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:56.476970] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:57.477321] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:57.487801] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:58.488106] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:58.496791] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T21:59:59.497098] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T21:59:59.510145] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:00.510689] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:00.519964] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:01.520278] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:01.530791] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:02.531073] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:02.540042] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:03.540421] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:03.549973] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:04.550311] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:04.559099] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:05.559572] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:05.569353] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:06.569811] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:06.579127] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:07.579433] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:07.589402] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:08.589854] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:08.607293] end - ✅ in 0.017s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:09.607580] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:09.616423] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:10.616890] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:10.626799] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:11.627076] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:11.640801] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:12.641109] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:12.651335] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:13.651703] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:13.662093] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:14.662581] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:14.671830] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:15.672190] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:15.682334] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:16.682654] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:16.692726] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:17.693169] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:17.704516] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:18.704784] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:18.714438] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:19.714839] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:19.723761] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:20.724052] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:20.732714] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:21.733004] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:21.742251] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:22.742561] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:22.751808] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:23.752158] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:23.761844] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:24.762118] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:24.772000] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:25.772286] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:25.781662] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:26.781952] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:26.792509] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:27.792810] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:27.802847] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:28.803133] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:28.812919] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:29.813206] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:29.822308] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:30.822768] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:30.831809] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:31.832137] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:31.841798] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:32.842321] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:32.852382] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:33.852689] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:33.862474] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:34.862782] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:34.872031] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:35.872359] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:35.881941] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:36.882221] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:36.891303] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:37.891688] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:37.901820] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:38.902180] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:38.911449] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:39.911876] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:39.921165] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:40.921471] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:40.931031] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:41.931457] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:41.940692] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:42.941139] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:42.950915] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:43.951362] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:43.961153] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:44.961441] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:44.971848] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:45.972288] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:45.992567] end - ✅ in 0.020s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:46.992843] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:47.002567] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:48.002974] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:48.014999] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:49.015284] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:49.024028] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:50.024330] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:50.033799] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:51.034101] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:51.043863] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:52.044303] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:52.054122] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:53.054555] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:53.065010] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:54.065501] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:54.088293] end - ✅ in 0.023s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:55.088718] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:55.105330] end - ✅ in 0.016s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:56.105572] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:56.115716] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:57.116207] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:57.141550] end - ✅ in 0.025s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:58.141887] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:58.150672] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:00:59.150936] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:00:59.159987] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:00.160476] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:00.168737] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:01.169021] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:01.178657] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:02.178952] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:02.189064] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:03.189569] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:03.206719] end - ✅ in 0.017s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:04.207215] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:04.216784] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:05.217060] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:05.226433] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:06.226895] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:06.236135] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:07.236447] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:07.245759] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:08.246083] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:08.254987] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:09.256699] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:09.268126] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:10.268483] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:10.277935] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:11.278205] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:11.287606] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:12.288119] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:12.296584] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:13.296906] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:13.306654] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:14.307103] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:14.316038] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:15.316313] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:15.325647] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:16.326127] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:16.335040] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:17.335465] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:17.345433] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:18.345855] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:18.354670] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:19.355023] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:19.363492] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:20.363790] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:20.373187] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:21.373471] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:21.382456] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:22.382843] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:22.392852] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:23.393362] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:23.403327] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:24.403611] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:24.412912] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:25.413369] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:25.423391] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:26.423666] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:26.433197] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:27.433588] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:27.443388] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:28.443690] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:28.457105] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:29.457564] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:29.467039] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:30.467558] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:30.477211] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:31.477774] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:31.486477] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:32.486873] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:32.495949] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:33.496285] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:33.504939] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:34.505564] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:34.516013] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:35.516496] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:35.526354] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:36.526683] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:36.534970] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:37.535312] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:37.546656] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:38.546932] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:38.555884] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:39.556293] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:39.565403] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:40.565798] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:40.575070] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:41.575579] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:41.585096] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:42.585444] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:42.594722] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:43.595076] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:43.603897] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:44.604175] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:44.613956] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:45.614340] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:45.623289] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:46.623608] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:46.632658] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:47.633124] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:47.641612] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:48.641903] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:48.650369] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:49.650672] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:49.660126] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:50.660430] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:50.669876] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:51.670188] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:51.679758] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:52.680162] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:52.689490] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:53.689915] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:53.698753] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:54.699215] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:54.708599] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:55.708910] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:55.719006] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:56.719404] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:56.728803] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:57.729311] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:57.739930] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:58.740449] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:58.749408] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:01:59.749736] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:01:59.758549] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:00.758889] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:00.768317] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:01.768584] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:01.778212] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:02.778514] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:02.787783] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:03.788078] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:03.796699] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:04.797014] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:04.806175] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:05.806665] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:05.816006] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:06.816296] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:06.824719] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:07.824979] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:07.835135] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:08.835476] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:08.845141] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:09.845575] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:09.854970] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:10.855506] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:10.865659] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:11.865975] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:11.875775] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:12.876114] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:12.885264] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:13.885609] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:13.894752] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:14.895037] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:14.903784] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:15.904037] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:15.912824] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:16.913215] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:16.922937] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:17.923305] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:17.932072] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:18.932536] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:18.942999] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:19.943292] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:19.952003] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:20.952284] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:20.960936] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:21.961217] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:21.970558] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:22.970960] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:22.980301] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:23.980717] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:23.989929] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:24.990290] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:24.999720] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:26.000175] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:26.009974] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:27.010534] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:27.019445] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:28.019752] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:28.029400] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:29.029791] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:29.038949] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:30.039422] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:30.048267] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:31.048544] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:31.057350] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:32.057849] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:32.066606] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:33.067032] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:33.076591] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:34.076962] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:34.086352] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:35.086737] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:35.096517] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:36.096886] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:36.109289] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:37.109649] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:37.121222] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:38.121657] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:38.130750] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:39.131147] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:39.140136] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:40.140641] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:40.149538] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:41.149840] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:41.161095] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:42.161373] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:42.171537] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:43.171871] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:43.180906] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:44.181295] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:44.191598] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:45.191895] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:45.201141] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:46.201635] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:46.211716] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:47.211987] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:47.220931] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:48.221220] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:48.230695] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:49.231274] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:49.240697] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:50.241059] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:50.251535] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:51.363314] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:51.372509] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:52.372984] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:52.382640] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:53.383048] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:53.392437] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:54.392707] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:54.401968] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:55.402270] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:55.417686] end - ✅ in 0.015s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:56.418143] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:56.430724] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:57.431026] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:57.440707] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:58.441471] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:58.453753] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:02:59.454204] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:02:59.463524] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:00.463790] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:00.473304] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:01.473569] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:01.482917] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:02.483381] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:02.499539] end - ✅ in 0.016s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:03.499887] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:03.521264] end - ✅ in 0.021s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:04.521528] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:04.532941] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:05.533305] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:05.542903] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:06.543427] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:06.554160] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:07.554510] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:07.567292] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:08.567611] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:08.578296] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:09.578617] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:09.590968] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:10.591276] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:10.600685] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:11.600960] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:11.614567] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:12.615150] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:12.624203] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:13.624532] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:13.635853] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:14.636141] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:14.648784] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:15.649093] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:15.658797] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:16.659102] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:16.670551] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:17.670870] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:17.680557] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:18.680920] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:18.690823] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:19.691201] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:19.700006] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:20.700333] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:20.709162] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:21.709507] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:21.718864] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:22.719202] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:22.729356] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:23.729640] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:23.738434] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:24.738687] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:24.747472] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:25.747748] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:25.756860] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:26.757138] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:26.766182] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:27.766512] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:27.775532] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:28.775950] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:28.784742] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:29.785059] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:29.795329] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:30.795685] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:30.804256] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:31.804541] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:31.813285] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:32.813557] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:32.822659] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:33.823147] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:33.833202] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:34.833479] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:34.842324] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:35.842581] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:35.852093] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:36.852486] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:36.861668] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:37.861952] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:37.871599] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:38.871969] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:38.881808] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:39.882220] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:39.891574] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:40.891851] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:40.902508] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:41.902786] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:41.924422] end - ✅ in 0.021s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:42.924741] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:42.949594] end - ✅ in 0.025s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:43.949863] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:43.968262] end - ✅ in 0.018s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:44.968622] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:44.978801] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:45.979139] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:45.989534] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:46.989831] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:47.001907] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:48.002207] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:48.015530] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:49.015850] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:49.028504] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:50.028812] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:50.038146] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:51.038656] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:51.048786] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:52.049026] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:52.061647] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:53.061949] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:53.072352] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:54.072802] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:54.083060] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:55.083516] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:55.093871] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:56.094147] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:56.103678] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:57.104047] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:57.115913] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:58.116468] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:58.126226] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:03:59.126630] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:03:59.135769] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:00.136170] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:00.146203] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:01.146644] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:01.156832] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:02.157221] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:02.166593] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:03.166981] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:03.178379] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:04.178660] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:04.188123] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:05.188430] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:05.198028] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:06.198344] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:06.210072] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:07.210529] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:07.221964] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:08.222299] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:08.231729] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:09.232186] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:09.241916] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:10.242390] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:10.251795] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:11.252297] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:11.261562] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:12.261842] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:12.272485] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:13.272759] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:13.284944] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:14.285445] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:14.294881] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:15.295271] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:15.305435] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:16.305716] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:16.318609] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:17.318972] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:17.331013] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:18.331547] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:18.341353] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:19.341760] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:19.351401] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:20.351793] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:20.365803] end - ✅ in 0.014s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:21.366125] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:21.375514] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:22.375877] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:22.385155] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:23.385620] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:23.395435] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:24.395852] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:24.405186] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:25.405591] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:25.415332] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:26.415866] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:26.426459] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:27.426900] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:27.435988] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:28.436263] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:28.446613] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:29.446929] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:29.455732] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:30.456057] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:30.467133] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:31.467397] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:31.476707] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:32.477209] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:32.486985] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:33.487302] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:33.496404] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:34.496694] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:34.505798] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:35.506277] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:35.515877] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:36.516474] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:36.525802] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:37.526141] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:37.535837] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:38.536303] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:38.548962] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:39.549400] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:39.559089] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:40.559498] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:40.569432] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:41.569738] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:41.581946] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:42.582446] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:42.592048] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:43.592522] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:43.602377] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:44.602620] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:44.611457] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:45.611719] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:45.622014] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:46.622301] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:46.632520] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:47.632793] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:47.642185] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:48.642623] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:48.651738] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:49.652114] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:49.661665] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:50.661953] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:50.673602] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:51.673877] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:51.683344] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:52.683756] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:52.691866] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:53.692181] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:53.701367] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:54.701797] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:54.711698] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:55.712278] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:55.722840] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:56.723153] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:56.732436] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:57.732883] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:57.742193] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:58.742708] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:58.752004] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:04:59.752521] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:04:59.761963] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:00.762317] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:00.771771] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:01.772079] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:01.780852] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:02.781163] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:02.790962] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:03.791272] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:03.800512] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:04.800916] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:04.811085] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:05.811389] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:05.820089] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:06.820398] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:06.833099] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:07.833396] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:07.842875] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:08.843392] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:08.852488] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:09.852881] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:09.862760] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:10.863224] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:10.873619] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:11.874190] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:11.884429] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:12.884691] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:12.893904] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:13.894365] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:13.903694] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:14.904121] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:14.913345] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:15.913638] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:15.922373] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:16.922662] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:16.931911] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:17.932333] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:17.941114] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:18.941504] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:18.950369] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:19.950921] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:19.959581] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:20.959866] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:20.968891] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:21.969293] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:21.978636] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:22.978918] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:22.988346] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:23.988783] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:23.997715] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:24.997951] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:25.007815] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:26.008086] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:26.017548] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:27.017851] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:27.026979] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:28.027331] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:28.039572] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:29.040085] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:29.049089] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:30.049532] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:30.058666] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:31.059048] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:31.068016] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:32.068312] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:32.078088] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:33.078546] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:33.087058] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:34.087457] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:34.096561] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:35.097017] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:35.105989] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:36.106287] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:36.120505] end - ✅ in 0.014s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:37.120808] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:37.136178] end - ✅ in 0.015s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:38.136476] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:38.146299] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:39.146670] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:39.160172] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:40.160461] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:40.169738] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:41.170030] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:41.179944] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:42.180395] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:42.190984] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:43.191452] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:43.201370] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:44.201641] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:44.210860] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:45.211342] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:45.220372] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:46.220649] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:46.229211] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:47.229561] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:47.243466] end - ✅ in 0.014s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:48.243721] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:48.251886] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:49.252310] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:49.261389] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:50.261681] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:50.271134] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:51.271638] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:51.280995] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:52.281479] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:52.289883] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:53.290307] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:53.299897] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:54.300173] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:54.308907] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:55.309304] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:55.321956] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:56.322485] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:56.331940] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:57.332299] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:57.342529] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:58.342884] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:58.353581] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:05:59.353865] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:05:59.363466] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:00.363939] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:00.373489] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:01.373960] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:01.383730] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:02.384053] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:02.393490] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:03.393967] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:03.403643] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:04.404105] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:04.412996] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:05.413290] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:05.423097] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:06.423552] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:06.432807] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:07.433291] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:07.442403] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:08.442729] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:08.452041] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:09.452401] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:09.461083] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:10.461387] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:10.470210] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:11.470647] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:11.480133] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:12.480514] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:12.489577] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:13.490029] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:13.499390] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:14.499843] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:14.512848] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:15.513298] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:15.523201] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:16.523488] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:16.532194] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:17.532506] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:17.541665] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:18.542061] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:18.551730] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:19.552097] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:19.562640] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:20.563050] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:20.572328] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:21.572601] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:21.581508] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:22.581764] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:22.590446] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:23.590718] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:23.599776] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:24.600164] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:24.609173] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:25.609638] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:25.618316] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:26.618612] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:26.628600] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:27.629085] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:27.638597] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:28.638859] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:28.648225] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:29.648536] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:29.660592] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:30.660885] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:30.674462] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:31.674881] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:31.684134] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:32.684469] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:32.695840] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:33.696110] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:33.705025] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:34.705473] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:34.717469] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:35.717943] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:35.727621] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:36.728004] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:36.737004] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:37.737422] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:37.748131] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:38.748580] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:38.757336] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:39.757718] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:39.766507] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:40.766968] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:40.777561] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:41.777849] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:41.787335] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:42.787760] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:42.796837] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:43.797267] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:43.806184] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:44.806474] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:44.815597] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:45.816018] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:45.825911] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:46.826343] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:46.836015] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:47.836410] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:47.845795] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:48.846284] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:48.855289] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:49.855618] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:49.864974] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:50.865518] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:50.874805] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:51.875280] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:51.884536] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:52.884815] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:52.893934] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:53.894412] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:53.903818] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:54.904311] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:54.913706] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:55.914116] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:55.923712] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:56.924019] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:56.932647] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:57.932925] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:57.941816] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:58.942127] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:58.951227] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:06:59.951748] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:06:59.960833] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:00.961082] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:00.970465] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:01.970834] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:01.980760] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:02.981036] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:02.990324] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:03.990773] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:04.000088] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:05.000556] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:05.009353] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:06.009782] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:06.019558] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:07.019943] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:07.028662] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:08.029017] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:08.038324] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:09.038780] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:09.047768] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:10.048164] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:10.057012] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:11.057315] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:11.065538] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:12.065816] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:12.075203] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:13.075515] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:13.085199] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:14.085613] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:14.094538] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:15.095011] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:15.104119] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:16.104422] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:16.113821] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:17.114283] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:17.124220] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:18.124549] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:18.133735] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:19.134165] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:19.143636] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:20.144048] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:20.153819] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:21.154276] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:21.165518] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:22.165909] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:22.174582] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:23.174967] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:23.184086] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:24.184507] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:24.194299] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:25.194593] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:25.204065] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:26.204553] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:26.213864] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:27.214300] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:27.223298] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:28.223605] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:28.232662] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:29.233027] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:29.242052] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:30.242574] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:30.251834] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:31.252277] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:31.261457] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:32.261795] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:32.271838] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:33.272120] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:33.281286] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:34.281766] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:34.290814] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:35.291100] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:35.300541] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:36.301005] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:36.310656] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:37.311050] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:37.323045] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:38.323489] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:38.333624] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:39.334047] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:39.343538] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:40.343980] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:40.353037] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:41.353489] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:41.363760] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:42.364137] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:42.372916] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:43.373210] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:43.381947] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:44.382295] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:44.391492] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:45.391913] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:45.401952] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:46.402288] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:46.411542] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:47.411911] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:47.420873] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:48.421347] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:48.431034] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:49.431523] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:49.440683] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:50.441204] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:50.450902] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:51.451401] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:51.460741] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:52.461195] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:52.470813] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:53.471288] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:53.480207] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:54.480595] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:54.491428] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:55.491778] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:55.500939] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:56.501443] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:56.510788] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:57.511216] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:57.521038] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:58.521573] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:58.531495] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:07:59.531787] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:07:59.542071] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:00.542581] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:00.551181] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:01.551682] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:01.560982] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:02.561271] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:02.575955] end - ✅ in 0.014s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:03.576313] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:03.585739] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:04.586041] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:04.597081] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:05.597595] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:05.607157] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:06.607660] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:06.616942] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:07.617527] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:07.633325] end - ✅ in 0.016s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:08.633648] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:08.643387] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:09.643806] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:09.652439] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:10.652741] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:10.662032] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:11.662312] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:11.671386] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:12.671840] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:12.680973] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:13.681292] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:13.689993] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:14.690325] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:14.699341] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:15.699742] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:15.709906] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:16.710295] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:16.719683] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:17.720001] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:17.728439] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:18.728743] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:18.739684] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:19.740160] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:19.749021] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:20.749444] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:20.760848] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:21.761140] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:21.770720] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:22.771213] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:22.783288] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:23.783698] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:23.795421] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:24.795703] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:24.805983] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:25.806452] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:25.819394] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:26.819923] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:26.829641] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:27.829968] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:27.841505] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:28.841784] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:28.851320] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:29.851714] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:29.860945] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:30.861454] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:30.870704] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:31.870959] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:31.880303] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:32.880582] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:32.889920] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:33.890439] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:33.900311] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:34.900766] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:34.910505] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:35.910846] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:35.921338] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:36.921579] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:36.930742] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:37.930992] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:37.940521] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:38.940937] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:38.951072] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:39.951462] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:39.960523] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:40.960927] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:40.970736] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:41.971035] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:41.979884] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:42.980179] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:42.990677] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:43.991109] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:44.000030] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:45.000279] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:45.010404] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:46.011002] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:46.020141] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:47.020502] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:47.040883] end - ✅ in 0.020s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:48.041304] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:48.050056] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:49.050390] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:49.060659] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:50.061090] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:50.070008] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:51.070303] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:51.080199] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:52.080496] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:52.089204] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:53.089534] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:53.098647] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:54.099101] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:54.108656] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:55.109114] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:55.118718] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:56.119113] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:56.129704] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:57.130141] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:57.139171] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:58.139539] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:58.147920] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:08:59.148441] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:08:59.158069] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:00.158513] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:00.167932] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:01.168466] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:01.177652] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:02.178066] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:02.187187] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:03.187627] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:03.196666] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:04.196944] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:04.206164] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:05.206719] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:05.217032] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:06.217321] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:06.225962] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:07.226456] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:07.236123] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:08.236626] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:08.246726] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:09.246986] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:09.256473] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:10.256810] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:10.267477] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:11.267850] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:11.277068] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:12.277567] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:12.286652] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:13.286981] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:13.296034] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:14.296319] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:14.305893] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:15.306162] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:15.318847] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:16.319119] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:16.328001] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:17.328285] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:17.337468] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:18.337878] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:18.347444] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:19.347887] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:19.357110] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:20.357384] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:20.366007] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:21.366288] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:21.375577] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:22.376001] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:22.384767] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:23.385086] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:23.394139] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:24.394500] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:24.404363] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:25.404664] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:25.414136] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:26.414553] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:26.423815] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:27.424098] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:27.433831] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:28.434314] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:28.443623] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:29.444034] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:29.452671] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:30.452957] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:30.462324] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:31.462606] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:31.471919] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:32.472365] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:32.481879] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:33.482328] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:33.491736] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:34.491988] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:34.500532] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:35.500778] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:35.509717] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:36.510079] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:36.518809] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:37.519224] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:37.528059] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:38.528572] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:38.537496] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:39.537779] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:39.549639] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:40.549926] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:40.558810] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:41.559163] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:41.568368] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:42.568832] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:42.577839] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:43.578155] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:43.587345] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:44.587770] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:44.596956] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:45.597273] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:45.606790] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:46.607052] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:46.616501] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:47.616973] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:47.626304] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:48.626580] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:48.635742] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:49.636092] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:49.645090] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:50.645395] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:50.654187] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:51.654625] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:51.664433] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:52.664859] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:52.673293] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:53.673602] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:53.682679] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:54.683144] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:54.692071] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:55.692349] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:55.701524] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:56.701832] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:56.710830] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:57.711301] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:57.720034] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:58.720351] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:58.729014] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:09:59.729437] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:09:59.739816] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:00.740285] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:00.749516] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:01.749856] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:01.758291] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:02.758712] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:02.767680] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:03.767971] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:03.777200] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:04.777571] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:04.786376] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:05.786658] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:05.797942] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:06.798274] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:06.807203] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:07.807475] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:07.816458] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:08.816765] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:08.826113] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:09.826641] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:09.835845] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:10.836154] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:10.845346] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:11.845776] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:11.855357] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:12.855662] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:12.866132] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:13.866608] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:13.875070] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:14.875577] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:14.884977] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:15.885426] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:15.894489] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:16.894887] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:16.904456] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:17.904867] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:17.913727] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:18.914017] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:18.922882] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:19.923186] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:19.932091] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:20.932393] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:20.941274] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:21.941835] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:21.950517] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:22.950783] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:22.960456] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:23.961123] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:23.970791] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:24.971171] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:24.980879] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:25.981289] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:25.990562] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:26.991026] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:27.001988] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:28.002309] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:28.011399] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:29.011785] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:29.021294] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:30.021625] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:30.030164] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:31.030564] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:31.040420] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:32.040695] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:32.049590] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:33.049959] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:33.061861] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:34.062324] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:34.070911] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:35.071223] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:35.081324] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:36.081630] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:36.090510] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:37.090854] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:37.099692] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:38.099976] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:38.109274] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:39.109578] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:39.118628] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:40.118944] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:40.127953] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:41.128339] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:41.142897] end - ✅ in 0.014s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:42.143198] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:42.152606] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:43.152862] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:43.161594] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:44.161879] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:44.176268] end - ✅ in 0.014s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:45.176574] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:45.186820] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:46.187223] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:46.196400] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:47.196787] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:47.209702] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:48.209986] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:48.219339] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:49.219762] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:49.228657] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:50.228956] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:50.238742] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:51.239019] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:51.247880] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:52.248144] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:52.257183] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:53.257509] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:53.266605] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:54.266984] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:54.275441] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:55.275744] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:55.285432] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:56.285862] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:56.295816] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:57.296183] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:57.305294] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:58.305743] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:58.314760] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:10:59.315094] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:10:59.328806] end - ✅ in 0.013s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:00.329493] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:00.339380] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:01.339787] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:01.348740] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:02.349206] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:02.359101] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:03.359418] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:03.372166] end - ✅ in 0.012s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:04.372460] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:04.381649] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:05.382083] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:05.392492] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:06.392813] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:06.401632] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:07.401926] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:07.412835] end - ✅ in 0.011s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:08.413282] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:08.422563] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:09.422966] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:09.432792] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:10.433067] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:10.442374] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:11.442655] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:11.451862] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:12.452313] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:12.462089] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:13.462396] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:13.471609] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:14.471892] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:14.482487] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:15.482749] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:15.492194] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:16.492679] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:16.502432] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:17.502761] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:17.511471] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:18.511760] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:18.520639] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:19.521147] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:19.530161] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:20.530601] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:20.540430] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:21.540835] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:21.550352] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:22.550812] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:22.559727] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:23.560018] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:23.568667] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:24.568922] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:24.697997] end - ✅ in 0.129s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:25.698290] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:25.810707] end - ✅ in 0.112s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:26.810993] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:26.896951] end - ✅ in 0.086s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:27.897309] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:27.925193] end - ✅ in 0.028s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:28.925665] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:29.018600] end - ✅ in 0.093s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:30.018909] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:30.096153] end - ✅ in 0.077s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:31.096466] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:31.196811] end - ✅ in 0.100s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:32.197220] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:32.296607] end - ✅ in 0.099s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:33.297073] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:33.396686] end - ✅ in 0.099s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:34.397159] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:34.496260] end - ✅ in 0.099s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:35.496534] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:35.505463] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:36.505866] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:36.597887] end - ✅ in 0.092s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:37.598334] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:37.697780] end - ✅ in 0.099s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:38.698284] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:38.798282] end - ✅ in 0.100s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:39.798642] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:39.896705] end - ✅ in 0.098s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:40.897065] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:40.913268] end - ✅ in 0.016s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:41.913569] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:41.923173] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:42.923613] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:42.932996] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:43.933490] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:43.942014] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:44.942444] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:44.951552] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:45.951906] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:45.960750] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:46.961206] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:46.970293] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:47.970561] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:47.979561] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:48.979824] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:48.988674] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:49.988977] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:49.997607] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:50.997910] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:51.007139] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:52.007633] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:52.016687] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:53.016959] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:53.026752] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:54.027031] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:54.035778] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:55.036045] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:55.045218] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:56.045708] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:56.055287] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:57.055753] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:57.064918] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:58.065199] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:58.074163] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:11:59.074708] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:11:59.083886] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:00.084149] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:00.092768] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:01.093093] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:01.102603] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:02.103069] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:02.111839] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:03.112276] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:03.121656] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:04.121974] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:04.131690] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:05.132091] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:05.141411] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:06.141869] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:06.151132] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:07.151435] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:07.161026] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:08.161364] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:08.170360] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:09.170657] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:09.196936] end - ✅ in 0.026s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:10.197402] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:10.207979] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:11.208430] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:11.217583] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:12.217988] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:12.226947] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:13.227306] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:13.236068] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:14.236530] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:14.245701] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:15.246108] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:15.254299] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:16.254593] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:16.264034] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:17.264281] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:17.273374] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:18.273749] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:18.282665] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:19.282956] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:19.291676] end - ✅ in 0.008s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:20.291989] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:20.301115] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:21.301624] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:21.311380] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:22.311678] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:22.320727] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:23.321013] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:23.330448] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:24.330852] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:24.340116] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:25.340633] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:25.349621] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:26.349913] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:26.358923] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.test_llm_inference_service:test_llm_inference_service.py:632 Waiting: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:27.359311] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test', 'v1alpha1'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:27.374319] end - ✅ in 0.015s [e2e-llm-inference-service] ERROR e2e.llmisvc.logging:logging.py:48 [wait_for_llm_isvc_ready] [2026-04-24T22:12:27.374426] end - ❌ 900.209s: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llmisvc] [2026-04-24T22:12:27.374580] start - args=(, 'llmisvc-model-fb-opt-125m-route-f312f5ec', 'kserve-ci-e2e-test'), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llmisvc] [2026-04-24T22:12:27.384956] end - ✅ in 0.010s [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [delete_llmisvc] [2026-04-24T22:12:29.060018] start - args=(, {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security.opendatahub.io/enable-auth': 'false'}, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'llmisvc-model-fb-opt-125m-route-f312f5ec', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-managed-llmisvc-model-fb-8a7adbfb'}, [e2e-llm-inference-service] {'name': 'workload-simulated-dp-ep-cpu-ll-8bd4fbf5'}, [e2e-llm-inference-service] {'name': 'model-fb-opt-125m-llmisvc-model-e16aaf34'}]}, [e2e-llm-inference-service] 'status': None}), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [delete_llmisvc] [2026-04-24T22:12:29.085286] end - ✅ in 0.024s [e2e-llm-inference-service] ERROR e2e.llmisvc.logging:logging.py:48 [test_llm_inference_service] [2026-04-24T22:12:29.085388] end - ❌ 901.981s: Missing true conditions: {'Ready', 'WorkloadsReady'}, expected {'Ready', 'WorkloadsReady', 'RouterReady'}, got [{'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'status': 'True', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-04-24T21:58:32Z', 'severity': 'Info', 'status': 'True', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'WorkerWorkloadReady'}, {'lastTransitionTime': '2026-04-24T21:58:01Z', 'message': 'LWS is progressing', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] =============================== warnings summary =============================== [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:151 [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:151 [e2e-llm-inference-service] /workspace/source/test/e2e/llmisvc/test_llm_inference_service.py:151: PytestUnknownMarkWarning: Unknown pytest.mark.custom_gateway - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html [e2e-llm-inference-service] pytest.mark.custom_gateway, [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:200 [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:200 [e2e-llm-inference-service] /workspace/source/test/e2e/llmisvc/test_llm_inference_service.py:200: PytestUnknownMarkWarning: Unknown pytest.mark.custom_gateway - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html [e2e-llm-inference-service] pytest.mark.custom_gateway, [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:252 [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:252 [e2e-llm-inference-service] /workspace/source/test/e2e/llmisvc/test_llm_inference_service.py:252: PytestUnknownMarkWarning: Unknown pytest.mark.custom_gateway - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html [e2e-llm-inference-service] pytest.mark.custom_gateway, [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:299 [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:299 [e2e-llm-inference-service] /workspace/source/test/e2e/llmisvc/test_llm_inference_service.py:299: PytestUnknownMarkWarning: Unknown pytest.mark.cluster_gpu - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html [e2e-llm-inference-service] pytest.mark.cluster_gpu, [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:316 [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:316 [e2e-llm-inference-service] /workspace/source/test/e2e/llmisvc/test_llm_inference_service.py:316: PytestUnknownMarkWarning: Unknown pytest.mark.no_scheduler - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html [e2e-llm-inference-service] pytest.mark.no_scheduler, [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:329 [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:329 [e2e-llm-inference-service] /workspace/source/test/e2e/llmisvc/test_llm_inference_service.py:329: PytestUnknownMarkWarning: Unknown pytest.mark.cluster_multi_node - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_multi_node], [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-inline-config-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-gateway-ref-router-with-managed-route-model-fb-opt-125m-workload-llmd-simulator] [e2e-llm-inference-service] /workspace/source/python/kserve/.venv/lib64/python3.11/site-packages/pytest_asyncio/plugin.py:761: DeprecationWarning: The event_loop fixture provided by pytest-asyncio has been redefined in [e2e-llm-inference-service] /workspace/source/test/e2e/conftest.py:43 [e2e-llm-inference-service] Replacing the event_loop fixture with a custom implementation is deprecated [e2e-llm-inference-service] and will lead to errors in the future. [e2e-llm-inference-service] If you want to request an asyncio event loop with a scope other than function [e2e-llm-inference-service] scope, use the "scope" argument to the asyncio mark when marking the tests. [e2e-llm-inference-service] If you want to return different types of event loops, use the event_loop_policy [e2e-llm-inference-service] fixture. [e2e-llm-inference-service] [e2e-llm-inference-service] warnings.warn( [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-inline-config-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:124: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-gateway-ref-router-with-managed-route-model-fb-opt-125m-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:124: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-configmap-ref-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:124: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-replicas-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:124: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:124: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-precise-prefix-cache-inline-config-workload-llmd-simulator-kvcache] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:124: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-custom-route-timeout-scheduler-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:124: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-refs-scheduler-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:124: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service_stop.py::test_llm_stop_feature[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service_stop.py:40: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:124: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-no-scheduler-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:124: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-custom-route-timeout-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:124: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_multi_node-router-managed-workload-simulated-dp-ep-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:124: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-refs-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:124: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html [e2e-llm-inference-service] =========================== short test summary info ============================ [e2e-llm-inference-service] FAILED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-custom-route-timeout-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] FAILED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_multi_node-router-managed-workload-simulated-dp-ep-cpu-model-fb-opt-125m] [e2e-llm-inference-service] ====== 2 failed, 20 passed, 3 skipped, 28 warnings in 2176.68s (0:36:16) ======= [must-gather] [must-gather ] OUT 2026-04-24T22:15:49.536124262Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 [must-gather] When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: [must-gather] ClusterID: 570d497c-e2e1-4bdb-af5f-93d2fedcb369 [must-gather] ClientVersion: 4.21.5 [must-gather] ClusterVersion: Stable at "4.20.19" [must-gather] ClusterOperators: [must-gather] clusteroperator/authentication is missing [must-gather] clusteroperator/cloud-credential is missing [must-gather] clusteroperator/cluster-autoscaler is missing [must-gather] clusteroperator/config-operator is missing [must-gather] clusteroperator/etcd is missing [must-gather] clusteroperator/machine-api is missing [must-gather] clusteroperator/machine-approver is missing [must-gather] clusteroperator/machine-config is missing [must-gather] clusteroperator/marketplace is missing [must-gather] [must-gather] [must-gather] [must-gather ] OUT 2026-04-24T22:15:49.597054589Z namespace/openshift-must-gather-5ch7l created [must-gather] [must-gather ] OUT 2026-04-24T22:15:49.605026859Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-8rf4q created [must-gather] [must-gather ] OUT 2026-04-24T22:15:49.633213719Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:54.128726937Z [disk usage checker] Started [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:54.165427981Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70 [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:54.396134698Z Error from server (NotFound): namespaces "redhat-ods-operator" not found [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:54.561866025Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:54.561897774Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:54.561897774Z namespaces "redhat-ods-operator" not found [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:54.565516457Z Error getting logs from redhat-ods-operator [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:54.727569924Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:54.727600514Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:54.727600514Z namespaces "redhat-ods-monitoring" not found [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:54.730919103Z Error getting logs from redhat-ods-monitoring [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:54.896859137Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:54.896889879Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:54.896889879Z namespaces "redhat-ods-applications" not found [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:54.899984230Z Error getting logs from redhat-ods-applications [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.067986731Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.068038582Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.068038582Z namespaces "rhods-notebooks" not found [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.071245259Z Error getting logs from rhods-notebooks [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.228373041Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.228403873Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.228403873Z namespaces "rhoai-model-registries" not found [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.231536894Z Error getting logs from rhoai-model-registries [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.395438178Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.395467821Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.395467821Z namespaces "istio-system" not found [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.398740989Z Error getting logs from istio-system [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.565595457Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.565747712Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.565747712Z namespaces "knative-serving" not found [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.568916137Z Error getting logs from knative-serving [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.733957141Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.733989245Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.733989245Z namespaces "redhat-ods-applications-auth-provider" not found [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:55.737035533Z Error getting logs from redhat-ods-applications-auth-provider [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:56.018623438Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:56.301624146Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:56.438435682Z error: the server doesn't have a resource type "auths" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:56.518863689Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:56.522025404Z Error collecting info from [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:56.658107542Z error: the server doesn't have a resource type "monitorings" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:56.742944889Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:56.746053418Z Error collecting info from [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:56.874813426Z error: the server doesn't have a resource type "featuretrackers" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:56.957977750Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:56.960950846Z Error collecting info from [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:57.091557399Z error: the server doesn't have a resource type "codeflares" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:57.181241054Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:57.184141633Z Error collecting info from [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:57.315965534Z error: the server doesn't have a resource type "dashboards" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:57.399700149Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:57.402588569Z Error collecting info from [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:57.535771476Z error: the server doesn't have a resource type "datasciencepipelines" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:57.617146217Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:57.620061958Z Error collecting info from [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:57.749567765Z error: the server doesn't have a resource type "feastoperators" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:57.833396571Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:57.836387559Z Error collecting info from [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:57.965405270Z error: the server doesn't have a resource type "kserves" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:58.046778200Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:58.049696968Z Error collecting info from [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:58.180560691Z error: the server doesn't have a resource type "kueues" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:58.264805851Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:58.267599079Z Error collecting info from [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:58.397885936Z error: the server doesn't have a resource type "modelcontrollers" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:58.482014400Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:58.484900584Z Error collecting info from [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:58.614533081Z error: the server doesn't have a resource type "modelmeshservings" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:58.700222070Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:58.703156764Z Error collecting info from [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:58.838265029Z error: the server doesn't have a resource type "modelregistries" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:58.922971453Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:58.925988255Z Error collecting info from [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:59.059857140Z error: the server doesn't have a resource type "rays" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:59.142531771Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:59.145416305Z Error collecting info from [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:59.170505329Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70 [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:59.280208775Z error: the server doesn't have a resource type "trainingoperators" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:59.365243286Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:59.368436956Z Error collecting info from [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:59.497450342Z error: the server doesn't have a resource type "trustyais" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:59.583800028Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:59.586745636Z Error collecting info from [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:59.717785922Z error: the server doesn't have a resource type "workbenches" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:59.802288159Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:59.805374393Z Error collecting info from [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:15:59.938353173Z error: the server doesn't have a resource type "hardwareprofiles" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:00.025338222Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:00.028423428Z Error collecting info from [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:00.160851887Z error: the server doesn't have a resource type "llamastackoperators" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:00.250428406Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:00.253413759Z Error collecting info from [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:00.965329736Z error: the server doesn't have a resource type "predictors" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:01.093337533Z error: the server doesn't have a resource type "localmodelnodegroups" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:01.221420428Z error: the server doesn't have a resource type "smcp" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:01.354949211Z error: the server doesn't have a resource type "smm" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:01.481323245Z error: the server doesn't have a resource type "smmr" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:02.097467434Z error: the server doesn't have a resource type "knativeservings" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:02.227876844Z error: the server doesn't have a resource type "configurations" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:02.363813905Z error: the server doesn't have a resource type "routes" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:02.503275516Z error: the server doesn't have a resource type "services" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:02.635329790Z error: the server doesn't have a resource type "revisions" [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:03.181259849Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:03.571936535Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:03.955318965Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:04.174883091Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70 [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:04.184010938Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:04.352349158Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:04.726258768Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:05.143574734Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:05.363711172Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:05.531626817Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:05.896850356Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:06.275220485Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:06.492862114Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:06.657232024Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:07.019529617Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:07.395823673Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:07.606724529Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:07.771595724Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:08.168675547Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:08.578050177Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:08.790683959Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:08.949551079Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:09.180176219Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70 [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:09.323771047Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:09.698967854Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:09.904361588Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:10.073192768Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:10.435331350Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:10.836390050Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:11.063978953Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:11.231416184Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:11.666944537Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:12.101153173Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:12.335552465Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:12.511606869Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:12.890734645Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:13.266111257Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:13.486773240Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:13.654871155Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:14.021563832Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:14.186184127Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70 [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:14.403833542Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:14.620319453Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:14.783374411Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:15.178872183Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:15.544273421Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:15.763938727Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:15.940917787Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:16.302215461Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:16.677862684Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:16.882076886Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:17.041614770Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:17.416874044Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:17.786214625Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:17.999470946Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:18.162729023Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:18.569052326Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:18.941242999Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:19.163981304Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:19.191025525Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70 [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:19.333720783Z Gathering data for ns/openshift-ingress... [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:19.620600327Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:19.789252111Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:20.039767373Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:20.215933064Z Gathering data for ns/openshift-ingress... [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:20.487787026Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:20.661705966Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:20.912475627Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:21.084938803Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:21.440559622Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:21.635033598Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:21.894528792Z Wrote inspect data to must-gather. [must-gather] [must-gather-d5h6m] POD 2026-04-24T22:16:21.962443675Z Caches written to disk [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:22.975087901Z waiting for gather to complete [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:22.979119377Z downloading gather output [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.261269926Z receiving incremental file list [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.278402601Z ./ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.278477902Z aggregated-discovery-api.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.278746238Z aggregated-discovery-apis.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.279568106Z event-filter.html [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.280897824Z timestamp [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.281032547Z version [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.283347006Z cluster-scoped-resources/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.283367127Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.283376167Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.283397007Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.28351895Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.28353634Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.283581161Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.283672503Z namespaces/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.283682653Z namespaces/kserve-ci-e2e-test/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.283739074Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.283830316Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.283897738Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.283970119Z namespaces/kserve-ci-e2e-test/apps/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.284022691Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.284150673Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.284388708Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.284589183Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.284651944Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.284694145Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.284752136Z namespaces/kserve-ci-e2e-test/batch/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.284803247Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.284903429Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.28495551Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.285004772Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.285097823Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.285154465Z namespaces/kserve-ci-e2e-test/core/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.285216206Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.285380689Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.285482522Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.289547608Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.28964549Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.290029768Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.290163811Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.290453517Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.290506959Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.29055884Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.290654162Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.290699993Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.290763704Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.290800765Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.290920587Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.290957928Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.290977979Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.291082471Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.291114952Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.291133572Z namespaces/kserve-ci-e2e-test/pods/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.291140242Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-6c59fbf55c-ngwj6/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.291222114Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-6c59fbf55c-ngwj6/router-gateway-1-openshift-default-6c59fbf55c-ngwj6.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.291336526Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-6c59fbf55c-ngwj6/istio-proxy/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.291353807Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-6c59fbf55c-ngwj6/istio-proxy/istio-proxy/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.291360427Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-6c59fbf55c-ngwj6/istio-proxy/istio-proxy/logs/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.291394818Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-6c59fbf55c-ngwj6/istio-proxy/istio-proxy/logs/current.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.301699387Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-6c59fbf55c-ngwj6/istio-proxy/istio-proxy/logs/previous.insecure.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.301770929Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-6c59fbf55c-ngwj6/istio-proxy/istio-proxy/logs/previous.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.301791959Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-6866b85949-z7zjj/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.301864791Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-6866b85949-z7zjj/router-gateway-2-openshift-default-6866b85949-z7zjj.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.301978533Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-6866b85949-z7zjj/istio-proxy/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.301986943Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-6866b85949-z7zjj/istio-proxy/istio-proxy/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.301991473Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-6866b85949-z7zjj/istio-proxy/istio-proxy/logs/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.302026634Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-6866b85949-z7zjj/istio-proxy/istio-proxy/logs/current.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.302191567Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-6866b85949-z7zjj/istio-proxy/istio-proxy/logs/previous.insecure.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.302282049Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-6866b85949-z7zjj/istio-proxy/istio-proxy/logs/previous.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.30231028Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.302352851Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.302539245Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/llm-d-routing-sidecar/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.302546545Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/llm-d-routing-sidecar/llm-d-routing-sidecar/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.302550125Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/llm-d-routing-sidecar/llm-d-routing-sidecar/logs/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.302591046Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/llm-d-routing-sidecar/llm-d-routing-sidecar/logs/current.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.302720029Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/llm-d-routing-sidecar/llm-d-routing-sidecar/logs/previous.insecure.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.3027873Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/llm-d-routing-sidecar/llm-d-routing-sidecar/logs/previous.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.302819891Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/main/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.302827711Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/main/main/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.302831181Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/main/main/logs/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.302871372Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/main/main/logs/current.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.303181508Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/main/main/logs/previous.insecure.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.303270461Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/main/main/logs/previous.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.303310351Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/storage-initializer/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.303317791Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/storage-initializer/storage-initializer/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.303327322Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/storage-initializer/storage-initializer/logs/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.303363332Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/storage-initializer/storage-initializer/logs/current.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.303496205Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.303566097Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-5f6d44c486-h2n7s/storage-initializer/storage-initializer/logs/previous.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.303606188Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-prefill-5dfd79dc4f-r9ljk/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.303648229Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-prefill-5dfd79dc4f-r9ljk/router-with-refs-pd-test-kserve-prefill-5dfd79dc4f-r9ljk.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.303752461Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-prefill-5dfd79dc4f-r9ljk/main/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.303759471Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-prefill-5dfd79dc4f-r9ljk/main/main/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.303763651Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-prefill-5dfd79dc4f-r9ljk/main/main/logs/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.303801752Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-prefill-5dfd79dc4f-r9ljk/main/main/logs/current.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.304004236Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-prefill-5dfd79dc4f-r9ljk/main/main/logs/previous.insecure.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.304074058Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-prefill-5dfd79dc4f-r9ljk/main/main/logs/previous.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.304128289Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-prefill-5dfd79dc4f-r9ljk/storage-initializer/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.304134609Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-prefill-5dfd79dc4f-r9ljk/storage-initializer/storage-initializer/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.304138149Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-prefill-5dfd79dc4f-r9ljk/storage-initializer/storage-initializer/logs/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.30417287Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-prefill-5dfd79dc4f-r9ljk/storage-initializer/storage-initializer/logs/current.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.304324133Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-prefill-5dfd79dc4f-r9ljk/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.304391344Z namespaces/kserve-ci-e2e-test/pods/router-with-refs-pd-test-kserve-prefill-5dfd79dc4f-r9ljk/storage-initializer/storage-initializer/logs/previous.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.304434265Z namespaces/kserve-ci-e2e-test/policy/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.304469176Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.304521217Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.304567738Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.304618929Z namespaces/kuadrant-system/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.3046713Z namespaces/kuadrant-system/kuadrant-system.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.304719521Z namespaces/kuadrant-system/apps.openshift.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.304763992Z namespaces/kuadrant-system/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.304808983Z namespaces/kuadrant-system/apps/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.304850844Z namespaces/kuadrant-system/apps/daemonsets.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.304936816Z namespaces/kuadrant-system/apps/deployments.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.305322294Z namespaces/kuadrant-system/apps/replicasets.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.305638081Z namespaces/kuadrant-system/apps/statefulsets.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.305671652Z namespaces/kuadrant-system/autoscaling/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.305721063Z namespaces/kuadrant-system/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.305768774Z namespaces/kuadrant-system/batch/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.305799554Z namespaces/kuadrant-system/batch/cronjobs.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.305891026Z namespaces/kuadrant-system/batch/jobs.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.305922687Z namespaces/kuadrant-system/build.openshift.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.305976248Z namespaces/kuadrant-system/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.3060537Z namespaces/kuadrant-system/build.openshift.io/builds.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.306101651Z namespaces/kuadrant-system/core/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.306143822Z namespaces/kuadrant-system/core/configmaps.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.306320895Z namespaces/kuadrant-system/core/endpoints.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.306447078Z namespaces/kuadrant-system/core/events.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.306906098Z namespaces/kuadrant-system/core/persistentvolumeclaims.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.30698256Z namespaces/kuadrant-system/core/pods.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.307408349Z namespaces/kuadrant-system/core/replicationcontrollers.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.307531091Z namespaces/kuadrant-system/core/secrets.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.307753356Z namespaces/kuadrant-system/core/services.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.307877648Z namespaces/kuadrant-system/discovery.k8s.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.307913349Z namespaces/kuadrant-system/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.308032082Z namespaces/kuadrant-system/image.openshift.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.308057732Z namespaces/kuadrant-system/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.308115214Z namespaces/kuadrant-system/k8s.ovn.org/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.308160485Z namespaces/kuadrant-system/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.308254367Z namespaces/kuadrant-system/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.308341358Z namespaces/kuadrant-system/monitoring.coreos.com/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.30840025Z namespaces/kuadrant-system/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.308453951Z namespaces/kuadrant-system/networking.k8s.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.308475541Z namespaces/kuadrant-system/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.308541913Z namespaces/kuadrant-system/pods/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.308550403Z namespaces/kuadrant-system/pods/authorino-68bd676465-jf4qz/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.308588814Z namespaces/kuadrant-system/pods/authorino-68bd676465-jf4qz/authorino-68bd676465-jf4qz.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.308674756Z namespaces/kuadrant-system/pods/authorino-68bd676465-jf4qz/authorino/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.308695316Z namespaces/kuadrant-system/pods/authorino-68bd676465-jf4qz/authorino/authorino/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.308700636Z namespaces/kuadrant-system/pods/authorino-68bd676465-jf4qz/authorino/authorino/logs/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.308709316Z namespaces/kuadrant-system/pods/authorino-68bd676465-jf4qz/authorino/authorino/logs/current.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.309521594Z namespaces/kuadrant-system/pods/authorino-68bd676465-jf4qz/authorino/authorino/logs/previous.insecure.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.309597435Z namespaces/kuadrant-system/pods/authorino-68bd676465-jf4qz/authorino/authorino/logs/previous.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.309634306Z namespaces/kuadrant-system/pods/authorino-operator-7587b89b76-4d9ct/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.309679647Z namespaces/kuadrant-system/pods/authorino-operator-7587b89b76-4d9ct/authorino-operator-7587b89b76-4d9ct.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.309762129Z namespaces/kuadrant-system/pods/authorino-operator-7587b89b76-4d9ct/manager/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.309772219Z namespaces/kuadrant-system/pods/authorino-operator-7587b89b76-4d9ct/manager/manager/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.309776029Z namespaces/kuadrant-system/pods/authorino-operator-7587b89b76-4d9ct/manager/manager/logs/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.3098273Z namespaces/kuadrant-system/pods/authorino-operator-7587b89b76-4d9ct/manager/manager/logs/current.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.310010314Z namespaces/kuadrant-system/pods/authorino-operator-7587b89b76-4d9ct/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.310079946Z namespaces/kuadrant-system/pods/authorino-operator-7587b89b76-4d9ct/manager/manager/logs/previous.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.310119696Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-844548ff4c-6kpsg/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.310154517Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-844548ff4c-6kpsg/dns-operator-controller-manager-844548ff4c-6kpsg.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.310251949Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-844548ff4c-6kpsg/manager/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.310263919Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-844548ff4c-6kpsg/manager/manager/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.31026795Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-844548ff4c-6kpsg/manager/manager/logs/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.3103113Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-844548ff4c-6kpsg/manager/manager/logs/current.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.310415793Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-844548ff4c-6kpsg/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.310490414Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-844548ff4c-6kpsg/manager/manager/logs/previous.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.310512325Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-6c886788f8-bvg5d/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.310576196Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-6c886788f8-bvg5d/kuadrant-console-plugin-6c886788f8-bvg5d.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.310646138Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-6c886788f8-bvg5d/kuadrant-console-plugin/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.310653818Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-6c886788f8-bvg5d/kuadrant-console-plugin/kuadrant-console-plugin/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.310657738Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-6c886788f8-bvg5d/kuadrant-console-plugin/kuadrant-console-plugin/logs/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.310695659Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-6c886788f8-bvg5d/kuadrant-console-plugin/kuadrant-console-plugin/logs/current.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.31077485Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-6c886788f8-bvg5d/kuadrant-console-plugin/kuadrant-console-plugin/logs/previous.insecure.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.310845682Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-6c886788f8-bvg5d/kuadrant-console-plugin/kuadrant-console-plugin/logs/previous.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.310882363Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-6ddf9554fc-z9p66/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.310919583Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-6ddf9554fc-z9p66/kuadrant-operator-controller-manager-6ddf9554fc-z9p66.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.311040126Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-6ddf9554fc-z9p66/manager/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.311047556Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-6ddf9554fc-z9p66/manager/manager/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.311051296Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-6ddf9554fc-z9p66/manager/manager/logs/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.311083137Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-6ddf9554fc-z9p66/manager/manager/logs/current.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.31265925Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-6ddf9554fc-z9p66/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.312756363Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-6ddf9554fc-z9p66/manager/manager/logs/previous.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.312787883Z namespaces/kuadrant-system/pods/limitador-limitador-67566c68b4-mrc5l/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.312851005Z namespaces/kuadrant-system/pods/limitador-limitador-67566c68b4-mrc5l/limitador-limitador-67566c68b4-mrc5l.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.312932016Z namespaces/kuadrant-system/pods/limitador-limitador-67566c68b4-mrc5l/limitador/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.312939076Z namespaces/kuadrant-system/pods/limitador-limitador-67566c68b4-mrc5l/limitador/limitador/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.312942776Z namespaces/kuadrant-system/pods/limitador-limitador-67566c68b4-mrc5l/limitador/limitador/logs/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.312986357Z namespaces/kuadrant-system/pods/limitador-limitador-67566c68b4-mrc5l/limitador/limitador/logs/current.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.313077109Z namespaces/kuadrant-system/pods/limitador-limitador-67566c68b4-mrc5l/limitador/limitador/logs/previous.insecure.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.313146741Z namespaces/kuadrant-system/pods/limitador-limitador-67566c68b4-mrc5l/limitador/limitador/logs/previous.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.313188832Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-c7fb4c8d5-grrpw/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.313217942Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-c7fb4c8d5-grrpw/limitador-operator-controller-manager-c7fb4c8d5-grrpw.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.313331815Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-c7fb4c8d5-grrpw/manager/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.313342285Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-c7fb4c8d5-grrpw/manager/manager/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.313345745Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-c7fb4c8d5-grrpw/manager/manager/logs/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.313386896Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-c7fb4c8d5-grrpw/manager/manager/logs/current.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.313529509Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-c7fb4c8d5-grrpw/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.313605331Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-c7fb4c8d5-grrpw/manager/manager/logs/previous.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.313626931Z namespaces/kuadrant-system/policy/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.313675222Z namespaces/kuadrant-system/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.313725313Z namespaces/kuadrant-system/route.openshift.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.313760814Z namespaces/kuadrant-system/route.openshift.io/routes.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.313811165Z namespaces/openshift-ingress/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.313859386Z namespaces/openshift-ingress/openshift-ingress.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.313925748Z namespaces/openshift-ingress/apps.openshift.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.313966438Z namespaces/openshift-ingress/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.314014569Z namespaces/openshift-ingress/apps/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.3140463Z namespaces/openshift-ingress/apps/daemonsets.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.314137822Z namespaces/openshift-ingress/apps/deployments.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.314417948Z namespaces/openshift-ingress/apps/replicasets.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.314687444Z namespaces/openshift-ingress/apps/statefulsets.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.314737215Z namespaces/openshift-ingress/autoscaling/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.314785816Z namespaces/openshift-ingress/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.314843497Z namespaces/openshift-ingress/batch/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.314889478Z namespaces/openshift-ingress/batch/cronjobs.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.31496677Z namespaces/openshift-ingress/batch/jobs.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.315029351Z namespaces/openshift-ingress/build.openshift.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.315075012Z namespaces/openshift-ingress/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.315153614Z namespaces/openshift-ingress/build.openshift.io/builds.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.315200555Z namespaces/openshift-ingress/core/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.315253506Z namespaces/openshift-ingress/core/configmaps.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.315694495Z namespaces/openshift-ingress/core/endpoints.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.315798827Z namespaces/openshift-ingress/core/events.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.316057453Z namespaces/openshift-ingress/core/persistentvolumeclaims.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.316129894Z namespaces/openshift-ingress/core/pods.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.316480552Z namespaces/openshift-ingress/core/replicationcontrollers.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.316601484Z namespaces/openshift-ingress/core/secrets.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.316796529Z namespaces/openshift-ingress/core/services.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.31688011Z namespaces/openshift-ingress/discovery.k8s.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.316931241Z namespaces/openshift-ingress/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.317006743Z namespaces/openshift-ingress/image.openshift.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.317041654Z namespaces/openshift-ingress/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.317097135Z namespaces/openshift-ingress/k8s.ovn.org/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.317141666Z namespaces/openshift-ingress/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.317219327Z namespaces/openshift-ingress/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.317280949Z namespaces/openshift-ingress/monitoring.coreos.com/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.31733141Z namespaces/openshift-ingress/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.317385851Z namespaces/openshift-ingress/networking.k8s.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.317427052Z namespaces/openshift-ingress/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.317478213Z namespaces/openshift-ingress/pods/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.317489563Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-55ff986f96-nzp8n/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.317526274Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-55ff986f96-nzp8n/istiod-openshift-gateway-55ff986f96-nzp8n.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.317628806Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-55ff986f96-nzp8n/discovery/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.317636996Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-55ff986f96-nzp8n/discovery/discovery/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.317640796Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-55ff986f96-nzp8n/discovery/discovery/logs/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.317677837Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-55ff986f96-nzp8n/discovery/discovery/logs/current.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.319482856Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-55ff986f96-nzp8n/discovery/discovery/logs/previous.insecure.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.319553827Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-55ff986f96-nzp8n/discovery/discovery/logs/previous.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.319593318Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.319639609Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d/openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.319782132Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d/istio-proxy/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.319789262Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d/istio-proxy/istio-proxy/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.319792852Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d/istio-proxy/istio-proxy/logs/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.319829233Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d/istio-proxy/istio-proxy/logs/current.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.319972596Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d/istio-proxy/istio-proxy/logs/previous.insecure.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.320043108Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d/istio-proxy/istio-proxy/logs/previous.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.320082539Z namespaces/openshift-ingress/pods/router-default-7f4c79d4bd-dxrjx/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.32012428Z namespaces/openshift-ingress/pods/router-default-7f4c79d4bd-dxrjx/router-default-7f4c79d4bd-dxrjx.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.320246692Z namespaces/openshift-ingress/pods/router-default-7f4c79d4bd-dxrjx/router/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.320257862Z namespaces/openshift-ingress/pods/router-default-7f4c79d4bd-dxrjx/router/router/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.320261392Z namespaces/openshift-ingress/pods/router-default-7f4c79d4bd-dxrjx/router/router/logs/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.320297363Z namespaces/openshift-ingress/pods/router-default-7f4c79d4bd-dxrjx/router/router/logs/current.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.320406926Z namespaces/openshift-ingress/pods/router-default-7f4c79d4bd-dxrjx/router/router/logs/previous.insecure.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.320477427Z namespaces/openshift-ingress/pods/router-default-7f4c79d4bd-dxrjx/router/router/logs/previous.log [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.320520708Z namespaces/openshift-ingress/policy/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.320556869Z namespaces/openshift-ingress/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.32059685Z namespaces/openshift-ingress/route.openshift.io/ [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.32063913Z namespaces/openshift-ingress/route.openshift.io/routes.yaml [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.328285503Z [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.328304644Z sent 3,450 bytes received 664,868 bytes 445,545.33 bytes/sec [must-gather] [must-gather-d5h6m] OUT 2026-04-24T22:16:23.328309534Z total size is 7,380,539 speedup is 11.04 [must-gather] [must-gather ] OUT 2026-04-24T22:16:23.470724387Z namespace/openshift-must-gather-5ch7l deleted [must-gather] [must-gather] [must-gather] Reprinting Cluster State: [must-gather] When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: [must-gather] ClusterID: 570d497c-e2e1-4bdb-af5f-93d2fedcb369 [must-gather] ClientVersion: 4.21.5 [must-gather] ClusterVersion: Stable at "4.20.19" [must-gather] ClusterOperators: [must-gather] clusteroperator/authentication is missing [must-gather] clusteroperator/cloud-credential is missing [must-gather] clusteroperator/cluster-autoscaler is missing [must-gather] clusteroperator/config-operator is missing [must-gather] clusteroperator/etcd is missing [must-gather] clusteroperator/machine-api is missing [must-gather] clusteroperator/machine-approver is missing [must-gather] clusteroperator/machine-config is missing [must-gather] clusteroperator/marketplace is missing [must-gather] [must-gather] [must-gather] [must-gather ] OUT 2026-04-24T22:16:23.593108913Z Using must-gather plug-in image: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dd19538052f0deb24938546fa0d17135330102ff01b5699610d2fdf82785eaab [must-gather] When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: [must-gather] ClusterID: 570d497c-e2e1-4bdb-af5f-93d2fedcb369 [must-gather] ClientVersion: 4.21.5 [must-gather] ClusterVersion: Stable at "4.20.19" [must-gather] ClusterOperators: [must-gather] clusteroperator/authentication is missing [must-gather] clusteroperator/cloud-credential is missing [must-gather] clusteroperator/cluster-autoscaler is missing [must-gather] clusteroperator/config-operator is missing [must-gather] clusteroperator/etcd is missing [must-gather] clusteroperator/machine-api is missing [must-gather] clusteroperator/machine-approver is missing [must-gather] clusteroperator/machine-config is missing [must-gather] clusteroperator/marketplace is missing [must-gather] [must-gather] [must-gather] [must-gather ] OUT 2026-04-24T22:16:23.617575614Z namespace/openshift-must-gather-wmq6v created [must-gather] [must-gather ] OUT 2026-04-24T22:16:23.627624638Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-dfrdg created [must-gather] [must-gather ] OUT 2026-04-24T22:16:23.65307009Z pod for plug-in image quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dd19538052f0deb24938546fa0d17135330102ff01b5699610d2fdf82785eaab created [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:25.071004009Z [disk usage checker] Started [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:25.074155777Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:25.300501680Z Gathering data for ns/openshift-cluster-version... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:25.496142179Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:25.638172413Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:25.740659788Z Gathering data for ns/default... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:26.128719825Z Gathering data for ns/openshift... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:26.643737990Z Gathering data for ns/kube-system... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:27.374240003Z Gathering data for ns/openshift-etcd... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:27.643693362Z Waiting on subprocesses to finish execution. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:27.650279394Z INFO: Gathering machine config daemon's old logs from all nodes [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:27.651851373Z INFO: Gathering on-disk MachineConfig from degraded nodes [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:27.657780857Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:27.678819358Z INFO: Collecting host service logs for crio [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:27.679141200Z INFO: Collecting host service logs for kubelet [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:27.679449197Z INFO: Collecting host service logs for rpm-ostreed [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:27.679782296Z INFO: Collecting host service logs for ostree-finalize-staged [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:27.680067648Z INFO: Collecting host service logs for machine-config-daemon-firstboot [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:27.680373543Z INFO: Collecting host service logs for machine-config-daemon-host [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:27.680686266Z INFO: Collecting host service logs for NetworkManager [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:27.681031705Z INFO: Collecting host service logs for openvswitch [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:27.681341028Z INFO: Collecting host service logs for ovs-configuration [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:27.681659029Z INFO: Collecting host service logs for ovsdb-server [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:27.681997006Z INFO: Collecting host service logs for ovs-vswitchd [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:27.682351835Z INFO: Waiting for worker host service log collection to complete ... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:27.682808143Z INFO: Waiting for node performance related collection to complete ... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:27.691185975Z INFO: Gathering HAProxy config files [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:28.325459430Z INFO: Waiting for on-disk MachineConfig collection to complete ... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:28.325542198Z INFO: on-disk MachineConfig config collection complete. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:28.437053368Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:28.437151828Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:28.437151828Z namespaces "assisted-installer" not found [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:28.442112759Z No resources found in openshift-etcd namespace. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:28.453687936Z INFO: Collecting Insights Archives from insights-operator-585dfdc468-w6q7n [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:28.453742632Z insights-runtime-extractor-6ck65 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:28.453765147Z insights-runtime-extractor-sxbgk [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:28.453785129Z insights-runtime-extractor-vqxb9 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:28.536209976Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:28.618826606Z INFO: "metallb-operator" not detected. Skipping. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:28.657627256Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:28.855342386Z INFO: "sriov-network-operator" not detected. Skipping. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:28.932721757Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:28.932721757Z See 'oc rsync -h' for help and examples [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:28.995902141Z INFO: namespace openshift-frr-k8s not detected. Skipping. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:29.041114334Z error: the server doesn't have a resource type "performanceprofile" [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:29.056394355Z INFO: Found 1 replicas - prometheus-k8s-0 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:29.086110607Z No resources found [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:29.131757644Z INFO: Waiting for HAProxy config collection to complete ... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:29.227025122Z INFO: Worker host service log collection to complete. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:29.359995414Z ERROR: No running kube-apiserver pods found [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:29.697575423Z INFO: Getting alertmanagers from prometheus-k8s-0 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:29.985296271Z tar: Removing leading `/' from member names [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:29.986510032Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:29.991549266Z INFO: HAProxy config collection complete. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:30.108534542Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:30.162211754Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:30.267165932Z error: the server doesn't have a resource type "multi-networkpolicy" [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:30.275154496Z No resources found [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:30.300167435Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:30.348633169Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:30.468429474Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:30.486895106Z INFO: 'previous-logs' folder not found on ip-10-0-133-36.ec2.internal, skipping... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:30.643375050Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:30.685492379Z error: the server doesn't have a resource type "machineconfigs" [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:30.829796679Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:30.853076404Z INFO: Getting rules from prometheus-k8s-0 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:30.883456602Z INFO: 'previous-logs' folder not found on ip-10-0-134-232.ec2.internal, skipping... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:31.036646608Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:31.064311422Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:31.313129668Z INFO: 'previous-logs' folder not found on ip-10-0-142-242.ec2.internal, skipping... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:31.313239214Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:31.313295953Z INFO: Machine Config Daemon termination log collection complete. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:31.409575879Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:31.426555519Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:31.431084993Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:31.490845793Z INFO: Getting status/config from prometheus-k8s-0 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:31.670642656Z error: the server doesn't have a resource type "kubeletconfigs" [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:31.746024822Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:31.830441015Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:31.998015668Z Gathering data for ns/openshift-monitoring... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.037856679Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.077476369Z INFO: Getting status/flags from prometheus-k8s-0 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.246577269Z INFO: INTERCONNECT MODE [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.246613333Z INFO: Gathering ovn-kubernetes DBs [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.347271701Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.384738310Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.447009868Z INFO: Gathering OVN_Northbound from ovnkube-node-bt4zz... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.447269399Z INFO: Gathering OVN_Northbound from ovnkube-node-c6xp2... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.447522291Z INFO: Gathering OVN_Northbound from ovnkube-node-mxnmf... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.447854208Z INFO: Gathering OVN_Southbound from ovnkube-node-bt4zz... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.448143077Z INFO: Gathering OVN_Southbound from ovnkube-node-c6xp2... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.448419903Z INFO: Gathering OVN_Southbound from ovnkube-node-mxnmf... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.723151543Z INFO: Getting targets?state=active from prometheus-k8s-0 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.810048742Z tar: Removing leading `/' from member names [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.822148159Z tar: Removing leading `/' from member names [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.841335406Z tar: Removing leading `/' from member names [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.850313542Z tar: Removing leading `/' from member names [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.893112324Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.910544994Z tar: Removing leading `/' from member names [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:32.912108195Z tar: Removing leading `/' from member names [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:33.125984192Z INFO: Getting status/tsdb from prometheus-k8s-0 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:33.250591413Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:33.581837680Z INFO: Waiting for network log collection to complete ... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:33.581889377Z INFO: Waiting for ovnk database copies to complete ... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:33.582380569Z INFO: Copying ovnk databases complete. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:33.584447863Z 5.0M must-gather/network_logs/ovnk_database_store [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:33.587440931Z ovnk_database_store/ [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:33.587486113Z ovnk_database_store/ovnkube-node-mxnmf_nbdb [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:33.601247603Z ovnk_database_store/ovnkube-node-c6xp2_sbdb [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:33.613929824Z INFO: Getting status from alertmanager-main-0 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:33.618755833Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:33.627348867Z ovnk_database_store/ovnkube-node-c6xp2_nbdb [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:33.638450928Z ovnk_database_store/ovnkube-node-bt4zz_nbdb [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:33.649840392Z ovnk_database_store/ovnkube-node-bt4zz_sbdb [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:33.682473080Z ovnk_database_store/ovnkube-node-mxnmf_sbdb [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:33.716099280Z INFO: Network log collection complete. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:33.921047857Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:34.177979735Z W0424 22:16:34.177916 1433 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:34.196404862Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:34.480996644Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:34.484506047Z INFO: Fallback to identify the container image from release info [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:34.501897572Z Gathering data for ns/openshift-network-console... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:35.028738788Z Gathering data for ns/openshift-console-operator... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:35.098763472Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f2123db9953f98da0e43c266e6a8a070bf221533b995f87b7e358cc7498ca6d [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:35.200157563Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:35.245744717Z daemonset.apps/perf-node-gather-daemonset created [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:35.334750879Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:35.388591854Z Waiting for performance profile collector pods to become ready: 1 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:35.505855502Z Gathering data for ns/openshift-console... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:36.079376904Z Gathering data for ns/openshift-cluster-storage-operator... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:36.474014629Z Gathering data for ns/openshift-dns-operator... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:36.533242319Z Waiting for performance profile collector pods to become ready: 2 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:36.818569499Z Gathering data for ns/openshift-dns... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:37.466934194Z Gathering data for ns/openshift-image-registry... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:37.673951289Z Waiting for performance profile collector pods to become ready: 3 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:37.984650906Z Gathering data for ns/openshift-ingress-operator... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:38.347794803Z Gathering data for ns/openshift-ingress... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:38.810002146Z Waiting for performance profile collector pods to become ready: 4 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:38.933882306Z Gathering data for ns/openshift-ingress-canary... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:39.396497922Z Gathering data for ns/openshift-insights... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:39.943999954Z Waiting for performance profile collector pods to become ready: 5 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:40.204571657Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:41.069309434Z Waiting for performance profile collector pods to become ready: 6 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:42.187240205Z Gathering data for ns/openshift-lws-operator... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:42.201166410Z Waiting for performance profile collector pods to become ready: 7 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:42.765867724Z Gathering data for ns/kserve... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:43.325401046Z Daemonset perf-node-gather-daemonset ready 3 out of 3 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:43.606955947Z Collecting performance related data for node ip-10-0-134-232.ec2.internal [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:43.613725130Z Collecting performance related data for node ip-10-0-133-36.ec2.internal [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:43.620752121Z Collecting performance related data for node ip-10-0-142-242.ec2.internal [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:44.861553805Z Gathering data for ns/openshift-config... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:45.209494349Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:45.288131795Z Gathering data for ns/openshift-config-managed... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:45.785007778Z Gathering data for ns/openshift-kube-apiserver-operator... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:46.163945779Z Gathering data for ns/openshift-kube-apiserver... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:46.552571322Z Gathering data for ns/openshift-kube-controller-manager... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:46.930850250Z Gathering data for ns/openshift-kube-controller-manager-operator... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:47.323261304Z Gathering data for ns/openshift-kube-scheduler... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:47.678960106Z Gathering data for ns/openshift-kube-scheduler-operator... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:48.063335629Z Gathering data for ns/openshift-kube-storage-version-migrator... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:48.449037288Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:48.862028719Z Gathering data for ns/openshift-user-workload-monitoring... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:49.468021842Z Gathering data for ns/openshift-multus... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:50.214929923Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:51.023281245Z Gathering data for ns/openshift-ovn-kubernetes... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:52.049576218Z Collecting kubelet logs for node ip-10-0-134-232.ec2.internal [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:52.052360364Z Collecting kubelet logs for node ip-10-0-133-36.ec2.internal [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:52.054146841Z Collecting kubelet logs for node ip-10-0-142-242.ec2.internal [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:52.455329280Z daemonset.apps "perf-node-gather-daemonset" deleted [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:52.460638732Z INFO: Node performance data collection complete. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:52.758724782Z Gathering data for ns/openshift-host-network... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:53.133908398Z Gathering data for ns/openshift-network-diagnostics... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:53.709141661Z Gathering data for ns/openshift-network-node-identity... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:54.188892186Z Gathering data for ns/openshift-network-operator... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:54.615177761Z Gathering data for ns/openshift-cloud-network-config-controller... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:54.927263674Z Gathering data for ns/openshift-cluster-node-tuning-operator... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:55.219957015Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:55.487243048Z Gathering data for ns/openshift-apiserver-operator... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:55.828819730Z Gathering data for ns/openshift-apiserver... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:56.303229758Z Gathering data for ns/openshift-controller-manager-operator... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:56.641368770Z Gathering data for ns/openshift-controller-manager... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:56.955009824Z Gathering data for ns/openshift-cluster-samples-operator... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:57.640055542Z Gathering data for ns/openshift-operator-lifecycle-manager... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:58.002029101Z Gathering data for ns/openshift-service-ca-operator... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:58.351818181Z Gathering data for ns/openshift-service-ca... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:58.805599664Z Gathering data for ns/openshift-cluster-csi-drivers... [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:59.831899413Z Wrote inspect data to must-gather. [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:59.831943622Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:59.831943622Z skipping gathering secrets/support due to error: secrets "support" not found [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:16:59.974042708Z error: the server doesn't have a resource type "clusters" [must-gather] [must-gather-qrvlz] POD 2026-04-24T22:17:00.143469199Z Caches written to disk [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.152150892Z waiting for gather to complete [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.156734299Z downloading gather output [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.435290605Z receiving incremental file list [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.4571949Z ./ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.457325563Z aggregated-discovery-api.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.457637859Z aggregated-discovery-apis.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.458579989Z event-filter.html [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.461282956Z timestamp [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.461386449Z version [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.469160063Z cluster-scoped-resources/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.469194084Z cluster-scoped-resources/admissionregistration.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.469203804Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicies/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.469223495Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicies/default-network-annotation.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.469359478Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicies/servicecidrs.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.46947563Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicies/user-defined-networks-namespace-label.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.469539682Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicybindings/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.469583383Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicybindings/default-network-annotation-binding.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.469683885Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicybindings/servicecidrs-binding.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.469765887Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicybindings/user-defined-networks-namespace-label-binding.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.469877039Z cluster-scoped-resources/admissionregistration.k8s.io/validatingwebhookconfigurations/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.46992271Z cluster-scoped-resources/admissionregistration.k8s.io/validatingwebhookconfigurations/multus.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.470040012Z cluster-scoped-resources/admissionregistration.k8s.io/validatingwebhookconfigurations/network-node-identity.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.470111214Z cluster-scoped-resources/apiextensions.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.470540183Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.470586504Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/accounts.nim.opendatahub.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.470734957Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/adminnetworkpolicies.policy.networking.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.470956192Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/adminpolicybasedexternalroutes.k8s.ovn.org.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.471164856Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/alertingrules.monitoring.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.47132354Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/alertmanagerconfigs.monitoring.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.474717291Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/alertmanagers.monitoring.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.476690493Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/alertrelabelconfigs.monitoring.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.476883327Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/apikeys.devportal.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.477082622Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/apiproducts.devportal.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.477704845Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/apirequestcounts.apiserver.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.477884348Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/apiservers.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.478084903Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/appliedmanifestworks.work.open-cluster-management.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.478290077Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/authconfigs.authorino.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.479171286Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/authentications.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.479448972Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/authorinos.operator.authorino.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.479608545Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/authorizationpolicies.security.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.479805519Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/authpolicies.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.481089047Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/baselineadminnetworkpolicies.policy.networking.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.481389253Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/builds.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.481594927Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/bundles.trust.cert-manager.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.481788351Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/catalogsources.operators.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.482126249Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/certificaterequests.cert-manager.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.482320913Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/certificates.cert-manager.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.482573038Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/certmanagers.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.482886705Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/challenges.acme.cert-manager.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.483695162Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/cloudcredentials.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.483847785Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/cloudeventsources.eventing.keda.sh.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.483992428Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/cloudprivateipconfigs.cloud.network.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.484134561Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterclaims.cluster.open-cluster-management.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.484299065Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clustercloudeventsources.eventing.keda.sh.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.484439958Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clustercsidrivers.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.484635732Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterimagepolicies.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.484852266Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterissuers.cert-manager.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.485755446Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusteroperators.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.485922139Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterresourcequotas.quota.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.486152194Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterserviceversions.operators.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.488267239Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterstoragecontainers.serving.kserve.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.488486403Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clustertriggerauthentications.keda.sh.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.488689218Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusteruserdefinednetworks.k8s.ovn.org.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.488950113Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterversions.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.48929399Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/configs.imageregistry.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.489844652Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/configs.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.490000685Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/configs.samples.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.490175799Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consoleclidownloads.console.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.490341073Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consoleexternalloglinks.console.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.490488066Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consolelinks.console.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.490638479Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consolenotifications.console.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.490785182Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consoleplugins.console.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.491025747Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consolequickstarts.console.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.491202731Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consoles.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.491370425Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consoles.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.491693941Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consolesamples.console.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.491864505Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consoleyamlsamples.console.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.492017228Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/controllerconfigs.machineconfiguration.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.492688962Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/credentialsrequests.cloudcredential.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.492847716Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/csisnapshotcontrollers.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.492998349Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/datascienceclusters.datasciencecluster.opendatahub.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.493242394Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/destinationrules.networking.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.494069552Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dnses.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.494225295Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dnses.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.494500561Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dnshealthcheckprobes.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.494648384Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dnspolicies.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.494850938Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dnsrecords.ingress.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.495016452Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dnsrecords.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.495205766Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dscinitializations.dscinitialization.opendatahub.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.49540334Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/egressfirewalls.k8s.ovn.org.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.495555273Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/egressips.k8s.ovn.org.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.495702206Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/egressqoses.k8s.ovn.org.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.49586162Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/egressrouters.network.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.496038984Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/egressservices.k8s.ovn.org.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.496184067Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/envoyfilters.networking.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.496399251Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/etcds.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.496572965Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/featuregates.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.496743108Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/gatewayclasses.gateway.networking.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.496943143Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/gateways.gateway.networking.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.497386642Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/gateways.networking.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.497604917Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/grpcroutes.gateway.networking.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.498061326Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/helmchartrepositories.helm.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.498200769Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/httproutes.gateway.networking.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.499122769Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/imagecontentpolicies.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.499318803Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/imagecontentsourcepolicies.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.499458156Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/imagedigestmirrorsets.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.499603259Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/imagepolicies.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.499814953Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/imagepruners.imageregistry.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.50010432Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/images.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.500283594Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/imagetagmirrorsets.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.500437827Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencegraphs.serving.kserve.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.500634201Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencemodelrewrites.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.500790214Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferenceobjectives.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.500935027Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencepoolimports.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.501109941Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencepools.inference.networking.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.501307465Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencepools.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.501470859Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferenceservices.serving.kserve.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.503865739Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/infrastructures.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.50438599Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ingresscontrollers.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.505069295Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ingresses.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.50530418Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/insightsoperators.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.505517354Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/installplans.operators.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.505696398Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ipamclaims.k8s.cni.cncf.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.505835511Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ippools.whereabouts.cni.cncf.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.505966864Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/issuers.cert-manager.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.506890314Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/istiocnis.sailoperator.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.507318893Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/istiocsrs.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.50766878Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/istiorevisions.sailoperator.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.509597701Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/istiorevisiontags.sailoperator.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.509739914Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/istios.sailoperator.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.511251516Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/kedacontrollers.keda.sh.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.512796849Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/kuadrants.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.512959962Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/kubeapiservers.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.513149946Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/kubecontrollermanagers.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.51333846Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/kubeschedulers.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.513499864Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/kubestorageversionmigrators.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.513671917Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/leaderworkersetoperators.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.513825371Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/leaderworkersets.leaderworkerset.x-k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.518596592Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/limitadors.limitador.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.518922358Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/llminferenceserviceconfigs.serving.kserve.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.52370825Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/llminferenceservices.serving.kserve.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.528121254Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/machineconfignodes.machineconfiguration.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.528278207Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/machineconfigpools.machineconfiguration.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.528480671Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/machineconfigurations.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.528760827Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/machineosbuilds.machineconfiguration.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.52890244Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/machineosconfigs.machineconfiguration.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.529046993Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/network-attachment-definitions.k8s.cni.cncf.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.529152135Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/networks.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.52933531Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/networks.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.529577284Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/nodes.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.529686767Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/nodeslicepools.whereabouts.cni.cncf.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.529791189Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/oauths.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.530004864Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/oidcpolicies.extensions.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.530130866Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/olmconfigs.operators.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.530260019Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/openshiftapiservers.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.530401982Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/openshiftcontrollermanagers.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.530514944Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/operatorconditions.operators.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.530651727Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/operatorgroups.operators.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.53079389Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/operatorhubs.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.530904573Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/operatorpkis.network.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.531016055Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/operators.operators.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.531146638Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/orders.acme.cert-manager.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.531300401Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/overlappingrangeipreservations.whereabouts.cni.cncf.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.531407943Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/peerauthentications.security.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.531539986Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/pinnedimagesets.machineconfiguration.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.531651248Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/planpolicies.extensions.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.531778031Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/podmonitors.monitoring.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.532027816Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/podnetworkconnectivitychecks.controlplane.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.532151749Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/probes.monitoring.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.532446105Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/profiles.tuned.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.532585398Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/projecthelmchartrepositories.helm.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.532701261Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/projects.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.532806773Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/prometheuses.monitoring.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.534700173Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/prometheusrules.monitoring.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.534804885Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/proxies.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.534915148Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/proxyconfigs.networking.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.53503912Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/rangeallocations.security.internal.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.535144833Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ratelimitpolicies.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.535314996Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/referencegrants.gateway.networking.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.535434489Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/requestauthentications.security.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.535600462Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/rolebindingrestrictions.authorization.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.535713695Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/scaledjobs.keda.sh.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.537170045Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/scaledobjects.keda.sh.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.537337449Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/schedulers.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.537445621Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/securitycontextconstraints.security.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.537595854Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/servicecas.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.537707657Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/serviceentries.networking.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.537893741Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/servicemonitors.monitoring.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.538124636Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/servingruntimes.serving.kserve.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.538649487Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/sidecars.networking.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.538932563Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/storages.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.539060505Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/storagestates.migration.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.539167148Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/storageversionmigrations.migration.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.53929715Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/subscriptions.operators.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.539882933Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/telemetries.telemetry.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.540066297Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/telemetrypolicies.extensions.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.540175159Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/thanosrulers.monitoring.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.541570469Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/tlspolicies.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.541734012Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/tokenratelimitpolicies.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.541900586Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/trainedmodels.serving.kserve.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.541997358Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/triggerauthentications.keda.sh.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.542148171Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/trustmanagers.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.542427597Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/tuneds.tuned.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.5425594Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/userdefinednetworks.k8s.ovn.org.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.542711443Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/virtualservices.networking.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.543112151Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/volumepopulators.populator.storage.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.543214684Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/volumesnapshotclasses.snapshot.storage.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.543361777Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/volumesnapshotcontents.snapshot.storage.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.5435224Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/volumesnapshots.snapshot.storage.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.543673574Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/wasmplugins.extensions.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.543802676Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/workloadentries.networking.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.543944589Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/workloadgroups.networking.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.544120783Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ztunnels.sailoperator.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.545159785Z cluster-scoped-resources/apiregistration.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.54537803Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.545444091Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1..yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.545534293Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.acme.cert-manager.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.545619715Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.admissionregistration.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.545697496Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.apiextensions.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.545789338Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.apiserver.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.545941211Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.apps.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.546039313Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.apps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.546126875Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.authentication.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.546223417Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.authorization.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.5463295Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.authorization.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.546424482Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.autoscaling.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.546516194Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.batch.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.546596165Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.build.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.546687367Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.cert-manager.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.546771329Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.certificates.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.546863531Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.cloud.network.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.546946013Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.cloudcredential.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.547047595Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.config.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.547134817Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.console.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.547222399Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.coordination.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.547329531Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.datasciencecluster.opendatahub.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.547417923Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.discovery.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.547505935Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.dscinitialization.opendatahub.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.547589606Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.events.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.547685528Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.flowcontrol.apiserver.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.54776932Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.gateway.networking.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.547861862Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.image.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.547950084Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.imageregistry.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.548034846Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.inference.networking.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.548126568Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.ingress.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.548212379Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.k8s.cni.cncf.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.548395463Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.k8s.ovn.org.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.548480785Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.548572677Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.leaderworkerset.x-k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.548656359Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.machineconfiguration.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.548755841Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.monitoring.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.548832493Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.monitoring.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.548924845Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.network.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.549014357Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.networking.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.549103978Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.networking.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.54918672Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.nim.opendatahub.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.549308383Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.node.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.549407035Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.oauth.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.549491317Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.549584419Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.operators.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.549665181Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.packages.operators.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.549762452Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.policy.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.549879275Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.project.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.549974077Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.quota.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.550065469Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.rbac.authorization.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.550156991Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.route.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.550261213Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.sailoperator.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.550366845Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.samples.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.550459957Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.scheduling.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.550551959Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.security.internal.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.550638591Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.security.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.550732023Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.security.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.550819505Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.snapshot.storage.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.550911837Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.storage.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.551013299Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.telemetry.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.551109511Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.template.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.551201523Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.tuned.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.551318016Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.user.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.551417838Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.work.open-cluster-management.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.55152952Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.cluster.open-cluster-management.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.551621182Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.controlplane.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.551718064Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.devportal.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.551813446Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.eventing.keda.sh.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.551907608Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.extensions.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.55199461Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.extensions.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.552092652Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.552190484Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.k8s.cni.cncf.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.552303286Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.keda.sh.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.552396688Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.55247864Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.limitador.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.552573432Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.migration.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.552659674Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.monitoring.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.552750556Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.operator.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.552840718Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.operators.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.55294016Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.policy.networking.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.553023072Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.sailoperator.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.553119734Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.serving.kserve.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.553212916Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.telemetry.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.553350408Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.trust.cert-manager.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.553452551Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.whereabouts.cni.cncf.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.553547573Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha2.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.553633305Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha2.operators.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.553754147Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha2.serving.kserve.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.553853129Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha3.networking.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.553945171Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.admissionregistration.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.554031013Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.external.metrics.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.554160846Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.gateway.networking.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.554302459Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.helm.openshift.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.55438749Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.554486673Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.metrics.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.554587305Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.monitoring.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.554675727Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.networking.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.554761649Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.operator.authorino.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.55485714Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.populator.storage.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.554943282Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.security.istio.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.555054395Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.serving.kserve.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.555145017Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta2.authorino.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.555254359Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta3.authorino.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.555361271Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v2.autoscaling.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.555450603Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v2.operators.coreos.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.555502834Z cluster-scoped-resources/certificates.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.555544065Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.555595816Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/csr-275tc.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.555691408Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/csr-2h6wx.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.55578232Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/csr-5dddq.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.555873032Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/csr-5mfpw.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.555953234Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/csr-bhsn2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.556047226Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/csr-gbfsn.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.556135108Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/csr-j8p77.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.556225029Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/csr-jrsn4.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.556402173Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/csr-kzd8v.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.556504106Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/csr-kzlj8.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.556588607Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/csr-nhvnh.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.556687149Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/csr-sq75z.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.556778741Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/system:openshift:openshift-monitoring-2cj4r.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.556880283Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/system:openshift:openshift-monitoring-2qt5c.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.556979605Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/system:openshift:openshift-monitoring-7zvwh.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.557094418Z cluster-scoped-resources/config.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.557143889Z cluster-scoped-resources/config.openshift.io/apiservers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.557329223Z cluster-scoped-resources/config.openshift.io/authentications.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.557455676Z cluster-scoped-resources/config.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.557545068Z cluster-scoped-resources/config.openshift.io/clusterimagepolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.557636059Z cluster-scoped-resources/config.openshift.io/clusteroperators.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.557938036Z cluster-scoped-resources/config.openshift.io/clusterversions.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.558042648Z cluster-scoped-resources/config.openshift.io/consoles.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.55812513Z cluster-scoped-resources/config.openshift.io/dnses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.558219032Z cluster-scoped-resources/config.openshift.io/featuregates.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.558413896Z cluster-scoped-resources/config.openshift.io/imagecontentpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.558499098Z cluster-scoped-resources/config.openshift.io/imagedigestmirrorsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.55859356Z cluster-scoped-resources/config.openshift.io/imagepolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.558669151Z cluster-scoped-resources/config.openshift.io/images.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.558762923Z cluster-scoped-resources/config.openshift.io/imagetagmirrorsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.558836675Z cluster-scoped-resources/config.openshift.io/infrastructures.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.558937747Z cluster-scoped-resources/config.openshift.io/ingresses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.559037609Z cluster-scoped-resources/config.openshift.io/networks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.559126881Z cluster-scoped-resources/config.openshift.io/nodes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.559213923Z cluster-scoped-resources/config.openshift.io/oauths.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.559330315Z cluster-scoped-resources/config.openshift.io/operatorhubs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.559413477Z cluster-scoped-resources/config.openshift.io/projects.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.559507649Z cluster-scoped-resources/config.openshift.io/proxies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.559589061Z cluster-scoped-resources/config.openshift.io/schedulers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.559682553Z cluster-scoped-resources/config.openshift.io/clusteroperators/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.559725074Z cluster-scoped-resources/config.openshift.io/clusteroperators/console.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.559817036Z cluster-scoped-resources/config.openshift.io/clusteroperators/csi-snapshot-controller.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.559906567Z cluster-scoped-resources/config.openshift.io/clusteroperators/dns.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.559989989Z cluster-scoped-resources/config.openshift.io/clusteroperators/image-registry.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.560081281Z cluster-scoped-resources/config.openshift.io/clusteroperators/ingress.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.560169823Z cluster-scoped-resources/config.openshift.io/clusteroperators/insights.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.560298746Z cluster-scoped-resources/config.openshift.io/clusteroperators/kube-apiserver.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.560436429Z cluster-scoped-resources/config.openshift.io/clusteroperators/kube-controller-manager.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.560539621Z cluster-scoped-resources/config.openshift.io/clusteroperators/kube-scheduler.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.560636583Z cluster-scoped-resources/config.openshift.io/clusteroperators/kube-storage-version-migrator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.560731035Z cluster-scoped-resources/config.openshift.io/clusteroperators/monitoring.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.560824717Z cluster-scoped-resources/config.openshift.io/clusteroperators/network.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.56095147Z cluster-scoped-resources/config.openshift.io/clusteroperators/node-tuning.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.561038871Z cluster-scoped-resources/config.openshift.io/clusteroperators/openshift-apiserver.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.561130153Z cluster-scoped-resources/config.openshift.io/clusteroperators/openshift-controller-manager.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.561216315Z cluster-scoped-resources/config.openshift.io/clusteroperators/openshift-samples.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.561340518Z cluster-scoped-resources/config.openshift.io/clusteroperators/operator-lifecycle-manager-catalog.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.56142518Z cluster-scoped-resources/config.openshift.io/clusteroperators/operator-lifecycle-manager-packageserver.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.561518302Z cluster-scoped-resources/config.openshift.io/clusteroperators/operator-lifecycle-manager.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.561619354Z cluster-scoped-resources/config.openshift.io/clusteroperators/service-ca.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.561699076Z cluster-scoped-resources/config.openshift.io/clusteroperators/storage.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.561765437Z cluster-scoped-resources/config.openshift.io/clusterversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.561813648Z cluster-scoped-resources/config.openshift.io/clusterversions/version.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.561887289Z cluster-scoped-resources/config.openshift.io/consoles/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.561935381Z cluster-scoped-resources/config.openshift.io/consoles/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.562008712Z cluster-scoped-resources/config.openshift.io/featuregates/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.562055963Z cluster-scoped-resources/config.openshift.io/featuregates/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.562117324Z cluster-scoped-resources/config.openshift.io/infrastructures/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.562158005Z cluster-scoped-resources/config.openshift.io/infrastructures/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.562242827Z cluster-scoped-resources/config.openshift.io/oauths/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.562293958Z cluster-scoped-resources/config.openshift.io/oauths/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.562348679Z cluster-scoped-resources/config.openshift.io/proxies/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.56238759Z cluster-scoped-resources/config.openshift.io/proxies/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.562434611Z cluster-scoped-resources/console.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.562446481Z cluster-scoped-resources/console.openshift.io/consoleplugins/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.562500793Z cluster-scoped-resources/console.openshift.io/consoleplugins/kuadrant-console-plugin.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.562596825Z cluster-scoped-resources/console.openshift.io/consoleplugins/monitoring-plugin.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.562673596Z cluster-scoped-resources/console.openshift.io/consoleplugins/networking-console-plugin.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.562735127Z cluster-scoped-resources/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.562742618Z cluster-scoped-resources/core/nodes/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.562785529Z cluster-scoped-resources/core/nodes/ip-10-0-133-36.ec2.internal.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.562940042Z cluster-scoped-resources/core/nodes/ip-10-0-134-232.ec2.internal.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.563088155Z cluster-scoped-resources/core/nodes/ip-10-0-142-242.ec2.internal.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.563193817Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.563278199Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.5633243Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/catch-all.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.563423142Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/endpoint-controller.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.563504934Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/exempt.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.563589296Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/global-default.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.563679478Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/kube-controller-manager.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.563758589Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/kube-scheduler.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.563900472Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/kube-system-service-accounts.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.563995774Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-apiserver-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.564081066Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-apiserver-sar.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.564172548Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-apiserver.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.56428232Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-authentication-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.564376692Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-controller-manager.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.564472324Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-kube-apiserver-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.564557116Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-monitoring-metrics.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.564650688Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-oauth-apiserver-sar.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.56473945Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-oauth-apiserver.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.564829972Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-oauth-server.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.564927854Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/probes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.565015426Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/service-accounts.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.565108508Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/system-leader-election.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.56519058Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/system-node-high.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.565367223Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/system-nodes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.565454335Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/workload-leader-election.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.565535827Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.565584748Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/catch-all.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.56567327Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/exempt.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.565751042Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/global-default.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.565830883Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/leader-election.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.565912845Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/node-high.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.565997027Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/openshift-control-plane-operators.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.56616664Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/system.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.566332084Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/workload-high.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.566413996Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/workload-low.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.566470167Z cluster-scoped-resources/gateway.networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.566477227Z cluster-scoped-resources/gateway.networking.k8s.io/gatewayclasses/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.566532308Z cluster-scoped-resources/gateway.networking.k8s.io/gatewayclasses/openshift-default.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.56660603Z cluster-scoped-resources/imageregistry.operator.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.5666177Z cluster-scoped-resources/imageregistry.operator.openshift.io/configs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.566662751Z cluster-scoped-resources/imageregistry.operator.openshift.io/configs/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.566751373Z cluster-scoped-resources/imageregistry.operator.openshift.io/imagepruners/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.566796994Z cluster-scoped-resources/imageregistry.operator.openshift.io/imagepruners/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.566863125Z cluster-scoped-resources/migration.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.566870555Z cluster-scoped-resources/migration.k8s.io/storageversionmigrations/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.566924046Z cluster-scoped-resources/migration.k8s.io/storageversionmigrations/console-plugin-storage-version-migration.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.567021008Z cluster-scoped-resources/migration.k8s.io/storageversionmigrations/machineconfiguration-controllerconfig-storage-version-migration.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.567161221Z cluster-scoped-resources/migration.k8s.io/storageversionmigrations/machineconfiguration-machineconfigpool-storage-version-migration.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.567220393Z cluster-scoped-resources/oauth.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.567252623Z cluster-scoped-resources/oauth.openshift.io/oauthclients/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.567279474Z cluster-scoped-resources/oauth.openshift.io/oauthclients/console.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.567379816Z cluster-scoped-resources/operator.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.567389876Z cluster-scoped-resources/operator.openshift.io/clustercsidrivers/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.567425427Z cluster-scoped-resources/operator.openshift.io/clustercsidrivers/ebs.csi.aws.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.567503499Z cluster-scoped-resources/operator.openshift.io/consoles/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.56754156Z cluster-scoped-resources/operator.openshift.io/consoles/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.567666092Z cluster-scoped-resources/operator.openshift.io/csisnapshotcontrollers/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.567700083Z cluster-scoped-resources/operator.openshift.io/csisnapshotcontrollers/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.567775684Z cluster-scoped-resources/operator.openshift.io/dnses/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.567815865Z cluster-scoped-resources/operator.openshift.io/dnses/default.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.567878876Z cluster-scoped-resources/operator.openshift.io/insightsoperators/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.567920777Z cluster-scoped-resources/operator.openshift.io/insightsoperators/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.56804173Z cluster-scoped-resources/operator.openshift.io/kubeapiservers/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.568085601Z cluster-scoped-resources/operator.openshift.io/kubeapiservers/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.568140602Z cluster-scoped-resources/operator.openshift.io/kubecontrollermanagers/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.568176313Z cluster-scoped-resources/operator.openshift.io/kubecontrollermanagers/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.568254455Z cluster-scoped-resources/operator.openshift.io/kubeschedulers/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.568306566Z cluster-scoped-resources/operator.openshift.io/kubeschedulers/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.568375617Z cluster-scoped-resources/operator.openshift.io/kubestorageversionmigrators/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.568418498Z cluster-scoped-resources/operator.openshift.io/kubestorageversionmigrators/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.568485769Z cluster-scoped-resources/operator.openshift.io/networks/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.56852748Z cluster-scoped-resources/operator.openshift.io/networks/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.568591602Z cluster-scoped-resources/operator.openshift.io/openshiftapiservers/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.568622872Z cluster-scoped-resources/operator.openshift.io/openshiftapiservers/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.568679024Z cluster-scoped-resources/operator.openshift.io/openshiftcontrollermanagers/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.568725325Z cluster-scoped-resources/operator.openshift.io/openshiftcontrollermanagers/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.568789796Z cluster-scoped-resources/operator.openshift.io/servicecas/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.568830797Z cluster-scoped-resources/operator.openshift.io/servicecas/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.568899378Z cluster-scoped-resources/operator.openshift.io/storages/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.568938759Z cluster-scoped-resources/operator.openshift.io/storages/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.569031511Z cluster-scoped-resources/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.569039331Z cluster-scoped-resources/operators.coreos.com/olmconfigs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.569080162Z cluster-scoped-resources/operators.coreos.com/olmconfigs/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.569152514Z cluster-scoped-resources/operators.coreos.com/operators/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.569199575Z cluster-scoped-resources/operators.coreos.com/operators/authorino-operator.kuadrant-system.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.569326547Z cluster-scoped-resources/operators.coreos.com/operators/dns-operator.kuadrant-system.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.569426419Z cluster-scoped-resources/operators.coreos.com/operators/leader-worker-set.openshift-lws-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.569569192Z cluster-scoped-resources/operators.coreos.com/operators/limitador-operator.kuadrant-system.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.569675185Z cluster-scoped-resources/operators.coreos.com/operators/openshift-cert-manager-operator.cert-manager-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.569790157Z cluster-scoped-resources/operators.coreos.com/operators/openshift-custom-metrics-autoscaler-operator.openshift-keda.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.569894399Z cluster-scoped-resources/operators.coreos.com/operators/rhcl-operator.kuadrant-system.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.570008492Z cluster-scoped-resources/operators.coreos.com/operators/servicemeshoperator3.openshift-operators.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.570083193Z cluster-scoped-resources/rbac.authorization.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.570100494Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.570153935Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/aws-ebs-csi-driver-operator-clusterrolebinding.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.570279978Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/cloud-network-config-controller.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.57038596Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/cluster-storage-operator-role.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.570547053Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/metrics-daemon-sa-rolebinding.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.570655806Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/multus-admission-controller-webhook.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.570761628Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/multus-ancillary-tools.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.57086736Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/multus-cluster-readers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.570973372Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/multus-group.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.571093285Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/multus-transient.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.571195327Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/multus-whereabouts.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.57132048Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/network-diagnostics.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.571437132Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/network-node-identity.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.571538824Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/openshift-image-registry-pruner.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.571644287Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/openshift-iptables-alerter.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.571745339Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/openshift-ovn-kubernetes-control-plane-limited.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.571849691Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/openshift-ovn-kubernetes-node-identity-limited.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.571979174Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/openshift-ovn-kubernetes-node-kube-rbac-proxy.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.572085236Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/registry-registry-role.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.572188768Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.572261009Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/aws-ebs-csi-driver-operator-clusterrole.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.572401123Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/cloud-network-config-controller.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.572513765Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/metrics-daemon-role.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.572629867Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/multus-admission-controller-webhook.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.572785931Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/multus-ancillary-tools.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.572887543Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/multus.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.572995105Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/net-attach-def-project.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.573099547Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/network-diagnostics.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.57320894Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/network-node-identity.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.573344103Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-iptables-alerter.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.573441794Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-ovn-kubernetes-cluster-reader.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.573541157Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-ovn-kubernetes-control-plane-limited.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.573646419Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-ovn-kubernetes-kube-rbac-proxy.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.573747561Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-ovn-kubernetes-node-limited.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.573854023Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-ovn-kubernetes-udn-editor.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.573955416Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-ovn-kubernetes-udn-viewer.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.574055138Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/system:registry.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.57416247Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/whereabouts-cni.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.574242791Z cluster-scoped-resources/sailoperator.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.574355314Z cluster-scoped-resources/sailoperator.io/istios/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.574409015Z cluster-scoped-resources/sailoperator.io/istios/openshift-gateway.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.574493567Z cluster-scoped-resources/samples.operator.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.574500507Z cluster-scoped-resources/samples.operator.openshift.io/configs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.574544218Z cluster-scoped-resources/samples.operator.openshift.io/configs/cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.57462365Z cluster-scoped-resources/snapshot.storage.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.57463038Z cluster-scoped-resources/snapshot.storage.k8s.io/volumesnapshotclasses/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.574690931Z cluster-scoped-resources/snapshot.storage.k8s.io/volumesnapshotclasses/csi-aws-vsc.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.574757922Z cluster-scoped-resources/storage.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.574766743Z cluster-scoped-resources/storage.k8s.io/csidrivers/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.574818624Z cluster-scoped-resources/storage.k8s.io/csidrivers/ebs.csi.aws.com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.574906665Z cluster-scoped-resources/storage.k8s.io/csinodes/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.574960037Z cluster-scoped-resources/storage.k8s.io/csinodes/ip-10-0-133-36.ec2.internal.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.575081019Z cluster-scoped-resources/storage.k8s.io/csinodes/ip-10-0-134-232.ec2.internal.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.575177211Z cluster-scoped-resources/storage.k8s.io/csinodes/ip-10-0-142-242.ec2.internal.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.575255023Z cluster-scoped-resources/storage.k8s.io/storageclasses/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.575307204Z cluster-scoped-resources/storage.k8s.io/storageclasses/gp2-csi.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.575413076Z cluster-scoped-resources/storage.k8s.io/storageclasses/gp3-csi.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.575483458Z host_service_logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.575532399Z host_service_logs/masters/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.5755923Z host_service_logs/masters/NetworkManager_service.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.575669882Z host_service_logs/masters/crio_service.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.575751134Z host_service_logs/masters/kubelet_service.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.575833385Z host_service_logs/masters/machine-config-daemon-firstboot_service.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.575979808Z host_service_logs/masters/machine-config-daemon-host_service.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.576109221Z host_service_logs/masters/openvswitch_service.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.576194223Z host_service_logs/masters/ostree-finalize-staged_service.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.576324546Z host_service_logs/masters/ovs-configuration_service.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.576417248Z host_service_logs/masters/ovs-vswitchd_service.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.576497169Z host_service_logs/masters/ovsdb-server_service.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.576579881Z host_service_logs/masters/rpm-ostreed_service.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.576640702Z ingress_controllers/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.576647942Z ingress_controllers/default/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.576664903Z ingress_controllers/default/router-default-7f4c79d4bd-dxrjx/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.576727114Z ingress_controllers/default/router-default-7f4c79d4bd-dxrjx/haproxy.config [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.576883238Z insights-data/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.576890018Z machine_config_ondisk/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.576893488Z machine_config_termination_logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.576898848Z monitoring/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.576902548Z monitoring/alertmanager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.576957689Z monitoring/alertmanager/status.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.577076762Z monitoring/alertmanager/status.stderr [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.577147513Z monitoring/prometheus/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.577199174Z monitoring/prometheus/alertmanagers.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.577355697Z monitoring/prometheus/alertmanagers.stderr [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.577432029Z monitoring/prometheus/rules.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.578117204Z monitoring/prometheus/rules.stderr [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.578179835Z monitoring/prometheus/prometheus-k8s-0/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.578255057Z monitoring/prometheus/prometheus-k8s-0/active-targets.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.579109425Z monitoring/prometheus/prometheus-k8s-0/active-targets.stderr [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.579176456Z monitoring/prometheus/prometheus-k8s-0/status/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.579261358Z monitoring/prometheus/prometheus-k8s-0/status/runtimeinfo.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.579385691Z monitoring/prometheus/prometheus-k8s-0/status/runtimeinfo.stderr [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.579478942Z monitoring/prometheus/prometheus-k8s-0/status/tsdb.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.579610565Z monitoring/prometheus/prometheus-k8s-0/status/tsdb.stderr [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.579682747Z monitoring/prometheus/status/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.579737728Z monitoring/prometheus/status/config.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.580189338Z monitoring/prometheus/status/config.stderr [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.5802956Z monitoring/prometheus/status/flags.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.580411292Z monitoring/prometheus/status/flags.stderr [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.580616497Z namespaces/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.580625007Z namespaces/cert-manager-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.580628497Z namespaces/cert-manager-operator/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.580632207Z namespaces/cert-manager-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.580686278Z namespaces/cert-manager-operator/coordination.k8s.io/leases/cert-manager-operator-lock.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.580749829Z namespaces/cert-manager-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.5807598Z namespaces/cert-manager-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.580806031Z namespaces/cert-manager-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.581006575Z namespaces/cert-manager-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.581293911Z namespaces/cert-manager-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.581454364Z namespaces/cert-manager-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.581668159Z namespaces/cert-manager-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.581954245Z namespaces/cert-manager-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.58221712Z namespaces/cert-manager-operator/operators.coreos.com/installplans/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.582293032Z namespaces/cert-manager-operator/operators.coreos.com/installplans/install-bdc76.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.582464466Z namespaces/cert-manager-operator/operators.coreos.com/operatorconditions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.582507847Z namespaces/cert-manager-operator/operators.coreos.com/operatorconditions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.582596429Z namespaces/cert-manager-operator/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.58264554Z namespaces/cert-manager-operator/operators.coreos.com/operatorgroups/cert-manager-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.582721011Z namespaces/cert-manager-operator/operators.coreos.com/subscriptions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.582780683Z namespaces/cert-manager-operator/operators.coreos.com/subscriptions/openshift-cert-manager-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.582858594Z namespaces/cert-manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.582866684Z namespaces/cert-manager/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.582873394Z namespaces/cert-manager/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.582938446Z namespaces/cert-manager/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.583121Z namespaces/cert-manager/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.583415086Z namespaces/cert-manager/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.5835816Z namespaces/cert-manager/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.583780084Z namespaces/cert-manager/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.584025719Z namespaces/cert-manager/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.584279714Z namespaces/default/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.584339745Z namespaces/default/default.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.584430267Z namespaces/default/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.584470508Z namespaces/default/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.58455925Z namespaces/default/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.584605721Z namespaces/default/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.584714484Z namespaces/default/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.584811046Z namespaces/default/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.584908048Z namespaces/default/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.584963639Z namespaces/default/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.58502267Z namespaces/default/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.585079061Z namespaces/default/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.585134982Z namespaces/default/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.585245475Z namespaces/default/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.585330057Z namespaces/default/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.585366967Z namespaces/default/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.585451219Z namespaces/default/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.585534781Z namespaces/default/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.585578152Z namespaces/default/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.585726965Z namespaces/default/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.585867008Z namespaces/default/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.586066142Z namespaces/default/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.586165034Z namespaces/default/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.586288417Z namespaces/default/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.58642633Z namespaces/default/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.586608564Z namespaces/default/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.586714806Z namespaces/default/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.586770947Z namespaces/default/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.586847499Z namespaces/default/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.58690784Z namespaces/default/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.586967491Z namespaces/default/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.587036783Z namespaces/default/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.587134345Z namespaces/default/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.587242467Z namespaces/default/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.587309108Z namespaces/default/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.58736169Z namespaces/default/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.587431651Z namespaces/default/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.587485782Z namespaces/default/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.587542773Z namespaces/default/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.587549104Z namespaces/default/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.587602855Z namespaces/default/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.587755498Z namespaces/default/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.587940952Z namespaces/default/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.588086195Z namespaces/default/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.58831941Z namespaces/default/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.588577475Z namespaces/default/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.58876865Z namespaces/default/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.58880951Z namespaces/default/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.588880532Z namespaces/default/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.588926273Z namespaces/default/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.589010005Z namespaces/kserve-ci-e2e-test/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.589016415Z namespaces/kserve-ci-e2e-test/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.589019905Z namespaces/kserve-ci-e2e-test/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.589082826Z namespaces/kserve-ci-e2e-test/coordination.k8s.io/leases/epp-kserve-ci-e2e-test-scheduler-ha-replicas-test-inference-pool.gateway-api-inference-extension.sigs.k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.589192939Z namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.589199519Z namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/gateways/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.589284541Z namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/gateways/router-gateway-1.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.589392393Z namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/gateways/router-gateway-2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.589475365Z namespaces/kserve-ci-e2e-test/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.589485415Z namespaces/kserve-ci-e2e-test/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.589548306Z namespaces/kserve-ci-e2e-test/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.589709599Z namespaces/kserve-ci-e2e-test/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.589901163Z namespaces/kserve-ci-e2e-test/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.590045877Z namespaces/kserve-ci-e2e-test/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.590269751Z namespaces/kserve-ci-e2e-test/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.590529017Z namespaces/kserve-ci-e2e-test/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.590755172Z namespaces/kserve/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.590806243Z namespaces/kserve/kserve.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.590885494Z namespaces/kserve/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.590934025Z namespaces/kserve/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.591054278Z namespaces/kserve/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.591096349Z namespaces/kserve/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.591202441Z namespaces/kserve/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.591507237Z namespaces/kserve/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.591700272Z namespaces/kserve/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.591753203Z namespaces/kserve/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.591809594Z namespaces/kserve/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.591863395Z namespaces/kserve/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.591916786Z namespaces/kserve/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.592018199Z namespaces/kserve/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.59208939Z namespaces/kserve/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.592144171Z namespaces/kserve/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.592255104Z namespaces/kserve/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.592322705Z namespaces/kserve/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.592330245Z namespaces/kserve/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.592380416Z namespaces/kserve/coordination.k8s.io/leases/kserve-controller-manager-leader-lock.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.592474398Z namespaces/kserve/coordination.k8s.io/leases/llminferenceservice-kserve-controller-manager.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.59257869Z namespaces/kserve/coordination.k8s.io/leases/odh-model-controller.opendatahub.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.592697893Z namespaces/kserve/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.592753174Z namespaces/kserve/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.59301845Z namespaces/kserve/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.593152303Z namespaces/kserve/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.593477739Z namespaces/kserve/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.593565131Z namespaces/kserve/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.593822137Z namespaces/kserve/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.59396138Z namespaces/kserve/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.594215725Z namespaces/kserve/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.594333037Z namespaces/kserve/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.594382878Z namespaces/kserve/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.594483591Z namespaces/kserve/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.594514551Z namespaces/kserve/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.594592913Z namespaces/kserve/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.594635534Z namespaces/kserve/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.594734886Z namespaces/kserve/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.594831058Z namespaces/kserve/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.59489572Z namespaces/kserve/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.594951311Z namespaces/kserve/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.595053363Z namespaces/kserve/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.595103604Z namespaces/kserve/monitoring.coreos.com/servicemonitors/model-serving-api-metrics.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.595211066Z namespaces/kserve/monitoring.coreos.com/servicemonitors/odh-model-controller-metrics-monitor.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.595291898Z namespaces/kserve/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.595346679Z namespaces/kserve/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.595414211Z namespaces/kserve/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.595421671Z namespaces/kserve/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.595474862Z namespaces/kserve/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.595624345Z namespaces/kserve/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.595806919Z namespaces/kserve/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.595947732Z namespaces/kserve/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.596147596Z namespaces/kserve/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.596413441Z namespaces/kserve/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.596640736Z namespaces/kserve/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.596648837Z namespaces/kserve/pods/kserve-controller-manager-67f77cd7d7-ffx4r/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.596702448Z namespaces/kserve/pods/kserve-controller-manager-67f77cd7d7-ffx4r/kserve-controller-manager-67f77cd7d7-ffx4r.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.59682145Z namespaces/kserve/pods/kserve-controller-manager-67f77cd7d7-ffx4r/manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.59682845Z namespaces/kserve/pods/kserve-controller-manager-67f77cd7d7-ffx4r/manager/manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.59683391Z namespaces/kserve/pods/kserve-controller-manager-67f77cd7d7-ffx4r/manager/manager/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.596905272Z namespaces/kserve/pods/kserve-controller-manager-67f77cd7d7-ffx4r/manager/manager/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.597033195Z namespaces/kserve/pods/kserve-controller-manager-67f77cd7d7-ffx4r/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.597115867Z namespaces/kserve/pods/kserve-controller-manager-67f77cd7d7-ffx4r/manager/manager/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.597158997Z namespaces/kserve/pods/llmisvc-controller-manager-6ff58d5594-fk9lc/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.597221339Z namespaces/kserve/pods/llmisvc-controller-manager-6ff58d5594-fk9lc/llmisvc-controller-manager-6ff58d5594-fk9lc.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.597341741Z namespaces/kserve/pods/llmisvc-controller-manager-6ff58d5594-fk9lc/manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.597351661Z namespaces/kserve/pods/llmisvc-controller-manager-6ff58d5594-fk9lc/manager/manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.597366792Z namespaces/kserve/pods/llmisvc-controller-manager-6ff58d5594-fk9lc/manager/manager/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.597430943Z namespaces/kserve/pods/llmisvc-controller-manager-6ff58d5594-fk9lc/manager/manager/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.599977297Z namespaces/kserve/pods/llmisvc-controller-manager-6ff58d5594-fk9lc/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.600056269Z namespaces/kserve/pods/llmisvc-controller-manager-6ff58d5594-fk9lc/manager/manager/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.60010237Z namespaces/kserve/pods/model-serving-api-86f7b4b499-cm4l4/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.600172871Z namespaces/kserve/pods/model-serving-api-86f7b4b499-cm4l4/model-serving-api-86f7b4b499-cm4l4.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.600336945Z namespaces/kserve/pods/model-serving-api-86f7b4b499-cm4l4/server/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.600352925Z namespaces/kserve/pods/model-serving-api-86f7b4b499-cm4l4/server/server/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.600357485Z namespaces/kserve/pods/model-serving-api-86f7b4b499-cm4l4/server/server/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.600398406Z namespaces/kserve/pods/model-serving-api-86f7b4b499-cm4l4/server/server/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.600509159Z namespaces/kserve/pods/model-serving-api-86f7b4b499-cm4l4/server/server/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.60059345Z namespaces/kserve/pods/model-serving-api-86f7b4b499-cm4l4/server/server/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.600656702Z namespaces/kserve/pods/odh-model-controller-696fc77849-72h9j/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.600716123Z namespaces/kserve/pods/odh-model-controller-696fc77849-72h9j/odh-model-controller-696fc77849-72h9j.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.600801005Z namespaces/kserve/pods/odh-model-controller-696fc77849-72h9j/manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.600809235Z namespaces/kserve/pods/odh-model-controller-696fc77849-72h9j/manager/manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.600824875Z namespaces/kserve/pods/odh-model-controller-696fc77849-72h9j/manager/manager/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.600886207Z namespaces/kserve/pods/odh-model-controller-696fc77849-72h9j/manager/manager/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.608801544Z namespaces/kserve/pods/odh-model-controller-696fc77849-72h9j/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.608886386Z namespaces/kserve/pods/odh-model-controller-696fc77849-72h9j/manager/manager/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.608929317Z namespaces/kserve/pods/s3-init-6dhp2/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.608993448Z namespaces/kserve/pods/s3-init-6dhp2/s3-init-6dhp2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.60907887Z namespaces/kserve/pods/s3-init-6dhp2/s3-init/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.60908852Z namespaces/kserve/pods/s3-init-6dhp2/s3-init/s3-init/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.60909307Z namespaces/kserve/pods/s3-init-6dhp2/s3-init/s3-init/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.609150962Z namespaces/kserve/pods/s3-init-6dhp2/s3-init/s3-init/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.609297555Z namespaces/kserve/pods/s3-init-6dhp2/s3-init/s3-init/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.609384897Z namespaces/kserve/pods/s3-init-6dhp2/s3-init/s3-init/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.609445848Z namespaces/kserve/pods/seaweedfs-86cc847c5c-6mhj8/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.609476438Z namespaces/kserve/pods/seaweedfs-86cc847c5c-6mhj8/seaweedfs-86cc847c5c-6mhj8.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.609585181Z namespaces/kserve/pods/seaweedfs-86cc847c5c-6mhj8/seaweedfs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.609596891Z namespaces/kserve/pods/seaweedfs-86cc847c5c-6mhj8/seaweedfs/seaweedfs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.609604301Z namespaces/kserve/pods/seaweedfs-86cc847c5c-6mhj8/seaweedfs/seaweedfs/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.609645752Z namespaces/kserve/pods/seaweedfs-86cc847c5c-6mhj8/seaweedfs/seaweedfs/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.609855046Z namespaces/kserve/pods/seaweedfs-86cc847c5c-6mhj8/seaweedfs/seaweedfs/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.609944159Z namespaces/kserve/pods/seaweedfs-86cc847c5c-6mhj8/seaweedfs/seaweedfs/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.61000857Z namespaces/kserve/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.610059271Z namespaces/kserve/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.610121162Z namespaces/kserve/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.610167073Z namespaces/kserve/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.610274226Z namespaces/kuadrant-system/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.610336917Z namespaces/kuadrant-system/kuadrant-system.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.610422009Z namespaces/kuadrant-system/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.61046921Z namespaces/kuadrant-system/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.610568812Z namespaces/kuadrant-system/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.610614693Z namespaces/kuadrant-system/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.610720725Z namespaces/kuadrant-system/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.611024011Z namespaces/kuadrant-system/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.611320988Z namespaces/kuadrant-system/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.611372069Z namespaces/kuadrant-system/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.61144223Z namespaces/kuadrant-system/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.611511682Z namespaces/kuadrant-system/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.611566293Z namespaces/kuadrant-system/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.611675055Z namespaces/kuadrant-system/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.611750237Z namespaces/kuadrant-system/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.611805688Z namespaces/kuadrant-system/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.61190763Z namespaces/kuadrant-system/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.611966651Z namespaces/kuadrant-system/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.611974022Z namespaces/kuadrant-system/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.612028353Z namespaces/kuadrant-system/coordination.k8s.io/leases/3745a16e.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.612132175Z namespaces/kuadrant-system/coordination.k8s.io/leases/a3f98d6c.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.612250437Z namespaces/kuadrant-system/coordination.k8s.io/leases/aac3a15d.authorino.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.61236131Z namespaces/kuadrant-system/coordination.k8s.io/leases/f139389e.kuadrant.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.612445932Z namespaces/kuadrant-system/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.612483972Z namespaces/kuadrant-system/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.612633196Z namespaces/kuadrant-system/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.612749278Z namespaces/kuadrant-system/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.613162197Z namespaces/kuadrant-system/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.613259419Z namespaces/kuadrant-system/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.613606126Z namespaces/kuadrant-system/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.613747069Z namespaces/kuadrant-system/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.613961964Z namespaces/kuadrant-system/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.614080456Z namespaces/kuadrant-system/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.614130117Z namespaces/kuadrant-system/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.61424394Z namespaces/kuadrant-system/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.614311191Z namespaces/kuadrant-system/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.614375682Z namespaces/kuadrant-system/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.614422363Z namespaces/kuadrant-system/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.614531116Z namespaces/kuadrant-system/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.614629198Z namespaces/kuadrant-system/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.614690589Z namespaces/kuadrant-system/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.61473338Z namespaces/kuadrant-system/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.614803902Z namespaces/kuadrant-system/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.614842972Z namespaces/kuadrant-system/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.614923484Z namespaces/kuadrant-system/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.614932364Z namespaces/kuadrant-system/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.615009826Z namespaces/kuadrant-system/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.615259331Z namespaces/kuadrant-system/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.615513037Z namespaces/kuadrant-system/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.61566757Z namespaces/kuadrant-system/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.615879234Z namespaces/kuadrant-system/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.61614073Z namespaces/kuadrant-system/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.616475897Z namespaces/kuadrant-system/operators.coreos.com/installplans/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.616526748Z namespaces/kuadrant-system/operators.coreos.com/installplans/install-72zxs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.616787293Z namespaces/kuadrant-system/operators.coreos.com/operatorconditions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.616838355Z namespaces/kuadrant-system/operators.coreos.com/operatorconditions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.616942927Z namespaces/kuadrant-system/operators.coreos.com/operatorconditions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.617048469Z namespaces/kuadrant-system/operators.coreos.com/operatorconditions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.617160452Z namespaces/kuadrant-system/operators.coreos.com/operatorconditions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.617252474Z namespaces/kuadrant-system/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.617298324Z namespaces/kuadrant-system/operators.coreos.com/operatorgroups/kuadrant.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.617374836Z namespaces/kuadrant-system/operators.coreos.com/subscriptions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.617430927Z namespaces/kuadrant-system/operators.coreos.com/subscriptions/authorino-operator-stable-redhat-operators-openshift-marketplace.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.61754234Z namespaces/kuadrant-system/operators.coreos.com/subscriptions/dns-operator-stable-redhat-operators-openshift-marketplace.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.617703873Z namespaces/kuadrant-system/operators.coreos.com/subscriptions/limitador-operator-stable-redhat-operators-openshift-marketplace.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.617814175Z namespaces/kuadrant-system/operators.coreos.com/subscriptions/rhcl-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.617901807Z namespaces/kuadrant-system/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.617912277Z namespaces/kuadrant-system/pods/authorino-68bd676465-jf4qz/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.617983329Z namespaces/kuadrant-system/pods/authorino-68bd676465-jf4qz/authorino-68bd676465-jf4qz.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.618068121Z namespaces/kuadrant-system/pods/authorino-68bd676465-jf4qz/authorino/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.618078211Z namespaces/kuadrant-system/pods/authorino-68bd676465-jf4qz/authorino/authorino/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.618085651Z namespaces/kuadrant-system/pods/authorino-68bd676465-jf4qz/authorino/authorino/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.618134762Z namespaces/kuadrant-system/pods/authorino-68bd676465-jf4qz/authorino/authorino/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.618879998Z namespaces/kuadrant-system/pods/authorino-68bd676465-jf4qz/authorino/authorino/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.618944929Z namespaces/kuadrant-system/pods/authorino-68bd676465-jf4qz/authorino/authorino/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.619019771Z namespaces/kuadrant-system/pods/authorino-operator-7587b89b76-4d9ct/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.619056432Z namespaces/kuadrant-system/pods/authorino-operator-7587b89b76-4d9ct/authorino-operator-7587b89b76-4d9ct.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.619154164Z namespaces/kuadrant-system/pods/authorino-operator-7587b89b76-4d9ct/manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.619161304Z namespaces/kuadrant-system/pods/authorino-operator-7587b89b76-4d9ct/manager/manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.619164584Z namespaces/kuadrant-system/pods/authorino-operator-7587b89b76-4d9ct/manager/manager/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.619204655Z namespaces/kuadrant-system/pods/authorino-operator-7587b89b76-4d9ct/manager/manager/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.61943719Z namespaces/kuadrant-system/pods/authorino-operator-7587b89b76-4d9ct/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.619516361Z namespaces/kuadrant-system/pods/authorino-operator-7587b89b76-4d9ct/manager/manager/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.619574513Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-844548ff4c-6kpsg/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.619640114Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-844548ff4c-6kpsg/dns-operator-controller-manager-844548ff4c-6kpsg.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.619741006Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-844548ff4c-6kpsg/manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.619750986Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-844548ff4c-6kpsg/manager/manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.619761576Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-844548ff4c-6kpsg/manager/manager/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.619830688Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-844548ff4c-6kpsg/manager/manager/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.61994051Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-844548ff4c-6kpsg/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.620008232Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-844548ff4c-6kpsg/manager/manager/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.620063113Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-6c886788f8-bvg5d/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.620110994Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-6c886788f8-bvg5d/kuadrant-console-plugin-6c886788f8-bvg5d.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.620220556Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-6c886788f8-bvg5d/kuadrant-console-plugin/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.620258937Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-6c886788f8-bvg5d/kuadrant-console-plugin/kuadrant-console-plugin/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.620280987Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-6c886788f8-bvg5d/kuadrant-console-plugin/kuadrant-console-plugin/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.620322319Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-6c886788f8-bvg5d/kuadrant-console-plugin/kuadrant-console-plugin/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.620420741Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-6c886788f8-bvg5d/kuadrant-console-plugin/kuadrant-console-plugin/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.620512712Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-6c886788f8-bvg5d/kuadrant-console-plugin/kuadrant-console-plugin/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.620556544Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-6ddf9554fc-z9p66/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.620615495Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-6ddf9554fc-z9p66/kuadrant-operator-controller-manager-6ddf9554fc-z9p66.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.620722597Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-6ddf9554fc-z9p66/manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.620731837Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-6ddf9554fc-z9p66/manager/manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.620737207Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-6ddf9554fc-z9p66/manager/manager/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.620809909Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-6ddf9554fc-z9p66/manager/manager/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.622337411Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-6ddf9554fc-z9p66/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.622433003Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-6ddf9554fc-z9p66/manager/manager/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.622483594Z namespaces/kuadrant-system/pods/limitador-limitador-67566c68b4-mrc5l/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.622532715Z namespaces/kuadrant-system/pods/limitador-limitador-67566c68b4-mrc5l/limitador-limitador-67566c68b4-mrc5l.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.622627557Z namespaces/kuadrant-system/pods/limitador-limitador-67566c68b4-mrc5l/limitador/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.622636948Z namespaces/kuadrant-system/pods/limitador-limitador-67566c68b4-mrc5l/limitador/limitador/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.622641428Z namespaces/kuadrant-system/pods/limitador-limitador-67566c68b4-mrc5l/limitador/limitador/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.622673388Z namespaces/kuadrant-system/pods/limitador-limitador-67566c68b4-mrc5l/limitador/limitador/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.622796511Z namespaces/kuadrant-system/pods/limitador-limitador-67566c68b4-mrc5l/limitador/limitador/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.622883623Z namespaces/kuadrant-system/pods/limitador-limitador-67566c68b4-mrc5l/limitador/limitador/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.622927864Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-c7fb4c8d5-grrpw/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.622988915Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-c7fb4c8d5-grrpw/limitador-operator-controller-manager-c7fb4c8d5-grrpw.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.623093137Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-c7fb4c8d5-grrpw/manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.623103307Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-c7fb4c8d5-grrpw/manager/manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.623111008Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-c7fb4c8d5-grrpw/manager/manager/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.623176229Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-c7fb4c8d5-grrpw/manager/manager/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.623348223Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-c7fb4c8d5-grrpw/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.623431054Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-c7fb4c8d5-grrpw/manager/manager/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.623471015Z namespaces/kuadrant-system/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.623535627Z namespaces/kuadrant-system/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.623590068Z namespaces/kuadrant-system/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.623652129Z namespaces/kuadrant-system/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.623725461Z namespaces/kube-node-lease/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.623735001Z namespaces/kube-node-lease/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.623754021Z namespaces/kube-node-lease/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.623794222Z namespaces/kube-node-lease/coordination.k8s.io/leases/ip-10-0-133-36.ec2.internal.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.623894754Z namespaces/kube-node-lease/coordination.k8s.io/leases/ip-10-0-134-232.ec2.internal.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.623976116Z namespaces/kube-node-lease/coordination.k8s.io/leases/ip-10-0-142-242.ec2.internal.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.624037277Z namespaces/kube-node-lease/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.624044507Z namespaces/kube-node-lease/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.624091079Z namespaces/kube-node-lease/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.624278922Z namespaces/kube-node-lease/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.624470676Z namespaces/kube-node-lease/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.6246192Z namespaces/kube-node-lease/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.624824034Z namespaces/kube-node-lease/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.625073559Z namespaces/kube-node-lease/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.625292004Z namespaces/kube-public/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.625304264Z namespaces/kube-public/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.625315064Z namespaces/kube-public/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.625377396Z namespaces/kube-public/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.625545699Z namespaces/kube-public/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.625727363Z namespaces/kube-public/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.625880616Z namespaces/kube-public/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.626085651Z namespaces/kube-public/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.626352266Z namespaces/kube-public/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.626592441Z namespaces/kube-system/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.626640962Z namespaces/kube-system/kube-system.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.626773195Z namespaces/kube-system/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.626822556Z namespaces/kube-system/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.626907298Z namespaces/kube-system/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.626954309Z namespaces/kube-system/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.627106322Z namespaces/kube-system/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.627194244Z namespaces/kube-system/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.627315937Z namespaces/kube-system/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.627376918Z namespaces/kube-system/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.627433639Z namespaces/kube-system/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.627501171Z namespaces/kube-system/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.627555782Z namespaces/kube-system/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.627654414Z namespaces/kube-system/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.627754026Z namespaces/kube-system/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.627805357Z namespaces/kube-system/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.627906929Z namespaces/kube-system/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.627962141Z namespaces/kube-system/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.627968501Z namespaces/kube-system/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.628024642Z namespaces/kube-system/coordination.k8s.io/leases/apiserver-ezkmacztfkieszuelui257g36a.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.628127474Z namespaces/kube-system/coordination.k8s.io/leases/cert-manager-cainjector-leader-election.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.628245447Z namespaces/kube-system/coordination.k8s.io/leases/cert-manager-controller.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.6284124Z namespaces/kube-system/coordination.k8s.io/leases/kube-controller-manager.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.628594834Z namespaces/kube-system/coordination.k8s.io/leases/kube-scheduler.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.628651985Z namespaces/kube-system/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.628716917Z namespaces/kube-system/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.628916061Z namespaces/kube-system/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.629004773Z namespaces/kube-system/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.629288169Z namespaces/kube-system/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.629375111Z namespaces/kube-system/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.629650056Z namespaces/kube-system/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.629783979Z namespaces/kube-system/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.630104066Z namespaces/kube-system/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.630182097Z namespaces/kube-system/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.630241819Z namespaces/kube-system/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.630354271Z namespaces/kube-system/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.630387762Z namespaces/kube-system/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.630487854Z namespaces/kube-system/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.630513765Z namespaces/kube-system/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.630617407Z namespaces/kube-system/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.630714649Z namespaces/kube-system/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.63078012Z namespaces/kube-system/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.630826961Z namespaces/kube-system/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.630911643Z namespaces/kube-system/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.630952344Z namespaces/kube-system/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.631032796Z namespaces/kube-system/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.631045296Z namespaces/kube-system/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.631110747Z namespaces/kube-system/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.631295441Z namespaces/kube-system/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.631487275Z namespaces/kube-system/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.631625958Z namespaces/kube-system/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.631834412Z namespaces/kube-system/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.632067497Z namespaces/kube-system/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.632299222Z namespaces/kube-system/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.632310373Z namespaces/kube-system/pods/global-pull-secret-syncer-m4t52/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.632369894Z namespaces/kube-system/pods/global-pull-secret-syncer-m4t52/global-pull-secret-syncer-m4t52.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.632467766Z namespaces/kube-system/pods/global-pull-secret-syncer-m4t52/global-pull-secret-syncer/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.632476866Z namespaces/kube-system/pods/global-pull-secret-syncer-m4t52/global-pull-secret-syncer/global-pull-secret-syncer/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.632484156Z namespaces/kube-system/pods/global-pull-secret-syncer-m4t52/global-pull-secret-syncer/global-pull-secret-syncer/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.632552148Z namespaces/kube-system/pods/global-pull-secret-syncer-m4t52/global-pull-secret-syncer/global-pull-secret-syncer/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.632805713Z namespaces/kube-system/pods/global-pull-secret-syncer-m4t52/global-pull-secret-syncer/global-pull-secret-syncer/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.632893415Z namespaces/kube-system/pods/global-pull-secret-syncer-m4t52/global-pull-secret-syncer/global-pull-secret-syncer/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.632942456Z namespaces/kube-system/pods/global-pull-secret-syncer-pblbn/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.632990997Z namespaces/kube-system/pods/global-pull-secret-syncer-pblbn/global-pull-secret-syncer-pblbn.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.633086869Z namespaces/kube-system/pods/global-pull-secret-syncer-pblbn/global-pull-secret-syncer/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.633096879Z namespaces/kube-system/pods/global-pull-secret-syncer-pblbn/global-pull-secret-syncer/global-pull-secret-syncer/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.63310915Z namespaces/kube-system/pods/global-pull-secret-syncer-pblbn/global-pull-secret-syncer/global-pull-secret-syncer/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.633172521Z namespaces/kube-system/pods/global-pull-secret-syncer-pblbn/global-pull-secret-syncer/global-pull-secret-syncer/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.633410676Z namespaces/kube-system/pods/global-pull-secret-syncer-pblbn/global-pull-secret-syncer/global-pull-secret-syncer/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.633492308Z namespaces/kube-system/pods/global-pull-secret-syncer-pblbn/global-pull-secret-syncer/global-pull-secret-syncer/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.633539909Z namespaces/kube-system/pods/global-pull-secret-syncer-vwv9h/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.63358126Z namespaces/kube-system/pods/global-pull-secret-syncer-vwv9h/global-pull-secret-syncer-vwv9h.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.633673211Z namespaces/kube-system/pods/global-pull-secret-syncer-vwv9h/global-pull-secret-syncer/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.633680642Z namespaces/kube-system/pods/global-pull-secret-syncer-vwv9h/global-pull-secret-syncer/global-pull-secret-syncer/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.633684092Z namespaces/kube-system/pods/global-pull-secret-syncer-vwv9h/global-pull-secret-syncer/global-pull-secret-syncer/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.633742283Z namespaces/kube-system/pods/global-pull-secret-syncer-vwv9h/global-pull-secret-syncer/global-pull-secret-syncer/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.633987208Z namespaces/kube-system/pods/global-pull-secret-syncer-vwv9h/global-pull-secret-syncer/global-pull-secret-syncer/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.63406958Z namespaces/kube-system/pods/global-pull-secret-syncer-vwv9h/global-pull-secret-syncer/global-pull-secret-syncer/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.634117001Z namespaces/kube-system/pods/konnectivity-agent-dzcxv/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.634154192Z namespaces/kube-system/pods/konnectivity-agent-dzcxv/konnectivity-agent-dzcxv.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.634261104Z namespaces/kube-system/pods/konnectivity-agent-dzcxv/konnectivity-agent/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.634274094Z namespaces/kube-system/pods/konnectivity-agent-dzcxv/konnectivity-agent/konnectivity-agent/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.634281475Z namespaces/kube-system/pods/konnectivity-agent-dzcxv/konnectivity-agent/konnectivity-agent/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.634336365Z namespaces/kube-system/pods/konnectivity-agent-dzcxv/konnectivity-agent/konnectivity-agent/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.634886007Z namespaces/kube-system/pods/konnectivity-agent-dzcxv/konnectivity-agent/konnectivity-agent/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.634976059Z namespaces/kube-system/pods/konnectivity-agent-dzcxv/konnectivity-agent/konnectivity-agent/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.63503499Z namespaces/kube-system/pods/konnectivity-agent-jfk4d/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.635102092Z namespaces/kube-system/pods/konnectivity-agent-jfk4d/konnectivity-agent-jfk4d.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.635185214Z namespaces/kube-system/pods/konnectivity-agent-jfk4d/konnectivity-agent/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.635191994Z namespaces/kube-system/pods/konnectivity-agent-jfk4d/konnectivity-agent/konnectivity-agent/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.635197854Z namespaces/kube-system/pods/konnectivity-agent-jfk4d/konnectivity-agent/konnectivity-agent/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.635317856Z namespaces/kube-system/pods/konnectivity-agent-jfk4d/konnectivity-agent/konnectivity-agent/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.635887009Z namespaces/kube-system/pods/konnectivity-agent-jfk4d/konnectivity-agent/konnectivity-agent/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.63596513Z namespaces/kube-system/pods/konnectivity-agent-jfk4d/konnectivity-agent/konnectivity-agent/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.636018701Z namespaces/kube-system/pods/konnectivity-agent-rvnzj/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.636077453Z namespaces/kube-system/pods/konnectivity-agent-rvnzj/konnectivity-agent-rvnzj.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.636166664Z namespaces/kube-system/pods/konnectivity-agent-rvnzj/konnectivity-agent/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.636186535Z namespaces/kube-system/pods/konnectivity-agent-rvnzj/konnectivity-agent/konnectivity-agent/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.636191845Z namespaces/kube-system/pods/konnectivity-agent-rvnzj/konnectivity-agent/konnectivity-agent/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.636279327Z namespaces/kube-system/pods/konnectivity-agent-rvnzj/konnectivity-agent/konnectivity-agent/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.636831909Z namespaces/kube-system/pods/konnectivity-agent-rvnzj/konnectivity-agent/konnectivity-agent/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.636921771Z namespaces/kube-system/pods/konnectivity-agent-rvnzj/konnectivity-agent/konnectivity-agent/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.636969261Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-133-36.ec2.internal/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.637017082Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-133-36.ec2.internal/kube-apiserver-proxy-ip-10-0-133-36.ec2.internal.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.637101664Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-133-36.ec2.internal/haproxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.637109544Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-133-36.ec2.internal/haproxy/haproxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.637115755Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-133-36.ec2.internal/haproxy/haproxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.637190326Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-133-36.ec2.internal/haproxy/haproxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.637459732Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-133-36.ec2.internal/haproxy/haproxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.637560874Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-133-36.ec2.internal/haproxy/haproxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.637622925Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-134-232.ec2.internal/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.637683607Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-134-232.ec2.internal/kube-apiserver-proxy-ip-10-0-134-232.ec2.internal.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.637782509Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-134-232.ec2.internal/haproxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.637797329Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-134-232.ec2.internal/haproxy/haproxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.637813879Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-134-232.ec2.internal/haproxy/haproxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.637918732Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-134-232.ec2.internal/haproxy/haproxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.638169127Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-134-232.ec2.internal/haproxy/haproxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.638294169Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-134-232.ec2.internal/haproxy/haproxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.63834181Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.638394172Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.638474713Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal/haproxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.638482904Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal/haproxy/haproxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.638488954Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal/haproxy/haproxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.638555415Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal/haproxy/haproxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.638716538Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal/haproxy/haproxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.63880528Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal/haproxy/haproxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.638876892Z namespaces/kube-system/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.638931733Z namespaces/kube-system/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.639022765Z namespaces/kube-system/rbac.authorization.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.639030855Z namespaces/kube-system/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.639083716Z namespaces/kube-system/rbac.authorization.k8s.io/rolebindings/network-diagnostics.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.639154618Z namespaces/kube-system/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.639195859Z namespaces/kube-system/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.639289331Z namespaces/open-cluster-management-769bf792-e6a2-42ba-a290-147a326c6/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.639301631Z namespaces/open-cluster-management-769bf792-e6a2-42ba-a290-147a326c6/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.639305461Z namespaces/open-cluster-management-769bf792-e6a2-42ba-a290-147a326c6/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.639355242Z namespaces/open-cluster-management-769bf792-e6a2-42ba-a290-147a326c6/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.639516086Z namespaces/open-cluster-management-769bf792-e6a2-42ba-a290-147a326c6/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.639699439Z namespaces/open-cluster-management-769bf792-e6a2-42ba-a290-147a326c6/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.639848722Z namespaces/open-cluster-management-769bf792-e6a2-42ba-a290-147a326c6/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.640059227Z namespaces/open-cluster-management-769bf792-e6a2-42ba-a290-147a326c6/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.640331123Z namespaces/open-cluster-management-769bf792-e6a2-42ba-a290-147a326c6/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.640538807Z namespaces/open-cluster-management-agent-addon/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.640546977Z namespaces/open-cluster-management-agent-addon/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.640553177Z namespaces/open-cluster-management-agent-addon/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.640620129Z namespaces/open-cluster-management-agent-addon/coordination.k8s.io/leases/cluster-proxy.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.640743221Z namespaces/open-cluster-management-agent-addon/coordination.k8s.io/leases/work-manager.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.640792802Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.640838283Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.640891775Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.641088339Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.641334844Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.641489667Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.641691432Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.641941437Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.642175972Z namespaces/openshift-apiserver-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.642245543Z namespaces/openshift-apiserver-operator/openshift-apiserver-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.642339245Z namespaces/openshift-apiserver-operator/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.642369516Z namespaces/openshift-apiserver-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.642448597Z namespaces/openshift-apiserver-operator/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.642486208Z namespaces/openshift-apiserver-operator/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.64257608Z namespaces/openshift-apiserver-operator/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.642654972Z namespaces/openshift-apiserver-operator/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.642734734Z namespaces/openshift-apiserver-operator/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.642790935Z namespaces/openshift-apiserver-operator/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.642841136Z namespaces/openshift-apiserver-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.642913478Z namespaces/openshift-apiserver-operator/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.642956459Z namespaces/openshift-apiserver-operator/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.643074521Z namespaces/openshift-apiserver-operator/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.643123542Z namespaces/openshift-apiserver-operator/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.643188663Z namespaces/openshift-apiserver-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.643314496Z namespaces/openshift-apiserver-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.643402528Z namespaces/openshift-apiserver-operator/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.643458679Z namespaces/openshift-apiserver-operator/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.644412939Z namespaces/openshift-apiserver-operator/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.644515641Z namespaces/openshift-apiserver-operator/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.644618634Z namespaces/openshift-apiserver-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.644719386Z namespaces/openshift-apiserver-operator/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.644819918Z namespaces/openshift-apiserver-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.644959141Z namespaces/openshift-apiserver-operator/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.645154175Z namespaces/openshift-apiserver-operator/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.645242557Z namespaces/openshift-apiserver-operator/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.645302658Z namespaces/openshift-apiserver-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.64537712Z namespaces/openshift-apiserver-operator/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.645421831Z namespaces/openshift-apiserver-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.645491572Z namespaces/openshift-apiserver-operator/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.645535533Z namespaces/openshift-apiserver-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.645639085Z namespaces/openshift-apiserver-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.645737937Z namespaces/openshift-apiserver-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.645795919Z namespaces/openshift-apiserver-operator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.64585074Z namespaces/openshift-apiserver-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.645917901Z namespaces/openshift-apiserver-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.645971462Z namespaces/openshift-apiserver-operator/monitoring.coreos.com/servicemonitors/openshift-apiserver-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.646040944Z namespaces/openshift-apiserver-operator/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.646081585Z namespaces/openshift-apiserver-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.646148746Z namespaces/openshift-apiserver-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.646158686Z namespaces/openshift-apiserver-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.646221328Z namespaces/openshift-apiserver-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.646465193Z namespaces/openshift-apiserver-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.646650087Z namespaces/openshift-apiserver-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.64680529Z namespaces/openshift-apiserver-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.647036855Z namespaces/openshift-apiserver-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.647356432Z namespaces/openshift-apiserver-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.647609927Z namespaces/openshift-apiserver-operator/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.647652548Z namespaces/openshift-apiserver-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.64772976Z namespaces/openshift-apiserver-operator/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.64777287Z namespaces/openshift-apiserver-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.647875053Z namespaces/openshift-apiserver/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.647933654Z namespaces/openshift-apiserver/openshift-apiserver.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.648005575Z namespaces/openshift-apiserver/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.648055016Z namespaces/openshift-apiserver/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.648132738Z namespaces/openshift-apiserver/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.648187829Z namespaces/openshift-apiserver/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.648312112Z namespaces/openshift-apiserver/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.648409454Z namespaces/openshift-apiserver/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.648504426Z namespaces/openshift-apiserver/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.648791412Z namespaces/openshift-apiserver/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.648848493Z namespaces/openshift-apiserver/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.648930035Z namespaces/openshift-apiserver/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.648985226Z namespaces/openshift-apiserver/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.649086488Z namespaces/openshift-apiserver/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.64914263Z namespaces/openshift-apiserver/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.649198921Z namespaces/openshift-apiserver/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.649316243Z namespaces/openshift-apiserver/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.649387015Z namespaces/openshift-apiserver/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.649444036Z namespaces/openshift-apiserver/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.649564819Z namespaces/openshift-apiserver/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.649663761Z namespaces/openshift-apiserver/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.649762533Z namespaces/openshift-apiserver/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.649859825Z namespaces/openshift-apiserver/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.649957547Z namespaces/openshift-apiserver/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.65009227Z namespaces/openshift-apiserver/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.650307674Z namespaces/openshift-apiserver/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.650377446Z namespaces/openshift-apiserver/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.650431817Z namespaces/openshift-apiserver/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.650519319Z namespaces/openshift-apiserver/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.65055846Z namespaces/openshift-apiserver/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.650635271Z namespaces/openshift-apiserver/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.650677472Z namespaces/openshift-apiserver/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.650783924Z namespaces/openshift-apiserver/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.650879007Z namespaces/openshift-apiserver/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.650952028Z namespaces/openshift-apiserver/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.650992829Z namespaces/openshift-apiserver/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.651085031Z namespaces/openshift-apiserver/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.651132912Z namespaces/openshift-apiserver/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.651202363Z namespaces/openshift-apiserver/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.651216843Z namespaces/openshift-apiserver/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.651304636Z namespaces/openshift-apiserver/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.651483959Z namespaces/openshift-apiserver/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.651673613Z namespaces/openshift-apiserver/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.651826976Z namespaces/openshift-apiserver/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.652028291Z namespaces/openshift-apiserver/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.652347658Z namespaces/openshift-apiserver/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.652562302Z namespaces/openshift-apiserver/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.652605683Z namespaces/openshift-apiserver/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.652690985Z namespaces/openshift-apiserver/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.652733016Z namespaces/openshift-apiserver/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.652810597Z namespaces/openshift-authentication-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.652818457Z namespaces/openshift-authentication-operator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.652826398Z namespaces/openshift-authentication-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.652881109Z namespaces/openshift-authentication-operator/monitoring.coreos.com/servicemonitors/authentication-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.6529547Z namespaces/openshift-authentication-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.652964861Z namespaces/openshift-authentication-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.653044612Z namespaces/openshift-authentication-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.653197336Z namespaces/openshift-authentication-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.65340751Z namespaces/openshift-authentication-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.653551113Z namespaces/openshift-authentication-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.653759817Z namespaces/openshift-authentication-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.653993752Z namespaces/openshift-authentication-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.654202737Z namespaces/openshift-authentication/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.654210747Z namespaces/openshift-authentication/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.654216877Z namespaces/openshift-authentication/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.654302529Z namespaces/openshift-authentication/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.654461742Z namespaces/openshift-authentication/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.654640436Z namespaces/openshift-authentication/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.654788399Z namespaces/openshift-authentication/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.654991574Z namespaces/openshift-authentication/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.655262449Z namespaces/openshift-authentication/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.655485234Z namespaces/openshift-cloud-controller-manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.655494144Z namespaces/openshift-cloud-controller-manager/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.655507665Z namespaces/openshift-cloud-controller-manager/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.655557815Z namespaces/openshift-cloud-controller-manager/coordination.k8s.io/leases/cloud-controller-manager.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.655629607Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.655650377Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.655710979Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.655862792Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.656059106Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.656166459Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.656391523Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.656625678Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.656879654Z namespaces/openshift-cloud-credential-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.656894444Z namespaces/openshift-cloud-credential-operator/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.656899834Z namespaces/openshift-cloud-credential-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.656926595Z namespaces/openshift-cloud-credential-operator/coordination.k8s.io/leases/cloud-credential-operator-leader.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.657005186Z namespaces/openshift-cloud-credential-operator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.657019427Z namespaces/openshift-cloud-credential-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.657048087Z namespaces/openshift-cloud-credential-operator/monitoring.coreos.com/servicemonitors/cloud-credential-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.657108448Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.657119529Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.65719172Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.657371484Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.657552878Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.657695361Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.657910696Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.658147761Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.658394366Z namespaces/openshift-cloud-network-config-controller/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.658455897Z namespaces/openshift-cloud-network-config-controller/openshift-cloud-network-config-controller.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.658531239Z namespaces/openshift-cloud-network-config-controller/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.65857289Z namespaces/openshift-cloud-network-config-controller/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.658654961Z namespaces/openshift-cloud-network-config-controller/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.658708432Z namespaces/openshift-cloud-network-config-controller/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.658810804Z namespaces/openshift-cloud-network-config-controller/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.658907867Z namespaces/openshift-cloud-network-config-controller/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.659008799Z namespaces/openshift-cloud-network-config-controller/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.6590786Z namespaces/openshift-cloud-network-config-controller/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.659118591Z namespaces/openshift-cloud-network-config-controller/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.659201063Z namespaces/openshift-cloud-network-config-controller/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.659304305Z namespaces/openshift-cloud-network-config-controller/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.659407117Z namespaces/openshift-cloud-network-config-controller/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.659471918Z namespaces/openshift-cloud-network-config-controller/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.65952663Z namespaces/openshift-cloud-network-config-controller/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.659626092Z namespaces/openshift-cloud-network-config-controller/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.659683373Z namespaces/openshift-cloud-network-config-controller/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.659693103Z namespaces/openshift-cloud-network-config-controller/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.659764455Z namespaces/openshift-cloud-network-config-controller/coordination.k8s.io/leases/cloud-network-config-controller-lock.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.659839796Z namespaces/openshift-cloud-network-config-controller/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.659873557Z namespaces/openshift-cloud-network-config-controller/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.66000052Z namespaces/openshift-cloud-network-config-controller/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.660092962Z namespaces/openshift-cloud-network-config-controller/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.660181094Z namespaces/openshift-cloud-network-config-controller/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.660306536Z namespaces/openshift-cloud-network-config-controller/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.660417098Z namespaces/openshift-cloud-network-config-controller/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.660570412Z namespaces/openshift-cloud-network-config-controller/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.660691484Z namespaces/openshift-cloud-network-config-controller/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.660765886Z namespaces/openshift-cloud-network-config-controller/core/serviceaccounts/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.660823447Z namespaces/openshift-cloud-network-config-controller/core/serviceaccounts/cloud-network-config-controller.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.660904399Z namespaces/openshift-cloud-network-config-controller/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.66094941Z namespaces/openshift-cloud-network-config-controller/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.661004491Z namespaces/openshift-cloud-network-config-controller/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.661045322Z namespaces/openshift-cloud-network-config-controller/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.661116733Z namespaces/openshift-cloud-network-config-controller/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.661155464Z namespaces/openshift-cloud-network-config-controller/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.661259267Z namespaces/openshift-cloud-network-config-controller/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.661371949Z namespaces/openshift-cloud-network-config-controller/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.66144241Z namespaces/openshift-cloud-network-config-controller/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.661498601Z namespaces/openshift-cloud-network-config-controller/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.661561093Z namespaces/openshift-cloud-network-config-controller/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.661614494Z namespaces/openshift-cloud-network-config-controller/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.661674345Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.661713926Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.661770487Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.661930561Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.662114174Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.662288518Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.662494193Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.662741608Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.662939142Z namespaces/openshift-cloud-network-config-controller/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.662987003Z namespaces/openshift-cloud-network-config-controller/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.663068975Z namespaces/openshift-cloud-network-config-controller/rbac.authorization.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.663077195Z namespaces/openshift-cloud-network-config-controller/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.663116626Z namespaces/openshift-cloud-network-config-controller/rbac.authorization.k8s.io/rolebindings/cloud-network-config-controller-rb.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.663183117Z namespaces/openshift-cloud-network-config-controller/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.663241769Z namespaces/openshift-cloud-network-config-controller/rbac.authorization.k8s.io/roles/cloud-network-config-controller.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.66331982Z namespaces/openshift-cloud-network-config-controller/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.663370041Z namespaces/openshift-cloud-network-config-controller/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.663463823Z namespaces/openshift-cluster-csi-drivers/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.663523574Z namespaces/openshift-cluster-csi-drivers/openshift-cluster-csi-drivers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.663608856Z namespaces/openshift-cluster-csi-drivers/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.663665937Z namespaces/openshift-cluster-csi-drivers/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.663730609Z namespaces/openshift-cluster-csi-drivers/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.66378059Z namespaces/openshift-cluster-csi-drivers/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.663921113Z namespaces/openshift-cluster-csi-drivers/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.664015425Z namespaces/openshift-cluster-csi-drivers/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.664110377Z namespaces/openshift-cluster-csi-drivers/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.664168388Z namespaces/openshift-cluster-csi-drivers/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.664223689Z namespaces/openshift-cluster-csi-drivers/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.664303411Z namespaces/openshift-cluster-csi-drivers/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.664361752Z namespaces/openshift-cluster-csi-drivers/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.664459674Z namespaces/openshift-cluster-csi-drivers/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.664527046Z namespaces/openshift-cluster-csi-drivers/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.664581667Z namespaces/openshift-cluster-csi-drivers/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.664684349Z namespaces/openshift-cluster-csi-drivers/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.66474935Z namespaces/openshift-cluster-csi-drivers/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.664760081Z namespaces/openshift-cluster-csi-drivers/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.664825692Z namespaces/openshift-cluster-csi-drivers/coordination.k8s.io/leases/ebs-csi-aws-com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.664915024Z namespaces/openshift-cluster-csi-drivers/coordination.k8s.io/leases/external-attacher-leader-ebs-csi-aws-com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.665002286Z namespaces/openshift-cluster-csi-drivers/coordination.k8s.io/leases/external-resizer-ebs-csi-aws-com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.665125178Z namespaces/openshift-cluster-csi-drivers/coordination.k8s.io/leases/external-snapshotter-leader-ebs-csi-aws-com.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.665221311Z namespaces/openshift-cluster-csi-drivers/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.665309742Z namespaces/openshift-cluster-csi-drivers/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.665436235Z namespaces/openshift-cluster-csi-drivers/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.665527907Z namespaces/openshift-cluster-csi-drivers/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.665856824Z namespaces/openshift-cluster-csi-drivers/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.665950336Z namespaces/openshift-cluster-csi-drivers/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.66615983Z namespaces/openshift-cluster-csi-drivers/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.666358075Z namespaces/openshift-cluster-csi-drivers/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.666486277Z namespaces/openshift-cluster-csi-drivers/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.666562309Z namespaces/openshift-cluster-csi-drivers/core/serviceaccounts/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.66661244Z namespaces/openshift-cluster-csi-drivers/core/serviceaccounts/aws-ebs-csi-driver-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.666695892Z namespaces/openshift-cluster-csi-drivers/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.666738093Z namespaces/openshift-cluster-csi-drivers/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.666823854Z namespaces/openshift-cluster-csi-drivers/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.666875386Z namespaces/openshift-cluster-csi-drivers/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.666950857Z namespaces/openshift-cluster-csi-drivers/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.667012878Z namespaces/openshift-cluster-csi-drivers/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.6671088Z namespaces/openshift-cluster-csi-drivers/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.667207793Z namespaces/openshift-cluster-csi-drivers/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.667285594Z namespaces/openshift-cluster-csi-drivers/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.667335285Z namespaces/openshift-cluster-csi-drivers/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.667397487Z namespaces/openshift-cluster-csi-drivers/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.667444708Z namespaces/openshift-cluster-csi-drivers/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.667528149Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.66753488Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.667580001Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.667737064Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.667917768Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.668060711Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.668319826Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.668559561Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.668765266Z namespaces/openshift-cluster-csi-drivers/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.668775576Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.668839197Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/aws-ebs-csi-driver-node-b2mfk.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.668942059Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/csi-driver/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.66895117Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/csi-driver/csi-driver/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.66895686Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/csi-driver/csi-driver/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.669018131Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/csi-driver/csi-driver/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.669131793Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/csi-driver/csi-driver/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.669213025Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/csi-driver/csi-driver/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.669300657Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/csi-liveness-probe/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.669310707Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/csi-liveness-probe/csi-liveness-probe/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.669318537Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/csi-liveness-probe/csi-liveness-probe/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.669377499Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/csi-liveness-probe/csi-liveness-probe/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.669488581Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/csi-liveness-probe/csi-liveness-probe/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.669571693Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/csi-liveness-probe/csi-liveness-probe/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.669619494Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/csi-node-driver-registrar/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.669628744Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/csi-node-driver-registrar/csi-node-driver-registrar/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.669632264Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/csi-node-driver-registrar/csi-node-driver-registrar/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.669685605Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/csi-node-driver-registrar/csi-node-driver-registrar/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.669784107Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/csi-node-driver-registrar/csi-node-driver-registrar/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.669869129Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-b2mfk/csi-node-driver-registrar/csi-node-driver-registrar/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.66991347Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.669988881Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/aws-ebs-csi-driver-node-lscsx.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.670125014Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/csi-driver/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.670135784Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/csi-driver/csi-driver/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.670140995Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/csi-driver/csi-driver/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.670176985Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/csi-driver/csi-driver/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.670316368Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/csi-driver/csi-driver/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.670414441Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/csi-driver/csi-driver/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.670430161Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/csi-liveness-probe/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.670448321Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/csi-liveness-probe/csi-liveness-probe/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.670467702Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/csi-liveness-probe/csi-liveness-probe/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.670547473Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/csi-liveness-probe/csi-liveness-probe/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.670656346Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/csi-liveness-probe/csi-liveness-probe/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.670744588Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/csi-liveness-probe/csi-liveness-probe/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.670807829Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/csi-node-driver-registrar/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.670816359Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/csi-node-driver-registrar/csi-node-driver-registrar/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.670822319Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/csi-node-driver-registrar/csi-node-driver-registrar/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.67087972Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/csi-node-driver-registrar/csi-node-driver-registrar/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.671004343Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/csi-node-driver-registrar/csi-node-driver-registrar/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.671095455Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-lscsx/csi-node-driver-registrar/csi-node-driver-registrar/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.671158096Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.671217618Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/aws-ebs-csi-driver-node-wplmf.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.67134133Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/csi-driver/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.671358841Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/csi-driver/csi-driver/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.671366011Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/csi-driver/csi-driver/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.671417202Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/csi-driver/csi-driver/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.671532304Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/csi-driver/csi-driver/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.671626836Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/csi-driver/csi-driver/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.671683928Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/csi-liveness-probe/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.671694428Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/csi-liveness-probe/csi-liveness-probe/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.671712658Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/csi-liveness-probe/csi-liveness-probe/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.671769129Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/csi-liveness-probe/csi-liveness-probe/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.671862721Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/csi-liveness-probe/csi-liveness-probe/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.671936753Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/csi-liveness-probe/csi-liveness-probe/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.671994174Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/csi-node-driver-registrar/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672001934Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/csi-node-driver-registrar/csi-node-driver-registrar/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672007644Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/csi-node-driver-registrar/csi-node-driver-registrar/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672083056Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/csi-node-driver-registrar/csi-node-driver-registrar/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672167908Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/csi-node-driver-registrar/csi-node-driver-registrar/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.67225112Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-wplmf/csi-node-driver-registrar/csi-node-driver-registrar/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672309271Z namespaces/openshift-cluster-csi-drivers/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672352862Z namespaces/openshift-cluster-csi-drivers/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672406933Z namespaces/openshift-cluster-csi-drivers/rbac.authorization.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672415023Z namespaces/openshift-cluster-csi-drivers/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672457734Z namespaces/openshift-cluster-csi-drivers/rbac.authorization.k8s.io/rolebindings/aws-ebs-csi-driver-operator-rolebinding.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672534626Z namespaces/openshift-cluster-csi-drivers/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672576616Z namespaces/openshift-cluster-csi-drivers/rbac.authorization.k8s.io/roles/aws-ebs-csi-driver-operator-role.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672672378Z namespaces/openshift-cluster-csi-drivers/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672696689Z namespaces/openshift-cluster-csi-drivers/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672790241Z namespaces/openshift-cluster-machine-approver/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672801891Z namespaces/openshift-cluster-machine-approver/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672807731Z namespaces/openshift-cluster-machine-approver/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672867953Z namespaces/openshift-cluster-machine-approver/coordination.k8s.io/leases/cluster-machine-approver-leader.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672940544Z namespaces/openshift-cluster-machine-approver/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672952435Z namespaces/openshift-cluster-machine-approver/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.672998125Z namespaces/openshift-cluster-machine-approver/monitoring.coreos.com/servicemonitors/cluster-machine-approver.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.673084977Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.673100867Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.673154399Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.673416714Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.673603988Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.673767102Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.674004937Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.674274072Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.674514748Z namespaces/openshift-cluster-node-tuning-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.674564238Z namespaces/openshift-cluster-node-tuning-operator/openshift-cluster-node-tuning-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.67465034Z namespaces/openshift-cluster-node-tuning-operator/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.674689701Z namespaces/openshift-cluster-node-tuning-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.674777863Z namespaces/openshift-cluster-node-tuning-operator/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.674822074Z namespaces/openshift-cluster-node-tuning-operator/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.674961787Z namespaces/openshift-cluster-node-tuning-operator/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.675070099Z namespaces/openshift-cluster-node-tuning-operator/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.675162151Z namespaces/openshift-cluster-node-tuning-operator/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.675222672Z namespaces/openshift-cluster-node-tuning-operator/apps/daemonsets/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.675298054Z namespaces/openshift-cluster-node-tuning-operator/apps/daemonsets/tuned.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.675393246Z namespaces/openshift-cluster-node-tuning-operator/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.675430727Z namespaces/openshift-cluster-node-tuning-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.675510649Z namespaces/openshift-cluster-node-tuning-operator/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.675546369Z namespaces/openshift-cluster-node-tuning-operator/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.675635881Z namespaces/openshift-cluster-node-tuning-operator/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.675696753Z namespaces/openshift-cluster-node-tuning-operator/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.675753744Z namespaces/openshift-cluster-node-tuning-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.675849376Z namespaces/openshift-cluster-node-tuning-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.675915827Z namespaces/openshift-cluster-node-tuning-operator/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.675922597Z namespaces/openshift-cluster-node-tuning-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.675988939Z namespaces/openshift-cluster-node-tuning-operator/coordination.k8s.io/leases/node-tuning-operator-lock.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.67605533Z namespaces/openshift-cluster-node-tuning-operator/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.676099331Z namespaces/openshift-cluster-node-tuning-operator/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.677036411Z namespaces/openshift-cluster-node-tuning-operator/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.677142333Z namespaces/openshift-cluster-node-tuning-operator/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.677333057Z namespaces/openshift-cluster-node-tuning-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.677435669Z namespaces/openshift-cluster-node-tuning-operator/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.677634203Z namespaces/openshift-cluster-node-tuning-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.677778037Z namespaces/openshift-cluster-node-tuning-operator/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.677982201Z namespaces/openshift-cluster-node-tuning-operator/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.678072253Z namespaces/openshift-cluster-node-tuning-operator/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.678120874Z namespaces/openshift-cluster-node-tuning-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.678250397Z namespaces/openshift-cluster-node-tuning-operator/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.67839123Z namespaces/openshift-cluster-node-tuning-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.678458471Z namespaces/openshift-cluster-node-tuning-operator/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.678508532Z namespaces/openshift-cluster-node-tuning-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.678609604Z namespaces/openshift-cluster-node-tuning-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.678705216Z namespaces/openshift-cluster-node-tuning-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.678779538Z namespaces/openshift-cluster-node-tuning-operator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.678835109Z namespaces/openshift-cluster-node-tuning-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.678920731Z namespaces/openshift-cluster-node-tuning-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.678971472Z namespaces/openshift-cluster-node-tuning-operator/monitoring.coreos.com/prometheusrules/node-tuning-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.679062974Z namespaces/openshift-cluster-node-tuning-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.679123755Z namespaces/openshift-cluster-node-tuning-operator/monitoring.coreos.com/servicemonitors/node-tuning-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.679186167Z namespaces/openshift-cluster-node-tuning-operator/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.679246578Z namespaces/openshift-cluster-node-tuning-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.679301889Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.67932899Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.679398161Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.679577465Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.679770829Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.679931172Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.680164287Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.680442043Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.680706949Z namespaces/openshift-cluster-node-tuning-operator/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.680714129Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-2h8b9/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.6807726Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-2h8b9/tuned-2h8b9.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.680871982Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-2h8b9/tuned/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.680880932Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-2h8b9/tuned/tuned/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.680912533Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-2h8b9/tuned/tuned/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.680973525Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-2h8b9/tuned/tuned/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.681097817Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-2h8b9/tuned/tuned/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.681184559Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-2h8b9/tuned/tuned/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.681266771Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-nb65j/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.681317722Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-nb65j/tuned-nb65j.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.681412524Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-nb65j/tuned/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.681443544Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-nb65j/tuned/tuned/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.681462555Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-nb65j/tuned/tuned/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.681530926Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-nb65j/tuned/tuned/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.6816867Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-nb65j/tuned/tuned/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.681768421Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-nb65j/tuned/tuned/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.681846693Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-xh68j/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.681949125Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-xh68j/tuned-xh68j.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.682043687Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-xh68j/tuned/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.682060988Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-xh68j/tuned/tuned/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.682082998Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-xh68j/tuned/tuned/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.682136129Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-xh68j/tuned/tuned/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.682276382Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-xh68j/tuned/tuned/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.682382974Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-xh68j/tuned/tuned/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.682514777Z namespaces/openshift-cluster-node-tuning-operator/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.682574538Z namespaces/openshift-cluster-node-tuning-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.6826525Z namespaces/openshift-cluster-node-tuning-operator/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.682705271Z namespaces/openshift-cluster-node-tuning-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.682759872Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.682775813Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/profiles/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.682800933Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/profiles/ip-10-0-133-36.ec2.internal.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.682924026Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/profiles/ip-10-0-134-232.ec2.internal.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.683034668Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/profiles/ip-10-0-142-242.ec2.internal.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.683095509Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/tuneds/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.683155111Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/tuneds/default.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.683280853Z namespaces/openshift-cluster-samples-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.683384405Z namespaces/openshift-cluster-samples-operator/openshift-cluster-samples-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.683457007Z namespaces/openshift-cluster-samples-operator/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.683508348Z namespaces/openshift-cluster-samples-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.68358697Z namespaces/openshift-cluster-samples-operator/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.683638331Z namespaces/openshift-cluster-samples-operator/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.683739583Z namespaces/openshift-cluster-samples-operator/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.683868216Z namespaces/openshift-cluster-samples-operator/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.683982558Z namespaces/openshift-cluster-samples-operator/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.684030259Z namespaces/openshift-cluster-samples-operator/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.68408629Z namespaces/openshift-cluster-samples-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.684151032Z namespaces/openshift-cluster-samples-operator/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.684202843Z namespaces/openshift-cluster-samples-operator/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.684312155Z namespaces/openshift-cluster-samples-operator/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.684377937Z namespaces/openshift-cluster-samples-operator/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.684438718Z namespaces/openshift-cluster-samples-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.68454261Z namespaces/openshift-cluster-samples-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.684620072Z namespaces/openshift-cluster-samples-operator/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.684675813Z namespaces/openshift-cluster-samples-operator/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.684867447Z namespaces/openshift-cluster-samples-operator/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.684968159Z namespaces/openshift-cluster-samples-operator/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.685106402Z namespaces/openshift-cluster-samples-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.685202564Z namespaces/openshift-cluster-samples-operator/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.685354907Z namespaces/openshift-cluster-samples-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.68549256Z namespaces/openshift-cluster-samples-operator/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.685685074Z namespaces/openshift-cluster-samples-operator/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.685752866Z namespaces/openshift-cluster-samples-operator/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.685805337Z namespaces/openshift-cluster-samples-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.685895979Z namespaces/openshift-cluster-samples-operator/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.68594998Z namespaces/openshift-cluster-samples-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.686026652Z namespaces/openshift-cluster-samples-operator/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.686086003Z namespaces/openshift-cluster-samples-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.686182975Z namespaces/openshift-cluster-samples-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.686302527Z namespaces/openshift-cluster-samples-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.686378259Z namespaces/openshift-cluster-samples-operator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.68643208Z namespaces/openshift-cluster-samples-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.686501482Z namespaces/openshift-cluster-samples-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.686549153Z namespaces/openshift-cluster-samples-operator/monitoring.coreos.com/prometheusrules/samples-operator-alerts.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.686630005Z namespaces/openshift-cluster-samples-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.686677935Z namespaces/openshift-cluster-samples-operator/monitoring.coreos.com/servicemonitors/cluster-samples-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.686745527Z namespaces/openshift-cluster-samples-operator/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.686791188Z namespaces/openshift-cluster-samples-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.686855049Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.68690328Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.686961952Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.687132075Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.687333469Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.687476212Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.687676927Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.687913462Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.688103076Z namespaces/openshift-cluster-samples-operator/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.688110756Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-6dc5bdb6b4-pxvnz/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.688143857Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-6dc5bdb6b4-pxvnz/cluster-samples-operator-6dc5bdb6b4-pxvnz.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.688244179Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-6dc5bdb6b4-pxvnz/cluster-samples-operator-watch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.688256139Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-6dc5bdb6b4-pxvnz/cluster-samples-operator-watch/cluster-samples-operator-watch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.688260149Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-6dc5bdb6b4-pxvnz/cluster-samples-operator-watch/cluster-samples-operator-watch/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.688341931Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-6dc5bdb6b4-pxvnz/cluster-samples-operator-watch/cluster-samples-operator-watch/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.688423082Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-6dc5bdb6b4-pxvnz/cluster-samples-operator-watch/cluster-samples-operator-watch/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.688496814Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-6dc5bdb6b4-pxvnz/cluster-samples-operator-watch/cluster-samples-operator-watch/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.688543365Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-6dc5bdb6b4-pxvnz/cluster-samples-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.688556185Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-6dc5bdb6b4-pxvnz/cluster-samples-operator/cluster-samples-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.688560865Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-6dc5bdb6b4-pxvnz/cluster-samples-operator/cluster-samples-operator/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.688594516Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-6dc5bdb6b4-pxvnz/cluster-samples-operator/cluster-samples-operator/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.689082926Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-6dc5bdb6b4-pxvnz/cluster-samples-operator/cluster-samples-operator/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.689176698Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-6dc5bdb6b4-pxvnz/cluster-samples-operator/cluster-samples-operator/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.689217309Z namespaces/openshift-cluster-samples-operator/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.689296261Z namespaces/openshift-cluster-samples-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.689374903Z namespaces/openshift-cluster-samples-operator/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.689422253Z namespaces/openshift-cluster-samples-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.689524946Z namespaces/openshift-cluster-storage-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.689581847Z namespaces/openshift-cluster-storage-operator/openshift-cluster-storage-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.689657478Z namespaces/openshift-cluster-storage-operator/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.6897091Z namespaces/openshift-cluster-storage-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.689786921Z namespaces/openshift-cluster-storage-operator/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.689840142Z namespaces/openshift-cluster-storage-operator/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.689997836Z namespaces/openshift-cluster-storage-operator/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.690119908Z namespaces/openshift-cluster-storage-operator/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.690253711Z namespaces/openshift-cluster-storage-operator/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.690354163Z namespaces/openshift-cluster-storage-operator/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.690411974Z namespaces/openshift-cluster-storage-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.690492246Z namespaces/openshift-cluster-storage-operator/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.690543777Z namespaces/openshift-cluster-storage-operator/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.690646079Z namespaces/openshift-cluster-storage-operator/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.690707261Z namespaces/openshift-cluster-storage-operator/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.690762082Z namespaces/openshift-cluster-storage-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.690866364Z namespaces/openshift-cluster-storage-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.690938556Z namespaces/openshift-cluster-storage-operator/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.690952166Z namespaces/openshift-cluster-storage-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.691012507Z namespaces/openshift-cluster-storage-operator/coordination.k8s.io/leases/data-source-validator-leader.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.691123249Z namespaces/openshift-cluster-storage-operator/coordination.k8s.io/leases/snapshot-controller-leader.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.691201491Z namespaces/openshift-cluster-storage-operator/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.691298523Z namespaces/openshift-cluster-storage-operator/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.691426756Z namespaces/openshift-cluster-storage-operator/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.691528728Z namespaces/openshift-cluster-storage-operator/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.691834305Z namespaces/openshift-cluster-storage-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.691921966Z namespaces/openshift-cluster-storage-operator/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.692048769Z namespaces/openshift-cluster-storage-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.692184632Z namespaces/openshift-cluster-storage-operator/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.692415877Z namespaces/openshift-cluster-storage-operator/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.692517819Z namespaces/openshift-cluster-storage-operator/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.69256109Z namespaces/openshift-cluster-storage-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.692642172Z namespaces/openshift-cluster-storage-operator/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.692691543Z namespaces/openshift-cluster-storage-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.692766564Z namespaces/openshift-cluster-storage-operator/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.692821846Z namespaces/openshift-cluster-storage-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.692921318Z namespaces/openshift-cluster-storage-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.69302157Z namespaces/openshift-cluster-storage-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.693099951Z namespaces/openshift-cluster-storage-operator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.693153373Z namespaces/openshift-cluster-storage-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.693244045Z namespaces/openshift-cluster-storage-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.693302016Z namespaces/openshift-cluster-storage-operator/monitoring.coreos.com/prometheusrules/prometheus.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.693401978Z namespaces/openshift-cluster-storage-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.693442719Z namespaces/openshift-cluster-storage-operator/monitoring.coreos.com/servicemonitors/cluster-storage-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.693533931Z namespaces/openshift-cluster-storage-operator/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.693572122Z namespaces/openshift-cluster-storage-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.693662594Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.693687114Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.693769526Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.693933509Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.694110873Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.694305477Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.694510761Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.694755757Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.694949551Z namespaces/openshift-cluster-storage-operator/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.694961311Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-7c6cbb6c87-pl48h/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.695035793Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-7c6cbb6c87-pl48h/volume-data-source-validator-7c6cbb6c87-pl48h.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.695145835Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-7c6cbb6c87-pl48h/volume-data-source-validator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.695156445Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-7c6cbb6c87-pl48h/volume-data-source-validator/volume-data-source-validator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.695165065Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-7c6cbb6c87-pl48h/volume-data-source-validator/volume-data-source-validator/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.695245607Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-7c6cbb6c87-pl48h/volume-data-source-validator/volume-data-source-validator/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.69536583Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-7c6cbb6c87-pl48h/volume-data-source-validator/volume-data-source-validator/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.695434241Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-7c6cbb6c87-pl48h/volume-data-source-validator/volume-data-source-validator/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.695510613Z namespaces/openshift-cluster-storage-operator/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.695559394Z namespaces/openshift-cluster-storage-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.695625925Z namespaces/openshift-cluster-storage-operator/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.695684226Z namespaces/openshift-cluster-storage-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.69584091Z namespaces/openshift-cluster-version/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.695879061Z namespaces/openshift-cluster-version/openshift-cluster-version.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.695952402Z namespaces/openshift-cluster-version/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.695985013Z namespaces/openshift-cluster-version/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.696049434Z namespaces/openshift-cluster-version/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.696095185Z namespaces/openshift-cluster-version/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.696190247Z namespaces/openshift-cluster-version/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.6963123Z namespaces/openshift-cluster-version/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.696414392Z namespaces/openshift-cluster-version/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.696483273Z namespaces/openshift-cluster-version/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.696543835Z namespaces/openshift-cluster-version/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.696616586Z namespaces/openshift-cluster-version/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.696676657Z namespaces/openshift-cluster-version/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.696768789Z namespaces/openshift-cluster-version/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.696839591Z namespaces/openshift-cluster-version/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.696894072Z namespaces/openshift-cluster-version/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.696993234Z namespaces/openshift-cluster-version/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.697062406Z namespaces/openshift-cluster-version/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.697069676Z namespaces/openshift-cluster-version/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.697124047Z namespaces/openshift-cluster-version/coordination.k8s.io/leases/version.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.697181648Z namespaces/openshift-cluster-version/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.697221449Z namespaces/openshift-cluster-version/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.697365112Z namespaces/openshift-cluster-version/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.697465334Z namespaces/openshift-cluster-version/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.697577786Z namespaces/openshift-cluster-version/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.697675628Z namespaces/openshift-cluster-version/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.697773001Z namespaces/openshift-cluster-version/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.697905483Z namespaces/openshift-cluster-version/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.698084797Z namespaces/openshift-cluster-version/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.698159239Z namespaces/openshift-cluster-version/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.69820301Z namespaces/openshift-cluster-version/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.698312642Z namespaces/openshift-cluster-version/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.698374273Z namespaces/openshift-cluster-version/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.698430955Z namespaces/openshift-cluster-version/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.698472215Z namespaces/openshift-cluster-version/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.698557797Z namespaces/openshift-cluster-version/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.698640219Z namespaces/openshift-cluster-version/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.69869873Z namespaces/openshift-cluster-version/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.698738601Z namespaces/openshift-cluster-version/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.698794312Z namespaces/openshift-cluster-version/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.698849573Z namespaces/openshift-cluster-version/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.698933145Z namespaces/openshift-cluster-version/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.698942055Z namespaces/openshift-cluster-version/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.699010547Z namespaces/openshift-cluster-version/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.69917195Z namespaces/openshift-cluster-version/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.699381735Z namespaces/openshift-cluster-version/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.699532298Z namespaces/openshift-cluster-version/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.699742882Z namespaces/openshift-cluster-version/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.699986908Z namespaces/openshift-cluster-version/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.700195832Z namespaces/openshift-cluster-version/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.700265383Z namespaces/openshift-cluster-version/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.700349895Z namespaces/openshift-cluster-version/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.700395946Z namespaces/openshift-cluster-version/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.700500848Z namespaces/openshift-config-managed/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.70055797Z namespaces/openshift-config-managed/openshift-config-managed.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.700636481Z namespaces/openshift-config-managed/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.700681312Z namespaces/openshift-config-managed/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.700757954Z namespaces/openshift-config-managed/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.700816835Z namespaces/openshift-config-managed/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.700916337Z namespaces/openshift-config-managed/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.701014319Z namespaces/openshift-config-managed/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.701109891Z namespaces/openshift-config-managed/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.701252355Z namespaces/openshift-config-managed/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.701376177Z namespaces/openshift-config-managed/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.701445688Z namespaces/openshift-config-managed/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.701483549Z namespaces/openshift-config-managed/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.701575651Z namespaces/openshift-config-managed/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.701612662Z namespaces/openshift-config-managed/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.701649623Z namespaces/openshift-config-managed/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.701736415Z namespaces/openshift-config-managed/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.701815436Z namespaces/openshift-config-managed/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.701852567Z namespaces/openshift-config-managed/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.704907782Z namespaces/openshift-config-managed/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.704997034Z namespaces/openshift-config-managed/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.705111426Z namespaces/openshift-config-managed/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.705186418Z namespaces/openshift-config-managed/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.705312221Z namespaces/openshift-config-managed/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.705446823Z namespaces/openshift-config-managed/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.705555175Z namespaces/openshift-config-managed/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.705614777Z namespaces/openshift-config-managed/core/configmaps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.705661518Z namespaces/openshift-config-managed/core/configmaps/console-public.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.70575638Z namespaces/openshift-config-managed/core/configmaps/openshift-network-features.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.705800601Z namespaces/openshift-config-managed/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.705852962Z namespaces/openshift-config-managed/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.705898913Z namespaces/openshift-config-managed/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.705944494Z namespaces/openshift-config-managed/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.705996255Z namespaces/openshift-config-managed/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.706043616Z namespaces/openshift-config-managed/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.706135788Z namespaces/openshift-config-managed/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.706210289Z namespaces/openshift-config-managed/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.706291401Z namespaces/openshift-config-managed/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.706351463Z namespaces/openshift-config-managed/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.706396683Z namespaces/openshift-config-managed/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.706437164Z namespaces/openshift-config-managed/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.706483355Z namespaces/openshift-config-managed/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.706519446Z namespaces/openshift-config-managed/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.706564587Z namespaces/openshift-config-managed/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.706744661Z namespaces/openshift-config-managed/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.706952395Z namespaces/openshift-config-managed/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.707103108Z namespaces/openshift-config-managed/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.707326483Z namespaces/openshift-config-managed/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.707578058Z namespaces/openshift-config-managed/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.707828074Z namespaces/openshift-config-managed/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.707877615Z namespaces/openshift-config-managed/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.707935546Z namespaces/openshift-config-managed/rbac.authorization.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.707945466Z namespaces/openshift-config-managed/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.707982617Z namespaces/openshift-config-managed/rbac.authorization.k8s.io/rolebindings/openshift-network-public-role-binding.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.708098269Z namespaces/openshift-config-managed/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.70814641Z namespaces/openshift-config-managed/rbac.authorization.k8s.io/roles/openshift-network-public-role.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.708195022Z namespaces/openshift-config-managed/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.708241113Z namespaces/openshift-config-managed/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.708308564Z namespaces/openshift-config-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.708320724Z namespaces/openshift-config-operator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.708324514Z namespaces/openshift-config-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.708365985Z namespaces/openshift-config-operator/monitoring.coreos.com/servicemonitors/config-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.708442667Z namespaces/openshift-config-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.708460207Z namespaces/openshift-config-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.708500438Z namespaces/openshift-config-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.708656051Z namespaces/openshift-config-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.708834125Z namespaces/openshift-config-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.708966948Z namespaces/openshift-config-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.709161162Z namespaces/openshift-config-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.709429708Z namespaces/openshift-config-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.709659883Z namespaces/openshift-config/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.709707344Z namespaces/openshift-config/openshift-config.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.709850557Z namespaces/openshift-config/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.709894308Z namespaces/openshift-config/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.709960699Z namespaces/openshift-config/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.7100026Z namespaces/openshift-config/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.710085482Z namespaces/openshift-config/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.710161013Z namespaces/openshift-config/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.710250145Z namespaces/openshift-config/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.710323727Z namespaces/openshift-config/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.710373558Z namespaces/openshift-config/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.710427139Z namespaces/openshift-config/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.71046285Z namespaces/openshift-config/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.710548752Z namespaces/openshift-config/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.710588532Z namespaces/openshift-config/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.710630523Z namespaces/openshift-config/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.710704795Z namespaces/openshift-config/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.710784186Z namespaces/openshift-config/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.710832907Z namespaces/openshift-config/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.71095817Z namespaces/openshift-config/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.711056432Z namespaces/openshift-config/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.711134954Z namespaces/openshift-config/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.711215066Z namespaces/openshift-config/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.711327938Z namespaces/openshift-config/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.711490052Z namespaces/openshift-config/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.711597844Z namespaces/openshift-config/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.711673645Z namespaces/openshift-config/core/secrets/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.711722676Z namespaces/openshift-config/core/secrets/pull-secret.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.711778047Z namespaces/openshift-config/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.711825099Z namespaces/openshift-config/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.7118901Z namespaces/openshift-config/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.711932301Z namespaces/openshift-config/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.711969191Z namespaces/openshift-config/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.712006562Z namespaces/openshift-config/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.712093964Z namespaces/openshift-config/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.712178356Z namespaces/openshift-config/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.712222887Z namespaces/openshift-config/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.712289898Z namespaces/openshift-config/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.712340899Z namespaces/openshift-config/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.71238471Z namespaces/openshift-config/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.712424431Z namespaces/openshift-config/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.712432351Z namespaces/openshift-config/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.712472732Z namespaces/openshift-config/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.712630685Z namespaces/openshift-config/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.712805309Z namespaces/openshift-config/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.712941742Z namespaces/openshift-config/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.713137616Z namespaces/openshift-config/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.713408882Z namespaces/openshift-config/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.713607786Z namespaces/openshift-config/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.713646267Z namespaces/openshift-config/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.713675448Z namespaces/openshift-config/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.713729559Z namespaces/openshift-config/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.71380823Z namespaces/openshift-console-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.713859452Z namespaces/openshift-console-operator/openshift-console-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.713952833Z namespaces/openshift-console-operator/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.713983914Z namespaces/openshift-console-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.714058336Z namespaces/openshift-console-operator/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.714102467Z namespaces/openshift-console-operator/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.714184618Z namespaces/openshift-console-operator/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.714334632Z namespaces/openshift-console-operator/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.714439294Z namespaces/openshift-console-operator/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.714483455Z namespaces/openshift-console-operator/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.714525316Z namespaces/openshift-console-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.714587597Z namespaces/openshift-console-operator/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.714623958Z namespaces/openshift-console-operator/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.71471193Z namespaces/openshift-console-operator/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.714808072Z namespaces/openshift-console-operator/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.714851103Z namespaces/openshift-console-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.714940195Z namespaces/openshift-console-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.714977666Z namespaces/openshift-console-operator/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.714985695Z namespaces/openshift-console-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.715046107Z namespaces/openshift-console-operator/coordination.k8s.io/leases/console-operator-lock.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.715118298Z namespaces/openshift-console-operator/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.715172719Z namespaces/openshift-console-operator/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.715783232Z namespaces/openshift-console-operator/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.715859964Z namespaces/openshift-console-operator/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.71611871Z namespaces/openshift-console-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.716194081Z namespaces/openshift-console-operator/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.716369465Z namespaces/openshift-console-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.716489238Z namespaces/openshift-console-operator/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.716656651Z namespaces/openshift-console-operator/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.716706832Z namespaces/openshift-console-operator/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.716755783Z namespaces/openshift-console-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.716804184Z namespaces/openshift-console-operator/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.716852565Z namespaces/openshift-console-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.716894376Z namespaces/openshift-console-operator/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.716930967Z namespaces/openshift-console-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.717014629Z namespaces/openshift-console-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.71709672Z namespaces/openshift-console-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.717132721Z namespaces/openshift-console-operator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.717178262Z namespaces/openshift-console-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.717252004Z namespaces/openshift-console-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.717310905Z namespaces/openshift-console-operator/monitoring.coreos.com/prometheusrules/cluster-monitoring-prometheus-rules.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.717365546Z namespaces/openshift-console-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.717408587Z namespaces/openshift-console-operator/monitoring.coreos.com/servicemonitors/console-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.717459118Z namespaces/openshift-console-operator/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.717501749Z namespaces/openshift-console-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.717614391Z namespaces/openshift-console-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.717630972Z namespaces/openshift-console-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.717672872Z namespaces/openshift-console-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.717834226Z namespaces/openshift-console-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.71801432Z namespaces/openshift-console-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.718151303Z namespaces/openshift-console-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.718374607Z namespaces/openshift-console-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.718607392Z namespaces/openshift-console-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.718808997Z namespaces/openshift-console-operator/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.718819067Z namespaces/openshift-console-operator/pods/console-operator-9d4b6777b-zxbmp/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.718864698Z namespaces/openshift-console-operator/pods/console-operator-9d4b6777b-zxbmp/console-operator-9d4b6777b-zxbmp.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.7189567Z namespaces/openshift-console-operator/pods/console-operator-9d4b6777b-zxbmp/console-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.71896452Z namespaces/openshift-console-operator/pods/console-operator-9d4b6777b-zxbmp/console-operator/console-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.71896827Z namespaces/openshift-console-operator/pods/console-operator-9d4b6777b-zxbmp/console-operator/console-operator/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.719022761Z namespaces/openshift-console-operator/pods/console-operator-9d4b6777b-zxbmp/console-operator/console-operator/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.719528042Z namespaces/openshift-console-operator/pods/console-operator-9d4b6777b-zxbmp/console-operator/console-operator/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.719564313Z namespaces/openshift-console-operator/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.719630504Z namespaces/openshift-console-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.719661665Z namespaces/openshift-console-operator/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.719707566Z namespaces/openshift-console-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.719763077Z namespaces/openshift-console-user-settings/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.719771227Z namespaces/openshift-console-user-settings/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.719778707Z namespaces/openshift-console-user-settings/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.719826128Z namespaces/openshift-console-user-settings/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.719986181Z namespaces/openshift-console-user-settings/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.720170985Z namespaces/openshift-console-user-settings/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.720347309Z namespaces/openshift-console-user-settings/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.720565014Z namespaces/openshift-console-user-settings/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.720806669Z namespaces/openshift-console-user-settings/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.721046784Z namespaces/openshift-console/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.721094415Z namespaces/openshift-console/openshift-console.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.721407732Z namespaces/openshift-console/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.721448003Z namespaces/openshift-console/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.721515224Z namespaces/openshift-console/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.721547965Z namespaces/openshift-console/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.721658237Z namespaces/openshift-console/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.72181692Z namespaces/openshift-console/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.722096886Z namespaces/openshift-console/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.722126097Z namespaces/openshift-console/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.722168078Z namespaces/openshift-console/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.722220899Z namespaces/openshift-console/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.72228843Z namespaces/openshift-console/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.722381692Z namespaces/openshift-console/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.722423073Z namespaces/openshift-console/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.722463124Z namespaces/openshift-console/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.722538536Z namespaces/openshift-console/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.722603817Z namespaces/openshift-console/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.722652518Z namespaces/openshift-console/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.723266771Z namespaces/openshift-console/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.723367523Z namespaces/openshift-console/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.72366367Z namespaces/openshift-console/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.723742251Z namespaces/openshift-console/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.723935315Z namespaces/openshift-console/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.724068598Z namespaces/openshift-console/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.724257662Z namespaces/openshift-console/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.724364734Z namespaces/openshift-console/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.724412435Z namespaces/openshift-console/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.724462096Z namespaces/openshift-console/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.724502647Z namespaces/openshift-console/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.724565939Z namespaces/openshift-console/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.724595259Z namespaces/openshift-console/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.724691581Z namespaces/openshift-console/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.724765073Z namespaces/openshift-console/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.724818734Z namespaces/openshift-console/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.724858145Z namespaces/openshift-console/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.724918746Z namespaces/openshift-console/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.724962767Z namespaces/openshift-console/monitoring.coreos.com/servicemonitors/console.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.725023208Z namespaces/openshift-console/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.725070739Z namespaces/openshift-console/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.72510802Z namespaces/openshift-console/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.725122201Z namespaces/openshift-console/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.725171342Z namespaces/openshift-console/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.725349265Z namespaces/openshift-console/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.725529309Z namespaces/openshift-console/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.725667512Z namespaces/openshift-console/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.725869066Z namespaces/openshift-console/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.726107381Z namespaces/openshift-console/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.726335826Z namespaces/openshift-console/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.726347296Z namespaces/openshift-console/pods/console-57dc596fcd-ql9q5/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.726388817Z namespaces/openshift-console/pods/console-57dc596fcd-ql9q5/console-57dc596fcd-ql9q5.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.72649319Z namespaces/openshift-console/pods/console-57dc596fcd-ql9q5/console/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.72650133Z namespaces/openshift-console/pods/console-57dc596fcd-ql9q5/console/console/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.72650956Z namespaces/openshift-console/pods/console-57dc596fcd-ql9q5/console/console/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.726558461Z namespaces/openshift-console/pods/console-57dc596fcd-ql9q5/console/console/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.726665803Z namespaces/openshift-console/pods/console-57dc596fcd-ql9q5/console/console/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.726744745Z namespaces/openshift-console/pods/console-57dc596fcd-ql9q5/console/console/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.726798276Z namespaces/openshift-console/pods/downloads-6bcc868b7-c6p8l/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.726842277Z namespaces/openshift-console/pods/downloads-6bcc868b7-c6p8l/downloads-6bcc868b7-c6p8l.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.726947449Z namespaces/openshift-console/pods/downloads-6bcc868b7-c6p8l/download-server/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.726955469Z namespaces/openshift-console/pods/downloads-6bcc868b7-c6p8l/download-server/download-server/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.72696264Z namespaces/openshift-console/pods/downloads-6bcc868b7-c6p8l/download-server/download-server/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.727041011Z namespaces/openshift-console/pods/downloads-6bcc868b7-c6p8l/download-server/download-server/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.727373868Z namespaces/openshift-console/pods/downloads-6bcc868b7-c6p8l/download-server/download-server/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.72745255Z namespaces/openshift-console/pods/downloads-6bcc868b7-c6p8l/download-server/download-server/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.727494861Z namespaces/openshift-console/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.727546122Z namespaces/openshift-console/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.727647174Z namespaces/openshift-console/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.727684135Z namespaces/openshift-console/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.727768406Z namespaces/openshift-controller-manager-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.727814507Z namespaces/openshift-controller-manager-operator/openshift-controller-manager-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.727900029Z namespaces/openshift-controller-manager-operator/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.72794799Z namespaces/openshift-controller-manager-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.728017522Z namespaces/openshift-controller-manager-operator/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.728071213Z namespaces/openshift-controller-manager-operator/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.728168035Z namespaces/openshift-controller-manager-operator/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.728305338Z namespaces/openshift-controller-manager-operator/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.72839746Z namespaces/openshift-controller-manager-operator/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.728469161Z namespaces/openshift-controller-manager-operator/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.728528383Z namespaces/openshift-controller-manager-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.728611884Z namespaces/openshift-controller-manager-operator/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.728646335Z namespaces/openshift-controller-manager-operator/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.728761227Z namespaces/openshift-controller-manager-operator/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.728817539Z namespaces/openshift-controller-manager-operator/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.72886409Z namespaces/openshift-controller-manager-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.728968852Z namespaces/openshift-controller-manager-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.729044913Z namespaces/openshift-controller-manager-operator/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.729088194Z namespaces/openshift-controller-manager-operator/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.729260848Z namespaces/openshift-controller-manager-operator/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.729401151Z namespaces/openshift-controller-manager-operator/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.729479673Z namespaces/openshift-controller-manager-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.729581235Z namespaces/openshift-controller-manager-operator/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.729658437Z namespaces/openshift-controller-manager-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.72981052Z namespaces/openshift-controller-manager-operator/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.730000014Z namespaces/openshift-controller-manager-operator/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.730061205Z namespaces/openshift-controller-manager-operator/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.73030093Z namespaces/openshift-controller-manager-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.730404902Z namespaces/openshift-controller-manager-operator/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.730479114Z namespaces/openshift-controller-manager-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.730558056Z namespaces/openshift-controller-manager-operator/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.730600137Z namespaces/openshift-controller-manager-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.730714459Z namespaces/openshift-controller-manager-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.730804881Z namespaces/openshift-controller-manager-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.730851082Z namespaces/openshift-controller-manager-operator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.730910653Z namespaces/openshift-controller-manager-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.730959294Z namespaces/openshift-controller-manager-operator/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.731020995Z namespaces/openshift-controller-manager-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.731079917Z namespaces/openshift-controller-manager-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.731101957Z namespaces/openshift-controller-manager-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.731170459Z namespaces/openshift-controller-manager-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.731378083Z namespaces/openshift-controller-manager-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.731669599Z namespaces/openshift-controller-manager-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.731734451Z namespaces/openshift-controller-manager-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.731943235Z namespaces/openshift-controller-manager-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.73218939Z namespaces/openshift-controller-manager-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.732408265Z namespaces/openshift-controller-manager-operator/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.732453156Z namespaces/openshift-controller-manager-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.732506077Z namespaces/openshift-controller-manager-operator/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.732551808Z namespaces/openshift-controller-manager-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.732617659Z namespaces/openshift-controller-manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.732671321Z namespaces/openshift-controller-manager/openshift-controller-manager.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.732727852Z namespaces/openshift-controller-manager/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.732773553Z namespaces/openshift-controller-manager/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.732831354Z namespaces/openshift-controller-manager/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.732890935Z namespaces/openshift-controller-manager/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.732963047Z namespaces/openshift-controller-manager/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.733045569Z namespaces/openshift-controller-manager/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.73312702Z namespaces/openshift-controller-manager/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.733174441Z namespaces/openshift-controller-manager/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.733220882Z namespaces/openshift-controller-manager/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.733305864Z namespaces/openshift-controller-manager/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.733349845Z namespaces/openshift-controller-manager/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.733440107Z namespaces/openshift-controller-manager/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.733488498Z namespaces/openshift-controller-manager/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.733543969Z namespaces/openshift-controller-manager/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.73361553Z namespaces/openshift-controller-manager/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.733672952Z namespaces/openshift-controller-manager/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.733684052Z namespaces/openshift-controller-manager/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.733723843Z namespaces/openshift-controller-manager/coordination.k8s.io/leases/openshift-master-controllers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.733790774Z namespaces/openshift-controller-manager/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.733822285Z namespaces/openshift-controller-manager/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.733946148Z namespaces/openshift-controller-manager/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.734023199Z namespaces/openshift-controller-manager/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.734109051Z namespaces/openshift-controller-manager/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.734196103Z namespaces/openshift-controller-manager/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.734299935Z namespaces/openshift-controller-manager/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.734436158Z namespaces/openshift-controller-manager/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.734586961Z namespaces/openshift-controller-manager/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.734769035Z namespaces/openshift-controller-manager/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.734807936Z namespaces/openshift-controller-manager/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.734875147Z namespaces/openshift-controller-manager/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.734906668Z namespaces/openshift-controller-manager/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.734971739Z namespaces/openshift-controller-manager/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.73502172Z namespaces/openshift-controller-manager/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.735116552Z namespaces/openshift-controller-manager/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.735188224Z namespaces/openshift-controller-manager/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.735267796Z namespaces/openshift-controller-manager/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.735314217Z namespaces/openshift-controller-manager/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.735368878Z namespaces/openshift-controller-manager/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.735407708Z namespaces/openshift-controller-manager/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.73548042Z namespaces/openshift-controller-manager/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.73549074Z namespaces/openshift-controller-manager/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.735525011Z namespaces/openshift-controller-manager/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.735681604Z namespaces/openshift-controller-manager/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.735852868Z namespaces/openshift-controller-manager/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.736000201Z namespaces/openshift-controller-manager/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.736197325Z namespaces/openshift-controller-manager/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.736456081Z namespaces/openshift-controller-manager/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.736684475Z namespaces/openshift-controller-manager/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.736716176Z namespaces/openshift-controller-manager/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.736791858Z namespaces/openshift-controller-manager/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.736837539Z namespaces/openshift-controller-manager/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.73689766Z namespaces/openshift-dns-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.736935011Z namespaces/openshift-dns-operator/openshift-dns-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.737003312Z namespaces/openshift-dns-operator/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.737046183Z namespaces/openshift-dns-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.737106865Z namespaces/openshift-dns-operator/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.737145356Z namespaces/openshift-dns-operator/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.737254608Z namespaces/openshift-dns-operator/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.73733504Z namespaces/openshift-dns-operator/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.737412181Z namespaces/openshift-dns-operator/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.737477423Z namespaces/openshift-dns-operator/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.737528913Z namespaces/openshift-dns-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.737583495Z namespaces/openshift-dns-operator/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.737636426Z namespaces/openshift-dns-operator/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.737708597Z namespaces/openshift-dns-operator/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.737768479Z namespaces/openshift-dns-operator/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.73782058Z namespaces/openshift-dns-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.737898671Z namespaces/openshift-dns-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.737949153Z namespaces/openshift-dns-operator/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.737999234Z namespaces/openshift-dns-operator/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.738101386Z namespaces/openshift-dns-operator/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.738182177Z namespaces/openshift-dns-operator/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.7382971Z namespaces/openshift-dns-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.738376322Z namespaces/openshift-dns-operator/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.738457893Z namespaces/openshift-dns-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.738579826Z namespaces/openshift-dns-operator/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.73875373Z namespaces/openshift-dns-operator/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.738824781Z namespaces/openshift-dns-operator/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.738872782Z namespaces/openshift-dns-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.738933073Z namespaces/openshift-dns-operator/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.738973124Z namespaces/openshift-dns-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.739051846Z namespaces/openshift-dns-operator/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.739094147Z namespaces/openshift-dns-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.739178899Z namespaces/openshift-dns-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.739384813Z namespaces/openshift-dns-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.739454984Z namespaces/openshift-dns-operator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.739510466Z namespaces/openshift-dns-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.739563327Z namespaces/openshift-dns-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.739604437Z namespaces/openshift-dns-operator/monitoring.coreos.com/prometheusrules/dns.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.739665169Z namespaces/openshift-dns-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.739698099Z namespaces/openshift-dns-operator/monitoring.coreos.com/servicemonitors/dns-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.739756101Z namespaces/openshift-dns-operator/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.739806412Z namespaces/openshift-dns-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.739847723Z namespaces/openshift-dns-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.739873523Z namespaces/openshift-dns-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.739923944Z namespaces/openshift-dns-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.740068557Z namespaces/openshift-dns-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.740271612Z namespaces/openshift-dns-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.740416705Z namespaces/openshift-dns-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.740622389Z namespaces/openshift-dns-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.740855794Z namespaces/openshift-dns-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.741048368Z namespaces/openshift-dns-operator/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.741093259Z namespaces/openshift-dns-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.74114601Z namespaces/openshift-dns-operator/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.741187181Z namespaces/openshift-dns-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.741249172Z namespaces/openshift-dns/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.741317474Z namespaces/openshift-dns/openshift-dns.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.741676952Z namespaces/openshift-dns/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.741723332Z namespaces/openshift-dns/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.741796104Z namespaces/openshift-dns/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.741827435Z namespaces/openshift-dns/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.741983758Z namespaces/openshift-dns/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.74206698Z namespaces/openshift-dns/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.742148041Z namespaces/openshift-dns/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.742189492Z namespaces/openshift-dns/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.742252114Z namespaces/openshift-dns/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.742319075Z namespaces/openshift-dns/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.742364146Z namespaces/openshift-dns/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.742444818Z namespaces/openshift-dns/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.742502399Z namespaces/openshift-dns/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.74255389Z namespaces/openshift-dns/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.742633472Z namespaces/openshift-dns/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.742685003Z namespaces/openshift-dns/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.742733274Z namespaces/openshift-dns/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.742846136Z namespaces/openshift-dns/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.742934628Z namespaces/openshift-dns/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.743159563Z namespaces/openshift-dns/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.743250335Z namespaces/openshift-dns/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.743526041Z namespaces/openshift-dns/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.743653223Z namespaces/openshift-dns/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.743831017Z namespaces/openshift-dns/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.743895808Z namespaces/openshift-dns/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.74394186Z namespaces/openshift-dns/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.743993431Z namespaces/openshift-dns/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.744035062Z namespaces/openshift-dns/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.744091933Z namespaces/openshift-dns/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.744128204Z namespaces/openshift-dns/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.744218926Z namespaces/openshift-dns/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.744318717Z namespaces/openshift-dns/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.744379199Z namespaces/openshift-dns/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.74443449Z namespaces/openshift-dns/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.744480431Z namespaces/openshift-dns/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.744520992Z namespaces/openshift-dns/monitoring.coreos.com/servicemonitors/dns-default.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.744575833Z namespaces/openshift-dns/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.744625244Z namespaces/openshift-dns/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.744653635Z namespaces/openshift-dns/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.744681435Z namespaces/openshift-dns/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.744741757Z namespaces/openshift-dns/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.744886829Z namespaces/openshift-dns/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.745070984Z namespaces/openshift-dns/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.745209786Z namespaces/openshift-dns/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.745428511Z namespaces/openshift-dns/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.745708407Z namespaces/openshift-dns/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746013884Z namespaces/openshift-dns/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746021313Z namespaces/openshift-dns/pods/dns-default-fp6xs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746062665Z namespaces/openshift-dns/pods/dns-default-fp6xs/dns-default-fp6xs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746151356Z namespaces/openshift-dns/pods/dns-default-fp6xs/dns/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746159176Z namespaces/openshift-dns/pods/dns-default-fp6xs/dns/dns/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746162607Z namespaces/openshift-dns/pods/dns-default-fp6xs/dns/dns/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746196567Z namespaces/openshift-dns/pods/dns-default-fp6xs/dns/dns/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.74634664Z namespaces/openshift-dns/pods/dns-default-fp6xs/dns/dns/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746423432Z namespaces/openshift-dns/pods/dns-default-fp6xs/dns/dns/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746440513Z namespaces/openshift-dns/pods/dns-default-fp6xs/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746444942Z namespaces/openshift-dns/pods/dns-default-fp6xs/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746451483Z namespaces/openshift-dns/pods/dns-default-fp6xs/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746500154Z namespaces/openshift-dns/pods/dns-default-fp6xs/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746594106Z namespaces/openshift-dns/pods/dns-default-fp6xs/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746661737Z namespaces/openshift-dns/pods/dns-default-fp6xs/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746712618Z namespaces/openshift-dns/pods/dns-default-jhpmf/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746754809Z namespaces/openshift-dns/pods/dns-default-jhpmf/dns-default-jhpmf.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746845271Z namespaces/openshift-dns/pods/dns-default-jhpmf/dns/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746852701Z namespaces/openshift-dns/pods/dns-default-jhpmf/dns/dns/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746856031Z namespaces/openshift-dns/pods/dns-default-jhpmf/dns/dns/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.746901492Z namespaces/openshift-dns/pods/dns-default-jhpmf/dns/dns/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747009365Z namespaces/openshift-dns/pods/dns-default-jhpmf/dns/dns/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747087696Z namespaces/openshift-dns/pods/dns-default-jhpmf/dns/dns/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747134037Z namespaces/openshift-dns/pods/dns-default-jhpmf/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747143537Z namespaces/openshift-dns/pods/dns-default-jhpmf/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747152128Z namespaces/openshift-dns/pods/dns-default-jhpmf/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747197418Z namespaces/openshift-dns/pods/dns-default-jhpmf/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747311471Z namespaces/openshift-dns/pods/dns-default-jhpmf/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747386513Z namespaces/openshift-dns/pods/dns-default-jhpmf/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747408063Z namespaces/openshift-dns/pods/dns-default-rbrfl/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747450754Z namespaces/openshift-dns/pods/dns-default-rbrfl/dns-default-rbrfl.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747533806Z namespaces/openshift-dns/pods/dns-default-rbrfl/dns/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747540316Z namespaces/openshift-dns/pods/dns-default-rbrfl/dns/dns/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747547546Z namespaces/openshift-dns/pods/dns-default-rbrfl/dns/dns/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747592717Z namespaces/openshift-dns/pods/dns-default-rbrfl/dns/dns/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747681219Z namespaces/openshift-dns/pods/dns-default-rbrfl/dns/dns/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.74775089Z namespaces/openshift-dns/pods/dns-default-rbrfl/dns/dns/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747797281Z namespaces/openshift-dns/pods/dns-default-rbrfl/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747804021Z namespaces/openshift-dns/pods/dns-default-rbrfl/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747809842Z namespaces/openshift-dns/pods/dns-default-rbrfl/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747861312Z namespaces/openshift-dns/pods/dns-default-rbrfl/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.747960345Z namespaces/openshift-dns/pods/dns-default-rbrfl/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.748021256Z namespaces/openshift-dns/pods/dns-default-rbrfl/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.748076047Z namespaces/openshift-dns/pods/node-resolver-9v87r/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.748126758Z namespaces/openshift-dns/pods/node-resolver-9v87r/node-resolver-9v87r.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.74821073Z namespaces/openshift-dns/pods/node-resolver-9v87r/dns-node-resolver/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.74821734Z namespaces/openshift-dns/pods/node-resolver-9v87r/dns-node-resolver/dns-node-resolver/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.74822078Z namespaces/openshift-dns/pods/node-resolver-9v87r/dns-node-resolver/dns-node-resolver/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.748284601Z namespaces/openshift-dns/pods/node-resolver-9v87r/dns-node-resolver/dns-node-resolver/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.748378263Z namespaces/openshift-dns/pods/node-resolver-9v87r/dns-node-resolver/dns-node-resolver/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.748446645Z namespaces/openshift-dns/pods/node-resolver-9v87r/dns-node-resolver/dns-node-resolver/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.748493946Z namespaces/openshift-dns/pods/node-resolver-nzxhn/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.748537717Z namespaces/openshift-dns/pods/node-resolver-nzxhn/node-resolver-nzxhn.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.748624769Z namespaces/openshift-dns/pods/node-resolver-nzxhn/dns-node-resolver/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.748635279Z namespaces/openshift-dns/pods/node-resolver-nzxhn/dns-node-resolver/dns-node-resolver/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.748643899Z namespaces/openshift-dns/pods/node-resolver-nzxhn/dns-node-resolver/dns-node-resolver/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.74866567Z namespaces/openshift-dns/pods/node-resolver-nzxhn/dns-node-resolver/dns-node-resolver/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.748771862Z namespaces/openshift-dns/pods/node-resolver-nzxhn/dns-node-resolver/dns-node-resolver/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.748837203Z namespaces/openshift-dns/pods/node-resolver-nzxhn/dns-node-resolver/dns-node-resolver/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.748887364Z namespaces/openshift-dns/pods/node-resolver-trd5d/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.748932875Z namespaces/openshift-dns/pods/node-resolver-trd5d/node-resolver-trd5d.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.749004697Z namespaces/openshift-dns/pods/node-resolver-trd5d/dns-node-resolver/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.749012527Z namespaces/openshift-dns/pods/node-resolver-trd5d/dns-node-resolver/dns-node-resolver/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.749022927Z namespaces/openshift-dns/pods/node-resolver-trd5d/dns-node-resolver/dns-node-resolver/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.749072418Z namespaces/openshift-dns/pods/node-resolver-trd5d/dns-node-resolver/dns-node-resolver/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.7491611Z namespaces/openshift-dns/pods/node-resolver-trd5d/dns-node-resolver/dns-node-resolver/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.749244442Z namespaces/openshift-dns/pods/node-resolver-trd5d/dns-node-resolver/dns-node-resolver/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.749289133Z namespaces/openshift-dns/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.749336824Z namespaces/openshift-dns/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.749391865Z namespaces/openshift-dns/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.749438246Z namespaces/openshift-dns/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.749503347Z namespaces/openshift-etcd/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.749553338Z namespaces/openshift-etcd/openshift-etcd.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.749604269Z namespaces/openshift-etcd/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.74964223Z namespaces/openshift-etcd/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.749716622Z namespaces/openshift-etcd/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.749751183Z namespaces/openshift-etcd/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.749833164Z namespaces/openshift-etcd/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.749917136Z namespaces/openshift-etcd/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.749995158Z namespaces/openshift-etcd/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.750042079Z namespaces/openshift-etcd/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.75008292Z namespaces/openshift-etcd/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.750136961Z namespaces/openshift-etcd/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.750174212Z namespaces/openshift-etcd/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.750352395Z namespaces/openshift-etcd/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.750421137Z namespaces/openshift-etcd/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.750467768Z namespaces/openshift-etcd/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.75054666Z namespaces/openshift-etcd/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.750617801Z namespaces/openshift-etcd/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.750661622Z namespaces/openshift-etcd/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.750762494Z namespaces/openshift-etcd/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.750838966Z namespaces/openshift-etcd/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.750921977Z namespaces/openshift-etcd/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.751009689Z namespaces/openshift-etcd/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.751096161Z namespaces/openshift-etcd/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.751224074Z namespaces/openshift-etcd/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.751403458Z namespaces/openshift-etcd/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.751444539Z namespaces/openshift-etcd/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.75149844Z namespaces/openshift-etcd/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.751538441Z namespaces/openshift-etcd/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.751591232Z namespaces/openshift-etcd/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.751630783Z namespaces/openshift-etcd/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.751680714Z namespaces/openshift-etcd/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.751758825Z namespaces/openshift-etcd/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.751833757Z namespaces/openshift-etcd/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.751885498Z namespaces/openshift-etcd/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.751929039Z namespaces/openshift-etcd/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.75197968Z namespaces/openshift-etcd/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.752030401Z namespaces/openshift-etcd/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.752078762Z namespaces/openshift-etcd/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.752091262Z namespaces/openshift-etcd/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.752150143Z namespaces/openshift-etcd/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.752333778Z namespaces/openshift-etcd/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.752508991Z namespaces/openshift-etcd/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.752647964Z namespaces/openshift-etcd/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.752859789Z namespaces/openshift-etcd/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.753090783Z namespaces/openshift-etcd/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.753322588Z namespaces/openshift-etcd/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.753340499Z namespaces/openshift-etcd/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.753419421Z namespaces/openshift-etcd/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.753464881Z namespaces/openshift-etcd/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.753542303Z namespaces/openshift-host-network/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.753569864Z namespaces/openshift-host-network/openshift-host-network.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.753658795Z namespaces/openshift-host-network/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.753698706Z namespaces/openshift-host-network/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.753759608Z namespaces/openshift-host-network/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.753799098Z namespaces/openshift-host-network/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.75388522Z namespaces/openshift-host-network/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.753960852Z namespaces/openshift-host-network/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.754045444Z namespaces/openshift-host-network/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.754095645Z namespaces/openshift-host-network/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.754142786Z namespaces/openshift-host-network/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.754205877Z namespaces/openshift-host-network/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.7543315Z namespaces/openshift-host-network/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.754420602Z namespaces/openshift-host-network/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.754467623Z namespaces/openshift-host-network/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.754513524Z namespaces/openshift-host-network/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.754593785Z namespaces/openshift-host-network/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.754668117Z namespaces/openshift-host-network/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.754709168Z namespaces/openshift-host-network/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.75481481Z namespaces/openshift-host-network/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.754888352Z namespaces/openshift-host-network/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.754969603Z namespaces/openshift-host-network/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.755074976Z namespaces/openshift-host-network/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.755153947Z namespaces/openshift-host-network/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.755320531Z namespaces/openshift-host-network/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.755423433Z namespaces/openshift-host-network/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.755478074Z namespaces/openshift-host-network/core/resourcequotas/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.755528835Z namespaces/openshift-host-network/core/resourcequotas/host-network-namespace-quotas.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.755595687Z namespaces/openshift-host-network/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.755643328Z namespaces/openshift-host-network/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.755698429Z namespaces/openshift-host-network/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.755728429Z namespaces/openshift-host-network/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.755790691Z namespaces/openshift-host-network/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.755833212Z namespaces/openshift-host-network/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.755920643Z namespaces/openshift-host-network/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.756002975Z namespaces/openshift-host-network/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.756055706Z namespaces/openshift-host-network/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.756103687Z namespaces/openshift-host-network/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.756157819Z namespaces/openshift-host-network/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.756199439Z namespaces/openshift-host-network/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.756298102Z namespaces/openshift-host-network/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.756313022Z namespaces/openshift-host-network/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.756362183Z namespaces/openshift-host-network/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.756519756Z namespaces/openshift-host-network/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.75669702Z namespaces/openshift-host-network/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.756836213Z namespaces/openshift-host-network/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.757027037Z namespaces/openshift-host-network/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.757272212Z namespaces/openshift-host-network/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.757477056Z namespaces/openshift-host-network/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.757522147Z namespaces/openshift-host-network/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.757575378Z namespaces/openshift-host-network/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.757616679Z namespaces/openshift-host-network/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.757712281Z namespaces/openshift-image-registry/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.757758693Z namespaces/openshift-image-registry/openshift-image-registry.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.757826044Z namespaces/openshift-image-registry/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.757850984Z namespaces/openshift-image-registry/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.757916926Z namespaces/openshift-image-registry/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.757965597Z namespaces/openshift-image-registry/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.758078569Z namespaces/openshift-image-registry/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.758213022Z namespaces/openshift-image-registry/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.758456797Z namespaces/openshift-image-registry/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.758479058Z namespaces/openshift-image-registry/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.758536389Z namespaces/openshift-image-registry/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.7585782Z namespaces/openshift-image-registry/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.758627851Z namespaces/openshift-image-registry/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.758729723Z namespaces/openshift-image-registry/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.758791664Z namespaces/openshift-image-registry/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.758837205Z namespaces/openshift-image-registry/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.758920927Z namespaces/openshift-image-registry/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.758961178Z namespaces/openshift-image-registry/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.758970108Z namespaces/openshift-image-registry/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.759025029Z namespaces/openshift-image-registry/coordination.k8s.io/leases/openshift-master-controllers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.759085361Z namespaces/openshift-image-registry/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.759125782Z namespaces/openshift-image-registry/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.760081982Z namespaces/openshift-image-registry/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.760177124Z namespaces/openshift-image-registry/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.76047043Z namespaces/openshift-image-registry/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.760561392Z namespaces/openshift-image-registry/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.760770026Z namespaces/openshift-image-registry/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.760903389Z namespaces/openshift-image-registry/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.761102663Z namespaces/openshift-image-registry/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.761163995Z namespaces/openshift-image-registry/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.761204555Z namespaces/openshift-image-registry/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.761286677Z namespaces/openshift-image-registry/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.761326278Z namespaces/openshift-image-registry/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.761532682Z namespaces/openshift-image-registry/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.761561643Z namespaces/openshift-image-registry/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.761665225Z namespaces/openshift-image-registry/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.761740927Z namespaces/openshift-image-registry/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.761804008Z namespaces/openshift-image-registry/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.76186288Z namespaces/openshift-image-registry/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.761940381Z namespaces/openshift-image-registry/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.761991702Z namespaces/openshift-image-registry/monitoring.coreos.com/prometheusrules/image-registry-operator-alerts.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.762101485Z namespaces/openshift-image-registry/monitoring.coreos.com/prometheusrules/image-registry-rules.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.762182846Z namespaces/openshift-image-registry/monitoring.coreos.com/prometheusrules/imagestreams-rules.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.762261658Z namespaces/openshift-image-registry/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.762311759Z namespaces/openshift-image-registry/monitoring.coreos.com/servicemonitors/image-registry.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.7623628Z namespaces/openshift-image-registry/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.762404821Z namespaces/openshift-image-registry/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.762466492Z namespaces/openshift-image-registry/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.762475592Z namespaces/openshift-image-registry/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.762528543Z namespaces/openshift-image-registry/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.762690477Z namespaces/openshift-image-registry/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.762883421Z namespaces/openshift-image-registry/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.763055245Z namespaces/openshift-image-registry/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.763273589Z namespaces/openshift-image-registry/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.763527705Z namespaces/openshift-image-registry/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.763732079Z namespaces/openshift-image-registry/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.763739119Z namespaces/openshift-image-registry/pods/image-registry-7584f55f55-p88k5/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.7637945Z namespaces/openshift-image-registry/pods/image-registry-7584f55f55-p88k5/image-registry-7584f55f55-p88k5.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.763907423Z namespaces/openshift-image-registry/pods/image-registry-7584f55f55-p88k5/registry/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.763915083Z namespaces/openshift-image-registry/pods/image-registry-7584f55f55-p88k5/registry/registry/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.763920093Z namespaces/openshift-image-registry/pods/image-registry-7584f55f55-p88k5/registry/registry/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.763966404Z namespaces/openshift-image-registry/pods/image-registry-7584f55f55-p88k5/registry/registry/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.765007496Z namespaces/openshift-image-registry/pods/image-registry-7584f55f55-p88k5/registry/registry/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.765083628Z namespaces/openshift-image-registry/pods/image-registry-7584f55f55-p88k5/registry/registry/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.765121249Z namespaces/openshift-image-registry/pods/node-ca-8fpvh/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.76517443Z namespaces/openshift-image-registry/pods/node-ca-8fpvh/node-ca-8fpvh.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.765278752Z namespaces/openshift-image-registry/pods/node-ca-8fpvh/node-ca/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.765292842Z namespaces/openshift-image-registry/pods/node-ca-8fpvh/node-ca/node-ca/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.765306542Z namespaces/openshift-image-registry/pods/node-ca-8fpvh/node-ca/node-ca/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.765347453Z namespaces/openshift-image-registry/pods/node-ca-8fpvh/node-ca/node-ca/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.765477966Z namespaces/openshift-image-registry/pods/node-ca-8fpvh/node-ca/node-ca/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.765552888Z namespaces/openshift-image-registry/pods/node-ca-8fpvh/node-ca/node-ca/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.765595488Z namespaces/openshift-image-registry/pods/node-ca-pzhk2/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.765635309Z namespaces/openshift-image-registry/pods/node-ca-pzhk2/node-ca-pzhk2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.765710721Z namespaces/openshift-image-registry/pods/node-ca-pzhk2/node-ca/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.765717381Z namespaces/openshift-image-registry/pods/node-ca-pzhk2/node-ca/node-ca/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.765720801Z namespaces/openshift-image-registry/pods/node-ca-pzhk2/node-ca/node-ca/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.765796803Z namespaces/openshift-image-registry/pods/node-ca-pzhk2/node-ca/node-ca/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.765929866Z namespaces/openshift-image-registry/pods/node-ca-pzhk2/node-ca/node-ca/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.766005187Z namespaces/openshift-image-registry/pods/node-ca-pzhk2/node-ca/node-ca/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.766057898Z namespaces/openshift-image-registry/pods/node-ca-whp9g/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.766103309Z namespaces/openshift-image-registry/pods/node-ca-whp9g/node-ca-whp9g.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.766174121Z namespaces/openshift-image-registry/pods/node-ca-whp9g/node-ca/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.766181571Z namespaces/openshift-image-registry/pods/node-ca-whp9g/node-ca/node-ca/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.766193241Z namespaces/openshift-image-registry/pods/node-ca-whp9g/node-ca/node-ca/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.766255463Z namespaces/openshift-image-registry/pods/node-ca-whp9g/node-ca/node-ca/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.766491558Z namespaces/openshift-image-registry/pods/node-ca-whp9g/node-ca/node-ca/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.766573919Z namespaces/openshift-image-registry/pods/node-ca-whp9g/node-ca/node-ca/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.76661236Z namespaces/openshift-image-registry/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.766654681Z namespaces/openshift-image-registry/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.766712532Z namespaces/openshift-image-registry/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.766760263Z namespaces/openshift-image-registry/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.766806624Z namespaces/openshift-infra/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.766813705Z namespaces/openshift-infra/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.766822325Z namespaces/openshift-infra/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.766876686Z namespaces/openshift-infra/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.767048199Z namespaces/openshift-infra/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.767224033Z namespaces/openshift-infra/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.767381937Z namespaces/openshift-infra/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.7680056Z namespaces/openshift-infra/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.768247975Z namespaces/openshift-infra/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.76849518Z namespaces/openshift-ingress-canary/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.76851361Z namespaces/openshift-ingress-canary/openshift-ingress-canary.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.768623383Z namespaces/openshift-ingress-canary/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.768645343Z namespaces/openshift-ingress-canary/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.768718755Z namespaces/openshift-ingress-canary/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.768766846Z namespaces/openshift-ingress-canary/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.768869068Z namespaces/openshift-ingress-canary/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.76894627Z namespaces/openshift-ingress-canary/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.769025201Z namespaces/openshift-ingress-canary/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.769071482Z namespaces/openshift-ingress-canary/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.769109203Z namespaces/openshift-ingress-canary/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.769159104Z namespaces/openshift-ingress-canary/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.769193705Z namespaces/openshift-ingress-canary/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.769300517Z namespaces/openshift-ingress-canary/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.769332048Z namespaces/openshift-ingress-canary/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.769379319Z namespaces/openshift-ingress-canary/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.769468181Z namespaces/openshift-ingress-canary/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.769536992Z namespaces/openshift-ingress-canary/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.769581823Z namespaces/openshift-ingress-canary/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.769701786Z namespaces/openshift-ingress-canary/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.769782967Z namespaces/openshift-ingress-canary/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.769939721Z namespaces/openshift-ingress-canary/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.770030062Z namespaces/openshift-ingress-canary/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.770191076Z namespaces/openshift-ingress-canary/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.77039588Z namespaces/openshift-ingress-canary/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.770560214Z namespaces/openshift-ingress-canary/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.770705377Z namespaces/openshift-ingress-canary/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.770733608Z namespaces/openshift-ingress-canary/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.770807939Z namespaces/openshift-ingress-canary/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.77084038Z namespaces/openshift-ingress-canary/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.770905971Z namespaces/openshift-ingress-canary/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.770934502Z namespaces/openshift-ingress-canary/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.771049374Z namespaces/openshift-ingress-canary/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.771131786Z namespaces/openshift-ingress-canary/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.771183117Z namespaces/openshift-ingress-canary/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.771251128Z namespaces/openshift-ingress-canary/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.77130212Z namespaces/openshift-ingress-canary/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.77134192Z namespaces/openshift-ingress-canary/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.771395342Z namespaces/openshift-ingress-canary/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.771408862Z namespaces/openshift-ingress-canary/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.771465513Z namespaces/openshift-ingress-canary/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.771617286Z namespaces/openshift-ingress-canary/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.77179421Z namespaces/openshift-ingress-canary/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.771931173Z namespaces/openshift-ingress-canary/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.772132207Z namespaces/openshift-ingress-canary/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.772403963Z namespaces/openshift-ingress-canary/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.772607777Z namespaces/openshift-ingress-canary/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.772614917Z namespaces/openshift-ingress-canary/pods/ingress-canary-5gnht/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.772662808Z namespaces/openshift-ingress-canary/pods/ingress-canary-5gnht/ingress-canary-5gnht.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.77275768Z namespaces/openshift-ingress-canary/pods/ingress-canary-5gnht/serve-healthcheck-canary/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.772769021Z namespaces/openshift-ingress-canary/pods/ingress-canary-5gnht/serve-healthcheck-canary/serve-healthcheck-canary/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.772774311Z namespaces/openshift-ingress-canary/pods/ingress-canary-5gnht/serve-healthcheck-canary/serve-healthcheck-canary/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.772810921Z namespaces/openshift-ingress-canary/pods/ingress-canary-5gnht/serve-healthcheck-canary/serve-healthcheck-canary/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.772908354Z namespaces/openshift-ingress-canary/pods/ingress-canary-5gnht/serve-healthcheck-canary/serve-healthcheck-canary/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.772980425Z namespaces/openshift-ingress-canary/pods/ingress-canary-5gnht/serve-healthcheck-canary/serve-healthcheck-canary/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.773033086Z namespaces/openshift-ingress-canary/pods/ingress-canary-whtpb/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.773076917Z namespaces/openshift-ingress-canary/pods/ingress-canary-whtpb/ingress-canary-whtpb.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.773143369Z namespaces/openshift-ingress-canary/pods/ingress-canary-whtpb/serve-healthcheck-canary/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.773149999Z namespaces/openshift-ingress-canary/pods/ingress-canary-whtpb/serve-healthcheck-canary/serve-healthcheck-canary/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.773155859Z namespaces/openshift-ingress-canary/pods/ingress-canary-whtpb/serve-healthcheck-canary/serve-healthcheck-canary/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.77321438Z namespaces/openshift-ingress-canary/pods/ingress-canary-whtpb/serve-healthcheck-canary/serve-healthcheck-canary/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.773328532Z namespaces/openshift-ingress-canary/pods/ingress-canary-whtpb/serve-healthcheck-canary/serve-healthcheck-canary/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.773403294Z namespaces/openshift-ingress-canary/pods/ingress-canary-whtpb/serve-healthcheck-canary/serve-healthcheck-canary/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.773455745Z namespaces/openshift-ingress-canary/pods/ingress-canary-xk55r/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.773510636Z namespaces/openshift-ingress-canary/pods/ingress-canary-xk55r/ingress-canary-xk55r.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.773574528Z namespaces/openshift-ingress-canary/pods/ingress-canary-xk55r/serve-healthcheck-canary/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.773582228Z namespaces/openshift-ingress-canary/pods/ingress-canary-xk55r/serve-healthcheck-canary/serve-healthcheck-canary/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.773727761Z namespaces/openshift-ingress-canary/pods/ingress-canary-xk55r/serve-healthcheck-canary/serve-healthcheck-canary/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.773771782Z namespaces/openshift-ingress-canary/pods/ingress-canary-xk55r/serve-healthcheck-canary/serve-healthcheck-canary/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.773864374Z namespaces/openshift-ingress-canary/pods/ingress-canary-xk55r/serve-healthcheck-canary/serve-healthcheck-canary/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.773932415Z namespaces/openshift-ingress-canary/pods/ingress-canary-xk55r/serve-healthcheck-canary/serve-healthcheck-canary/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.773972116Z namespaces/openshift-ingress-canary/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.774014287Z namespaces/openshift-ingress-canary/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.774076888Z namespaces/openshift-ingress-canary/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.774118609Z namespaces/openshift-ingress-canary/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.774221282Z namespaces/openshift-ingress-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.774339114Z namespaces/openshift-ingress-operator/openshift-ingress-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.774413726Z namespaces/openshift-ingress-operator/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.774450886Z namespaces/openshift-ingress-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.774514698Z namespaces/openshift-ingress-operator/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.774561089Z namespaces/openshift-ingress-operator/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.774689421Z namespaces/openshift-ingress-operator/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.774761203Z namespaces/openshift-ingress-operator/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.774844015Z namespaces/openshift-ingress-operator/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.774878216Z namespaces/openshift-ingress-operator/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.774925446Z namespaces/openshift-ingress-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.774985848Z namespaces/openshift-ingress-operator/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.77510828Z namespaces/openshift-ingress-operator/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.775204672Z namespaces/openshift-ingress-operator/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.775277864Z namespaces/openshift-ingress-operator/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.775324495Z namespaces/openshift-ingress-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.775409837Z namespaces/openshift-ingress-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.775478908Z namespaces/openshift-ingress-operator/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.775531079Z namespaces/openshift-ingress-operator/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.776083481Z namespaces/openshift-ingress-operator/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.776166573Z namespaces/openshift-ingress-operator/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.776294575Z namespaces/openshift-ingress-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.776377367Z namespaces/openshift-ingress-operator/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.776465639Z namespaces/openshift-ingress-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.776588522Z namespaces/openshift-ingress-operator/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.776761135Z namespaces/openshift-ingress-operator/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.776818357Z namespaces/openshift-ingress-operator/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.776865218Z namespaces/openshift-ingress-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.776916299Z namespaces/openshift-ingress-operator/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.776952609Z namespaces/openshift-ingress-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.777016701Z namespaces/openshift-ingress-operator/ingress.operator.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.777025701Z namespaces/openshift-ingress-operator/ingress.operator.openshift.io/dnsrecords/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.777073332Z namespaces/openshift-ingress-operator/ingress.operator.openshift.io/dnsrecords/default-wildcard.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.777147864Z namespaces/openshift-ingress-operator/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.777207115Z namespaces/openshift-ingress-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.777351538Z namespaces/openshift-ingress-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.77742911Z namespaces/openshift-ingress-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.777494731Z namespaces/openshift-ingress-operator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.777550462Z namespaces/openshift-ingress-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.777597153Z namespaces/openshift-ingress-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.777649234Z namespaces/openshift-ingress-operator/monitoring.coreos.com/prometheusrules/ingress-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.777709705Z namespaces/openshift-ingress-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.777754026Z namespaces/openshift-ingress-operator/monitoring.coreos.com/servicemonitors/ingress-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.777818608Z namespaces/openshift-ingress-operator/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.777863649Z namespaces/openshift-ingress-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.77792071Z namespaces/openshift-ingress-operator/operator.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.77793065Z namespaces/openshift-ingress-operator/operator.openshift.io/ingresscontrollers/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.777956731Z namespaces/openshift-ingress-operator/operator.openshift.io/ingresscontrollers/default.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.778036052Z namespaces/openshift-ingress-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.778049183Z namespaces/openshift-ingress-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.778110994Z namespaces/openshift-ingress-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.778299608Z namespaces/openshift-ingress-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.778492502Z namespaces/openshift-ingress-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.778631815Z namespaces/openshift-ingress-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.778842409Z namespaces/openshift-ingress-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.779091265Z namespaces/openshift-ingress-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.77933446Z namespaces/openshift-ingress-operator/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.779395281Z namespaces/openshift-ingress-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.779480763Z namespaces/openshift-ingress-operator/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.779521294Z namespaces/openshift-ingress-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.779618926Z namespaces/openshift-ingress/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.779659727Z namespaces/openshift-ingress/openshift-ingress.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.779930203Z namespaces/openshift-ingress/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.779976273Z namespaces/openshift-ingress/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.780033365Z namespaces/openshift-ingress/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.780080086Z namespaces/openshift-ingress/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.780158047Z namespaces/openshift-ingress/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.780528075Z namespaces/openshift-ingress/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.78076677Z namespaces/openshift-ingress/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.780820291Z namespaces/openshift-ingress/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.780876113Z namespaces/openshift-ingress/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.780932874Z namespaces/openshift-ingress/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.780978385Z namespaces/openshift-ingress/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.781124218Z namespaces/openshift-ingress/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.781183989Z namespaces/openshift-ingress/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.781255121Z namespaces/openshift-ingress/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.781368503Z namespaces/openshift-ingress/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.781419524Z namespaces/openshift-ingress/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.781428614Z namespaces/openshift-ingress/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.781485185Z namespaces/openshift-ingress/coordination.k8s.io/leases/istio-gateway-ca-openshift-gateway.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.781581747Z namespaces/openshift-ingress/coordination.k8s.io/leases/istio-gateway-deployment-openshift-gateway.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.781659779Z namespaces/openshift-ingress/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.78170548Z namespaces/openshift-ingress/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.782100889Z namespaces/openshift-ingress/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.782201861Z namespaces/openshift-ingress/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.782486577Z namespaces/openshift-ingress/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.782572679Z namespaces/openshift-ingress/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.782825714Z namespaces/openshift-ingress/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.782954727Z namespaces/openshift-ingress/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.783182792Z namespaces/openshift-ingress/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.783300844Z namespaces/openshift-ingress/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.783332975Z namespaces/openshift-ingress/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.783431287Z namespaces/openshift-ingress/gateway.networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.783441637Z namespaces/openshift-ingress/gateway.networking.k8s.io/gateways/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.783483238Z namespaces/openshift-ingress/gateway.networking.k8s.io/gateways/openshift-ai-inference.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.7835713Z namespaces/openshift-ingress/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.78360459Z namespaces/openshift-ingress/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.783667572Z namespaces/openshift-ingress/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.783720233Z namespaces/openshift-ingress/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.783816975Z namespaces/openshift-ingress/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.783886646Z namespaces/openshift-ingress/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.783948568Z namespaces/openshift-ingress/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.783988598Z namespaces/openshift-ingress/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.7840533Z namespaces/openshift-ingress/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.784083191Z namespaces/openshift-ingress/monitoring.coreos.com/servicemonitors/router-default.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.784151272Z namespaces/openshift-ingress/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.784176202Z namespaces/openshift-ingress/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.784254314Z namespaces/openshift-ingress/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.784296375Z namespaces/openshift-ingress/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.784342726Z namespaces/openshift-ingress/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.78451571Z namespaces/openshift-ingress/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.784688073Z namespaces/openshift-ingress/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.784820736Z namespaces/openshift-ingress/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.78501836Z namespaces/openshift-ingress/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.785257565Z namespaces/openshift-ingress/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.78548745Z namespaces/openshift-ingress/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.78549455Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-55ff986f96-nzp8n/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.785543602Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-55ff986f96-nzp8n/istiod-openshift-gateway-55ff986f96-nzp8n.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.785685025Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-55ff986f96-nzp8n/discovery/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.785695135Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-55ff986f96-nzp8n/discovery/discovery/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.785698665Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-55ff986f96-nzp8n/discovery/discovery/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.785731226Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-55ff986f96-nzp8n/discovery/discovery/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.787516564Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-55ff986f96-nzp8n/discovery/discovery/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.787564505Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-55ff986f96-nzp8n/discovery/discovery/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.787614835Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.787671287Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d/openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.787787339Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d/istio-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.787797929Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d/istio-proxy/istio-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.78780349Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d/istio-proxy/istio-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.78783021Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d/istio-proxy/istio-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.788002554Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d/istio-proxy/istio-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.788070695Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-6b94bb86d8-q7m5d/istio-proxy/istio-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.788125216Z namespaces/openshift-ingress/pods/router-default-7f4c79d4bd-dxrjx/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.788169287Z namespaces/openshift-ingress/pods/router-default-7f4c79d4bd-dxrjx/router-default-7f4c79d4bd-dxrjx.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.78830994Z namespaces/openshift-ingress/pods/router-default-7f4c79d4bd-dxrjx/router/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.788321581Z namespaces/openshift-ingress/pods/router-default-7f4c79d4bd-dxrjx/router/router/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.78832781Z namespaces/openshift-ingress/pods/router-default-7f4c79d4bd-dxrjx/router/router/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.788377472Z namespaces/openshift-ingress/pods/router-default-7f4c79d4bd-dxrjx/router/router/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.788495714Z namespaces/openshift-ingress/pods/router-default-7f4c79d4bd-dxrjx/router/router/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.788567056Z namespaces/openshift-ingress/pods/router-default-7f4c79d4bd-dxrjx/router/router/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.788611247Z namespaces/openshift-ingress/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.788657097Z namespaces/openshift-ingress/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.788702449Z namespaces/openshift-ingress/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.78874523Z namespaces/openshift-ingress/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.788846061Z namespaces/openshift-insights/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.788900153Z namespaces/openshift-insights/openshift-insights.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.788966184Z namespaces/openshift-insights/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.789008075Z namespaces/openshift-insights/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.789074866Z namespaces/openshift-insights/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.789108057Z namespaces/openshift-insights/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.789331182Z namespaces/openshift-insights/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.789585607Z namespaces/openshift-insights/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.78970389Z namespaces/openshift-insights/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.789784761Z namespaces/openshift-insights/apps/deployments/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.789834193Z namespaces/openshift-insights/apps/deployments/insights-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.789920004Z namespaces/openshift-insights/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.789966985Z namespaces/openshift-insights/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.790034817Z namespaces/openshift-insights/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.790087028Z namespaces/openshift-insights/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.79017451Z namespaces/openshift-insights/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.790225851Z namespaces/openshift-insights/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.790292572Z namespaces/openshift-insights/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.790379394Z namespaces/openshift-insights/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.790460666Z namespaces/openshift-insights/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.790510187Z namespaces/openshift-insights/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.791660341Z namespaces/openshift-insights/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.791787474Z namespaces/openshift-insights/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.792106861Z namespaces/openshift-insights/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.792270534Z namespaces/openshift-insights/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.792583981Z namespaces/openshift-insights/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.792675793Z namespaces/openshift-insights/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.792841456Z namespaces/openshift-insights/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.792923758Z namespaces/openshift-insights/core/configmaps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.792985189Z namespaces/openshift-insights/core/configmaps/service-ca-bundle.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.793072821Z namespaces/openshift-insights/core/serviceaccounts/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.793116282Z namespaces/openshift-insights/core/serviceaccounts/gather.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.793201814Z namespaces/openshift-insights/core/serviceaccounts/operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.793272705Z namespaces/openshift-insights/core/services/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.793315366Z namespaces/openshift-insights/core/services/metrics.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.793377997Z namespaces/openshift-insights/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.793417968Z namespaces/openshift-insights/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.79350238Z namespaces/openshift-insights/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.793544771Z namespaces/openshift-insights/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.793596322Z namespaces/openshift-insights/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.793648513Z namespaces/openshift-insights/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.793756485Z namespaces/openshift-insights/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.793858188Z namespaces/openshift-insights/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.793913269Z namespaces/openshift-insights/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.79395754Z namespaces/openshift-insights/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.794039971Z namespaces/openshift-insights/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.794088873Z namespaces/openshift-insights/monitoring.coreos.com/prometheusrules/insights-prometheus-rules.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.794167104Z namespaces/openshift-insights/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.794205225Z namespaces/openshift-insights/monitoring.coreos.com/servicemonitors/insights-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.794299397Z namespaces/openshift-insights/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.794342568Z namespaces/openshift-insights/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.794391919Z namespaces/openshift-insights/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.794405809Z namespaces/openshift-insights/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.7944549Z namespaces/openshift-insights/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.794659315Z namespaces/openshift-insights/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.79490983Z namespaces/openshift-insights/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.795110124Z namespaces/openshift-insights/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.79534833Z namespaces/openshift-insights/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.795612055Z namespaces/openshift-insights/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.795885131Z namespaces/openshift-insights/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.795894441Z namespaces/openshift-insights/pods/insights-operator-585dfdc468-w6q7n/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.795937842Z namespaces/openshift-insights/pods/insights-operator-585dfdc468-w6q7n/insights-operator-585dfdc468-w6q7n.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.796036814Z namespaces/openshift-insights/pods/insights-operator-585dfdc468-w6q7n/insights-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.796045024Z namespaces/openshift-insights/pods/insights-operator-585dfdc468-w6q7n/insights-operator/insights-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.796049504Z namespaces/openshift-insights/pods/insights-operator-585dfdc468-w6q7n/insights-operator/insights-operator/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.796089505Z namespaces/openshift-insights/pods/insights-operator-585dfdc468-w6q7n/insights-operator/insights-operator/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.796534204Z namespaces/openshift-insights/pods/insights-operator-585dfdc468-w6q7n/insights-operator/insights-operator/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.796880912Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.796930123Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/insights-runtime-extractor-6ck65.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.797023625Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/exporter/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.797032675Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/exporter/exporter/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.797045385Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/exporter/exporter/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.797100656Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/exporter/exporter/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.797197539Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/exporter/exporter/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.797303891Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/exporter/exporter/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.797346422Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/extractor/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.797359192Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/extractor/extractor/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.797408463Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/extractor/extractor/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.797473275Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/extractor/extractor/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.797576767Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/extractor/extractor/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.797649388Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/extractor/extractor/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.797680259Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.797692809Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.797697749Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.79773055Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.797824492Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.797895703Z namespaces/openshift-insights/pods/insights-runtime-extractor-6ck65/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.798157259Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.79821734Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/insights-runtime-extractor-sxbgk.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.798346453Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/exporter/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.798359573Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/exporter/exporter/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.798362983Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/exporter/exporter/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.798426145Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/exporter/exporter/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.798519387Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/exporter/exporter/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.798639269Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/exporter/exporter/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.79868004Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/extractor/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.79869239Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/extractor/extractor/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.79869607Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/extractor/extractor/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.798748962Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/extractor/extractor/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.798871844Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/extractor/extractor/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.798943546Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/extractor/extractor/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.798981406Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.798989407Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.798995377Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.799056758Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.799189701Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.799301223Z namespaces/openshift-insights/pods/insights-runtime-extractor-sxbgk/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.799370245Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.799417316Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/insights-runtime-extractor-vqxb9.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.799511848Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/exporter/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.799523968Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/exporter/exporter/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.799529498Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/exporter/exporter/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.799577289Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/exporter/exporter/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.799666011Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/exporter/exporter/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.799737182Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/exporter/exporter/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.799766933Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/extractor/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.799773283Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/extractor/extractor/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.799779333Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/extractor/extractor/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.799821084Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/extractor/extractor/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.799950417Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/extractor/extractor/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.800056679Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/extractor/extractor/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.80010907Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.800115751Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.8001219Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.800325905Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.800428667Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.800504009Z namespaces/openshift-insights/pods/insights-runtime-extractor-vqxb9/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.800533839Z namespaces/openshift-insights/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.80058865Z namespaces/openshift-insights/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.800641642Z namespaces/openshift-insights/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.800676412Z namespaces/openshift-insights/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.800723383Z namespaces/openshift-keda/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.800732924Z namespaces/openshift-keda/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.800757944Z namespaces/openshift-keda/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.800803225Z namespaces/openshift-keda/coordination.k8s.io/leases/olm-operator.keda.sh.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.800893857Z namespaces/openshift-keda/coordination.k8s.io/leases/operator.keda.sh.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.800953968Z namespaces/openshift-keda/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.800969778Z namespaces/openshift-keda/monitoring.coreos.com/podmonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.801004939Z namespaces/openshift-keda/monitoring.coreos.com/podmonitors/keda-olm-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.801074781Z namespaces/openshift-keda/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.801122242Z namespaces/openshift-keda/monitoring.coreos.com/servicemonitors/keda-admission-webhooks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.801212174Z namespaces/openshift-keda/monitoring.coreos.com/servicemonitors/keda-metrics-apiserver.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.801322796Z namespaces/openshift-keda/monitoring.coreos.com/servicemonitors/keda-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.801399418Z namespaces/openshift-keda/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.801407838Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.801448539Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.801605942Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.801793346Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/custom-metrics-autoscaler.v2.18.1-2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.80198074Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.802198535Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.802377068Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.802573363Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.802764437Z namespaces/openshift-keda/operators.coreos.com/installplans/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.802806137Z namespaces/openshift-keda/operators.coreos.com/installplans/install-42mzz.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.80290762Z namespaces/openshift-keda/operators.coreos.com/operatorconditions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.802945431Z namespaces/openshift-keda/operators.coreos.com/operatorconditions/custom-metrics-autoscaler.v2.18.1-2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.803018582Z namespaces/openshift-keda/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.803070153Z namespaces/openshift-keda/operators.coreos.com/operatorgroups/openshift-keda.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.803130544Z namespaces/openshift-keda/operators.coreos.com/subscriptions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.803167715Z namespaces/openshift-keda/operators.coreos.com/subscriptions/openshift-custom-metrics-autoscaler-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.803311118Z namespaces/openshift-kube-apiserver-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.803360089Z namespaces/openshift-kube-apiserver-operator/openshift-kube-apiserver-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.803440461Z namespaces/openshift-kube-apiserver-operator/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.803485512Z namespaces/openshift-kube-apiserver-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.803536813Z namespaces/openshift-kube-apiserver-operator/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.803578534Z namespaces/openshift-kube-apiserver-operator/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.803665636Z namespaces/openshift-kube-apiserver-operator/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.803750928Z namespaces/openshift-kube-apiserver-operator/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.803831919Z namespaces/openshift-kube-apiserver-operator/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.803895201Z namespaces/openshift-kube-apiserver-operator/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.803945492Z namespaces/openshift-kube-apiserver-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.803987342Z namespaces/openshift-kube-apiserver-operator/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.804036114Z namespaces/openshift-kube-apiserver-operator/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.804114715Z namespaces/openshift-kube-apiserver-operator/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.804273869Z namespaces/openshift-kube-apiserver-operator/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.80432352Z namespaces/openshift-kube-apiserver-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.804421202Z namespaces/openshift-kube-apiserver-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.804491173Z namespaces/openshift-kube-apiserver-operator/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.804541494Z namespaces/openshift-kube-apiserver-operator/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.804671727Z namespaces/openshift-kube-apiserver-operator/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.804754199Z namespaces/openshift-kube-apiserver-operator/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.804846461Z namespaces/openshift-kube-apiserver-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.804916122Z namespaces/openshift-kube-apiserver-operator/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.804997084Z namespaces/openshift-kube-apiserver-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.805137387Z namespaces/openshift-kube-apiserver-operator/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.805358702Z namespaces/openshift-kube-apiserver-operator/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.805422993Z namespaces/openshift-kube-apiserver-operator/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.805471394Z namespaces/openshift-kube-apiserver-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.805526335Z namespaces/openshift-kube-apiserver-operator/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.805572866Z namespaces/openshift-kube-apiserver-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.805628447Z namespaces/openshift-kube-apiserver-operator/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.805675478Z namespaces/openshift-kube-apiserver-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.80575811Z namespaces/openshift-kube-apiserver-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.805835242Z namespaces/openshift-kube-apiserver-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.805895783Z namespaces/openshift-kube-apiserver-operator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.805938514Z namespaces/openshift-kube-apiserver-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.806012985Z namespaces/openshift-kube-apiserver-operator/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.806072537Z namespaces/openshift-kube-apiserver-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.806144888Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.806159499Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.80621479Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.806405724Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.806585468Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.806731171Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.806921625Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.80719299Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.807415525Z namespaces/openshift-kube-apiserver-operator/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.807442726Z namespaces/openshift-kube-apiserver-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.807543328Z namespaces/openshift-kube-apiserver-operator/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.807593689Z namespaces/openshift-kube-apiserver-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.807747532Z namespaces/openshift-kube-apiserver/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.807800063Z namespaces/openshift-kube-apiserver/openshift-kube-apiserver.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.807858644Z namespaces/openshift-kube-apiserver/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.807887745Z namespaces/openshift-kube-apiserver/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.807968477Z namespaces/openshift-kube-apiserver/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.808012928Z namespaces/openshift-kube-apiserver/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.8080907Z namespaces/openshift-kube-apiserver/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.808180281Z namespaces/openshift-kube-apiserver/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.808283684Z namespaces/openshift-kube-apiserver/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.808342365Z namespaces/openshift-kube-apiserver/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.808396346Z namespaces/openshift-kube-apiserver/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.808471448Z namespaces/openshift-kube-apiserver/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.808529809Z namespaces/openshift-kube-apiserver/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.808621081Z namespaces/openshift-kube-apiserver/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.808683712Z namespaces/openshift-kube-apiserver/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.808734323Z namespaces/openshift-kube-apiserver/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.808836555Z namespaces/openshift-kube-apiserver/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.808924327Z namespaces/openshift-kube-apiserver/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.808961158Z namespaces/openshift-kube-apiserver/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.80906221Z namespaces/openshift-kube-apiserver/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.809136352Z namespaces/openshift-kube-apiserver/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.809219344Z namespaces/openshift-kube-apiserver/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.809336096Z namespaces/openshift-kube-apiserver/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.809413418Z namespaces/openshift-kube-apiserver/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.80954102Z namespaces/openshift-kube-apiserver/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.809728134Z namespaces/openshift-kube-apiserver/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.809932389Z namespaces/openshift-kube-apiserver/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.809969689Z namespaces/openshift-kube-apiserver/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.810036171Z namespaces/openshift-kube-apiserver/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.810076892Z namespaces/openshift-kube-apiserver/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.810134223Z namespaces/openshift-kube-apiserver/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.810176214Z namespaces/openshift-kube-apiserver/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.810287676Z namespaces/openshift-kube-apiserver/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.810368258Z namespaces/openshift-kube-apiserver/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.810419769Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.81046673Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.810532961Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.810572182Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/prometheusrules/api-usage.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.810700315Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/prometheusrules/podsecurity.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.810775106Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.810828158Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/servicemonitors/openshift-kube-apiserver.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.810892779Z namespaces/openshift-kube-apiserver/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.81094214Z namespaces/openshift-kube-apiserver/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.810993141Z namespaces/openshift-kube-apiserver/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.811008282Z namespaces/openshift-kube-apiserver/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.811055852Z namespaces/openshift-kube-apiserver/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.811216646Z namespaces/openshift-kube-apiserver/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.811494982Z namespaces/openshift-kube-apiserver/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.811683006Z namespaces/openshift-kube-apiserver/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.811942391Z namespaces/openshift-kube-apiserver/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.812246798Z namespaces/openshift-kube-apiserver/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.812462662Z namespaces/openshift-kube-apiserver/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.812514953Z namespaces/openshift-kube-apiserver/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.812568775Z namespaces/openshift-kube-apiserver/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.812616005Z namespaces/openshift-kube-apiserver/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.812680747Z namespaces/openshift-kube-controller-manager-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.812732828Z namespaces/openshift-kube-controller-manager-operator/openshift-kube-controller-manager-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.812798489Z namespaces/openshift-kube-controller-manager-operator/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.81284629Z namespaces/openshift-kube-controller-manager-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.812914602Z namespaces/openshift-kube-controller-manager-operator/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.812960393Z namespaces/openshift-kube-controller-manager-operator/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.813059375Z namespaces/openshift-kube-controller-manager-operator/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.813173747Z namespaces/openshift-kube-controller-manager-operator/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.813367501Z namespaces/openshift-kube-controller-manager-operator/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.813417462Z namespaces/openshift-kube-controller-manager-operator/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.813474234Z namespaces/openshift-kube-controller-manager-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.813526735Z namespaces/openshift-kube-controller-manager-operator/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.813582056Z namespaces/openshift-kube-controller-manager-operator/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.813677758Z namespaces/openshift-kube-controller-manager-operator/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.81375701Z namespaces/openshift-kube-controller-manager-operator/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.813808401Z namespaces/openshift-kube-controller-manager-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.813919123Z namespaces/openshift-kube-controller-manager-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.813979484Z namespaces/openshift-kube-controller-manager-operator/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.814027705Z namespaces/openshift-kube-controller-manager-operator/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.814134258Z namespaces/openshift-kube-controller-manager-operator/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.814218439Z namespaces/openshift-kube-controller-manager-operator/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.814325252Z namespaces/openshift-kube-controller-manager-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.814429424Z namespaces/openshift-kube-controller-manager-operator/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.814505796Z namespaces/openshift-kube-controller-manager-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.814635628Z namespaces/openshift-kube-controller-manager-operator/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.814877973Z namespaces/openshift-kube-controller-manager-operator/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.814966885Z namespaces/openshift-kube-controller-manager-operator/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.815044607Z namespaces/openshift-kube-controller-manager-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.815128979Z namespaces/openshift-kube-controller-manager-operator/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.8151787Z namespaces/openshift-kube-controller-manager-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.815268882Z namespaces/openshift-kube-controller-manager-operator/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.815317873Z namespaces/openshift-kube-controller-manager-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.815402135Z namespaces/openshift-kube-controller-manager-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.815508967Z namespaces/openshift-kube-controller-manager-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.815566728Z namespaces/openshift-kube-controller-manager-operator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.815611959Z namespaces/openshift-kube-controller-manager-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.81567451Z namespaces/openshift-kube-controller-manager-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.815717901Z namespaces/openshift-kube-controller-manager-operator/monitoring.coreos.com/servicemonitors/kube-controller-manager-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.815780223Z namespaces/openshift-kube-controller-manager-operator/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.815830824Z namespaces/openshift-kube-controller-manager-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.815887605Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.815900195Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.815950886Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.81611089Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.816322644Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.816467467Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.816674612Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.816905287Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.81709726Z namespaces/openshift-kube-controller-manager-operator/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.817141072Z namespaces/openshift-kube-controller-manager-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.817185342Z namespaces/openshift-kube-controller-manager-operator/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.817249924Z namespaces/openshift-kube-controller-manager-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.817314515Z namespaces/openshift-kube-controller-manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.817349666Z namespaces/openshift-kube-controller-manager/openshift-kube-controller-manager.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.817418437Z namespaces/openshift-kube-controller-manager/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.817453948Z namespaces/openshift-kube-controller-manager/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.817510119Z namespaces/openshift-kube-controller-manager/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.81754997Z namespaces/openshift-kube-controller-manager/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.817633022Z namespaces/openshift-kube-controller-manager/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.817713384Z namespaces/openshift-kube-controller-manager/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.817798085Z namespaces/openshift-kube-controller-manager/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.817839036Z namespaces/openshift-kube-controller-manager/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.817884377Z namespaces/openshift-kube-controller-manager/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.817934318Z namespaces/openshift-kube-controller-manager/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.817977639Z namespaces/openshift-kube-controller-manager/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.818054921Z namespaces/openshift-kube-controller-manager/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.818101722Z namespaces/openshift-kube-controller-manager/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.818143803Z namespaces/openshift-kube-controller-manager/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.818243135Z namespaces/openshift-kube-controller-manager/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.818299796Z namespaces/openshift-kube-controller-manager/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.818307326Z namespaces/openshift-kube-controller-manager/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.818344027Z namespaces/openshift-kube-controller-manager/coordination.k8s.io/leases/cluster-policy-controller-lock.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.818413359Z namespaces/openshift-kube-controller-manager/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.818458189Z namespaces/openshift-kube-controller-manager/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.818558631Z namespaces/openshift-kube-controller-manager/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.818633903Z namespaces/openshift-kube-controller-manager/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.818920179Z namespaces/openshift-kube-controller-manager/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.819011281Z namespaces/openshift-kube-controller-manager/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.819094813Z namespaces/openshift-kube-controller-manager/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.819220696Z namespaces/openshift-kube-controller-manager/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.819411809Z namespaces/openshift-kube-controller-manager/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.819467321Z namespaces/openshift-kube-controller-manager/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.819512022Z namespaces/openshift-kube-controller-manager/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.819561113Z namespaces/openshift-kube-controller-manager/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.819600373Z namespaces/openshift-kube-controller-manager/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.819654385Z namespaces/openshift-kube-controller-manager/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.819700316Z namespaces/openshift-kube-controller-manager/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.819787757Z namespaces/openshift-kube-controller-manager/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.819875269Z namespaces/openshift-kube-controller-manager/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.819932761Z namespaces/openshift-kube-controller-manager/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.820015732Z namespaces/openshift-kube-controller-manager/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.820070974Z namespaces/openshift-kube-controller-manager/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.820110774Z namespaces/openshift-kube-controller-manager/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.820166556Z namespaces/openshift-kube-controller-manager/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.820176116Z namespaces/openshift-kube-controller-manager/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.820217527Z namespaces/openshift-kube-controller-manager/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.82039805Z namespaces/openshift-kube-controller-manager/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.820593445Z namespaces/openshift-kube-controller-manager/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.820738008Z namespaces/openshift-kube-controller-manager/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.820937852Z namespaces/openshift-kube-controller-manager/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.821170597Z namespaces/openshift-kube-controller-manager/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.821484624Z namespaces/openshift-kube-controller-manager/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.821528865Z namespaces/openshift-kube-controller-manager/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.821580475Z namespaces/openshift-kube-controller-manager/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.821614886Z namespaces/openshift-kube-controller-manager/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.821675977Z namespaces/openshift-kube-scheduler-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.821721749Z namespaces/openshift-kube-scheduler-operator/openshift-kube-scheduler-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.82177736Z namespaces/openshift-kube-scheduler-operator/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.82181862Z namespaces/openshift-kube-scheduler-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.821869492Z namespaces/openshift-kube-scheduler-operator/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.821906473Z namespaces/openshift-kube-scheduler-operator/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.822015605Z namespaces/openshift-kube-scheduler-operator/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.822105287Z namespaces/openshift-kube-scheduler-operator/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.822185488Z namespaces/openshift-kube-scheduler-operator/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.8222638Z namespaces/openshift-kube-scheduler-operator/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.822321891Z namespaces/openshift-kube-scheduler-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.822368162Z namespaces/openshift-kube-scheduler-operator/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.822408423Z namespaces/openshift-kube-scheduler-operator/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.822488685Z namespaces/openshift-kube-scheduler-operator/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.822539346Z namespaces/openshift-kube-scheduler-operator/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.822586507Z namespaces/openshift-kube-scheduler-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.822672079Z namespaces/openshift-kube-scheduler-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.82272665Z namespaces/openshift-kube-scheduler-operator/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.822765851Z namespaces/openshift-kube-scheduler-operator/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.822869823Z namespaces/openshift-kube-scheduler-operator/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.822945115Z namespaces/openshift-kube-scheduler-operator/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.823035937Z namespaces/openshift-kube-scheduler-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.823117878Z namespaces/openshift-kube-scheduler-operator/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.82319524Z namespaces/openshift-kube-scheduler-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.823338893Z namespaces/openshift-kube-scheduler-operator/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.823495316Z namespaces/openshift-kube-scheduler-operator/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.823543367Z namespaces/openshift-kube-scheduler-operator/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.823591478Z namespaces/openshift-kube-scheduler-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.823633169Z namespaces/openshift-kube-scheduler-operator/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.82368367Z namespaces/openshift-kube-scheduler-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.823727181Z namespaces/openshift-kube-scheduler-operator/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.823771522Z namespaces/openshift-kube-scheduler-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.823849534Z namespaces/openshift-kube-scheduler-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.823931425Z namespaces/openshift-kube-scheduler-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.823981517Z namespaces/openshift-kube-scheduler-operator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.824027718Z namespaces/openshift-kube-scheduler-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.824067128Z namespaces/openshift-kube-scheduler-operator/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.824111459Z namespaces/openshift-kube-scheduler-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.824157Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.824165641Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.824199751Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.824389265Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.824556169Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.824691732Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.824884486Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.82511423Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.825349286Z namespaces/openshift-kube-scheduler-operator/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.825404817Z namespaces/openshift-kube-scheduler-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.825473908Z namespaces/openshift-kube-scheduler-operator/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.825514349Z namespaces/openshift-kube-scheduler-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.82557722Z namespaces/openshift-kube-scheduler/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.825636221Z namespaces/openshift-kube-scheduler/openshift-kube-scheduler.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.825686513Z namespaces/openshift-kube-scheduler/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.825723943Z namespaces/openshift-kube-scheduler/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.825780165Z namespaces/openshift-kube-scheduler/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.825829676Z namespaces/openshift-kube-scheduler/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.825912878Z namespaces/openshift-kube-scheduler/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.825986239Z namespaces/openshift-kube-scheduler/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.826064181Z namespaces/openshift-kube-scheduler/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.826105542Z namespaces/openshift-kube-scheduler/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.826157733Z namespaces/openshift-kube-scheduler/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.826211994Z namespaces/openshift-kube-scheduler/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.826303516Z namespaces/openshift-kube-scheduler/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.826387277Z namespaces/openshift-kube-scheduler/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.826442429Z namespaces/openshift-kube-scheduler/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.826543381Z namespaces/openshift-kube-scheduler/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.826621442Z namespaces/openshift-kube-scheduler/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.826667343Z namespaces/openshift-kube-scheduler/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.826707894Z namespaces/openshift-kube-scheduler/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.826806886Z namespaces/openshift-kube-scheduler/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.826882838Z namespaces/openshift-kube-scheduler/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.82696254Z namespaces/openshift-kube-scheduler/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.827057832Z namespaces/openshift-kube-scheduler/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.827134793Z namespaces/openshift-kube-scheduler/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.827280927Z namespaces/openshift-kube-scheduler/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.82743806Z namespaces/openshift-kube-scheduler/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.827487581Z namespaces/openshift-kube-scheduler/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.827531382Z namespaces/openshift-kube-scheduler/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.827576173Z namespaces/openshift-kube-scheduler/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.827615303Z namespaces/openshift-kube-scheduler/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.827661435Z namespaces/openshift-kube-scheduler/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.827701545Z namespaces/openshift-kube-scheduler/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.827776737Z namespaces/openshift-kube-scheduler/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.827855399Z namespaces/openshift-kube-scheduler/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.82790516Z namespaces/openshift-kube-scheduler/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.82793706Z namespaces/openshift-kube-scheduler/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.827988881Z namespaces/openshift-kube-scheduler/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.828027142Z namespaces/openshift-kube-scheduler/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.828077543Z namespaces/openshift-kube-scheduler/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.828086804Z namespaces/openshift-kube-scheduler/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.828126754Z namespaces/openshift-kube-scheduler/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.828312208Z namespaces/openshift-kube-scheduler/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.828509133Z namespaces/openshift-kube-scheduler/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.828648915Z namespaces/openshift-kube-scheduler/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.82884666Z namespaces/openshift-kube-scheduler/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.829074944Z namespaces/openshift-kube-scheduler/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.829302089Z namespaces/openshift-kube-scheduler/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.82934798Z namespaces/openshift-kube-scheduler/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.829405741Z namespaces/openshift-kube-scheduler/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.829438092Z namespaces/openshift-kube-scheduler/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.829509524Z namespaces/openshift-kube-storage-version-migrator-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.829558175Z namespaces/openshift-kube-storage-version-migrator-operator/openshift-kube-storage-version-migrator-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.829617446Z namespaces/openshift-kube-storage-version-migrator-operator/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.829652817Z namespaces/openshift-kube-storage-version-migrator-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.829707748Z namespaces/openshift-kube-storage-version-migrator-operator/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.829750209Z namespaces/openshift-kube-storage-version-migrator-operator/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.82983277Z namespaces/openshift-kube-storage-version-migrator-operator/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.829972984Z namespaces/openshift-kube-storage-version-migrator-operator/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.830074126Z namespaces/openshift-kube-storage-version-migrator-operator/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.830119456Z namespaces/openshift-kube-storage-version-migrator-operator/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.830168177Z namespaces/openshift-kube-storage-version-migrator-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.830216138Z namespaces/openshift-kube-storage-version-migrator-operator/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.8302849Z namespaces/openshift-kube-storage-version-migrator-operator/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.830436553Z namespaces/openshift-kube-storage-version-migrator-operator/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.830491764Z namespaces/openshift-kube-storage-version-migrator-operator/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.830534335Z namespaces/openshift-kube-storage-version-migrator-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.830619457Z namespaces/openshift-kube-storage-version-migrator-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.830673098Z namespaces/openshift-kube-storage-version-migrator-operator/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.830686049Z namespaces/openshift-kube-storage-version-migrator-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.83075093Z namespaces/openshift-kube-storage-version-migrator-operator/coordination.k8s.io/leases/openshift-kube-storage-version-migrator-operator-lock.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.830812061Z namespaces/openshift-kube-storage-version-migrator-operator/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.830862072Z namespaces/openshift-kube-storage-version-migrator-operator/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.831013006Z namespaces/openshift-kube-storage-version-migrator-operator/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.831123108Z namespaces/openshift-kube-storage-version-migrator-operator/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.831323232Z namespaces/openshift-kube-storage-version-migrator-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.831421424Z namespaces/openshift-kube-storage-version-migrator-operator/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.831546147Z namespaces/openshift-kube-storage-version-migrator-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.83168327Z namespaces/openshift-kube-storage-version-migrator-operator/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.831870994Z namespaces/openshift-kube-storage-version-migrator-operator/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.831933195Z namespaces/openshift-kube-storage-version-migrator-operator/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.831990666Z namespaces/openshift-kube-storage-version-migrator-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.832046008Z namespaces/openshift-kube-storage-version-migrator-operator/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.832093329Z namespaces/openshift-kube-storage-version-migrator-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.83215077Z namespaces/openshift-kube-storage-version-migrator-operator/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.832196621Z namespaces/openshift-kube-storage-version-migrator-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.832317123Z namespaces/openshift-kube-storage-version-migrator-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.832395135Z namespaces/openshift-kube-storage-version-migrator-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.832448976Z namespaces/openshift-kube-storage-version-migrator-operator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.832501387Z namespaces/openshift-kube-storage-version-migrator-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.832555938Z namespaces/openshift-kube-storage-version-migrator-operator/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.832600569Z namespaces/openshift-kube-storage-version-migrator-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.8326488Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.83265861Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.832717222Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.832909516Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.833084699Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.833224453Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.833476498Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.833731123Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.833923357Z namespaces/openshift-kube-storage-version-migrator-operator/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.833942748Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-6769c5d45-74bgx/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.833983429Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-6769c5d45-74bgx/kube-storage-version-migrator-operator-6769c5d45-74bgx.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.834115691Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-6769c5d45-74bgx/kube-storage-version-migrator-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.834126681Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-6769c5d45-74bgx/kube-storage-version-migrator-operator/kube-storage-version-migrator-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.834132692Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-6769c5d45-74bgx/kube-storage-version-migrator-operator/kube-storage-version-migrator-operator/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.834175513Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-6769c5d45-74bgx/kube-storage-version-migrator-operator/kube-storage-version-migrator-operator/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.834331896Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-6769c5d45-74bgx/kube-storage-version-migrator-operator/kube-storage-version-migrator-operator/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.834460759Z namespaces/openshift-kube-storage-version-migrator-operator/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.834503149Z namespaces/openshift-kube-storage-version-migrator-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.834556841Z namespaces/openshift-kube-storage-version-migrator-operator/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.834587411Z namespaces/openshift-kube-storage-version-migrator-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.834682463Z namespaces/openshift-kube-storage-version-migrator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.834731734Z namespaces/openshift-kube-storage-version-migrator/openshift-kube-storage-version-migrator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.834790116Z namespaces/openshift-kube-storage-version-migrator/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.834836667Z namespaces/openshift-kube-storage-version-migrator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.834882177Z namespaces/openshift-kube-storage-version-migrator/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.834925138Z namespaces/openshift-kube-storage-version-migrator/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.83500723Z namespaces/openshift-kube-storage-version-migrator/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.835127333Z namespaces/openshift-kube-storage-version-migrator/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.835220015Z namespaces/openshift-kube-storage-version-migrator/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.835300117Z namespaces/openshift-kube-storage-version-migrator/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.835333037Z namespaces/openshift-kube-storage-version-migrator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.835383308Z namespaces/openshift-kube-storage-version-migrator/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.835422579Z namespaces/openshift-kube-storage-version-migrator/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.835502581Z namespaces/openshift-kube-storage-version-migrator/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.835544922Z namespaces/openshift-kube-storage-version-migrator/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.835592963Z namespaces/openshift-kube-storage-version-migrator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.835664164Z namespaces/openshift-kube-storage-version-migrator/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.835715875Z namespaces/openshift-kube-storage-version-migrator/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.835761646Z namespaces/openshift-kube-storage-version-migrator/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.835855778Z namespaces/openshift-kube-storage-version-migrator/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.83593178Z namespaces/openshift-kube-storage-version-migrator/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.836050242Z namespaces/openshift-kube-storage-version-migrator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.836122534Z namespaces/openshift-kube-storage-version-migrator/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.836250806Z namespaces/openshift-kube-storage-version-migrator/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.83639304Z namespaces/openshift-kube-storage-version-migrator/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.836584014Z namespaces/openshift-kube-storage-version-migrator/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.836630715Z namespaces/openshift-kube-storage-version-migrator/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.836651415Z namespaces/openshift-kube-storage-version-migrator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.836716707Z namespaces/openshift-kube-storage-version-migrator/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.836753127Z namespaces/openshift-kube-storage-version-migrator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.836807408Z namespaces/openshift-kube-storage-version-migrator/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.836845429Z namespaces/openshift-kube-storage-version-migrator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.836933441Z namespaces/openshift-kube-storage-version-migrator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.837005813Z namespaces/openshift-kube-storage-version-migrator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.837058264Z namespaces/openshift-kube-storage-version-migrator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.837101975Z namespaces/openshift-kube-storage-version-migrator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.837146376Z namespaces/openshift-kube-storage-version-migrator/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.837189517Z namespaces/openshift-kube-storage-version-migrator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.837257728Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.837301899Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.83737059Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.837517704Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.837694477Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.83784854Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.838045835Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.83830356Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.838494664Z namespaces/openshift-kube-storage-version-migrator/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.838506345Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-74bb7799d9-ss8cr/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.838569286Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-74bb7799d9-ss8cr/migrator-74bb7799d9-ss8cr.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.838657118Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-74bb7799d9-ss8cr/graceful-termination/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.838669058Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-74bb7799d9-ss8cr/graceful-termination/graceful-termination/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.838675178Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-74bb7799d9-ss8cr/graceful-termination/graceful-termination/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.838706739Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-74bb7799d9-ss8cr/graceful-termination/graceful-termination/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.838794791Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-74bb7799d9-ss8cr/graceful-termination/graceful-termination/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.838861132Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-74bb7799d9-ss8cr/graceful-termination/graceful-termination/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.838898023Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-74bb7799d9-ss8cr/migrator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.838904633Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-74bb7799d9-ss8cr/migrator/migrator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.838913763Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-74bb7799d9-ss8cr/migrator/migrator/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.838971594Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-74bb7799d9-ss8cr/migrator/migrator/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.839083707Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-74bb7799d9-ss8cr/migrator/migrator/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.839151688Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-74bb7799d9-ss8cr/migrator/migrator/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.839181059Z namespaces/openshift-kube-storage-version-migrator/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.8392182Z namespaces/openshift-kube-storage-version-migrator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.839302521Z namespaces/openshift-kube-storage-version-migrator/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.839347302Z namespaces/openshift-kube-storage-version-migrator/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.839455505Z namespaces/openshift-lws-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.839498226Z namespaces/openshift-lws-operator/openshift-lws-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.839561917Z namespaces/openshift-lws-operator/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.839601788Z namespaces/openshift-lws-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.839652819Z namespaces/openshift-lws-operator/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.839688279Z namespaces/openshift-lws-operator/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.839769781Z namespaces/openshift-lws-operator/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.839938695Z namespaces/openshift-lws-operator/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.840053587Z namespaces/openshift-lws-operator/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.840104948Z namespaces/openshift-lws-operator/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.840139639Z namespaces/openshift-lws-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.84019136Z namespaces/openshift-lws-operator/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.840250742Z namespaces/openshift-lws-operator/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.840344324Z namespaces/openshift-lws-operator/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.840392734Z namespaces/openshift-lws-operator/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.840434165Z namespaces/openshift-lws-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.840517607Z namespaces/openshift-lws-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.840567648Z namespaces/openshift-lws-operator/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.840574058Z namespaces/openshift-lws-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.840613349Z namespaces/openshift-lws-operator/coordination.k8s.io/leases/b8b2488c.x-k8s.io.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.840709661Z namespaces/openshift-lws-operator/coordination.k8s.io/leases/openshift-lws-operator-lock.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.840772642Z namespaces/openshift-lws-operator/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.840823894Z namespaces/openshift-lws-operator/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.840924906Z namespaces/openshift-lws-operator/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.841006118Z namespaces/openshift-lws-operator/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.841332694Z namespaces/openshift-lws-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.841408176Z namespaces/openshift-lws-operator/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.84157859Z namespaces/openshift-lws-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.841705372Z namespaces/openshift-lws-operator/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.841883766Z namespaces/openshift-lws-operator/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.841956167Z namespaces/openshift-lws-operator/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.842002808Z namespaces/openshift-lws-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.84207531Z namespaces/openshift-lws-operator/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.842149972Z namespaces/openshift-lws-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.842210043Z namespaces/openshift-lws-operator/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.842275444Z namespaces/openshift-lws-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.842352856Z namespaces/openshift-lws-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.842433128Z namespaces/openshift-lws-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.842478799Z namespaces/openshift-lws-operator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.842515799Z namespaces/openshift-lws-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.842570191Z namespaces/openshift-lws-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.842615592Z namespaces/openshift-lws-operator/monitoring.coreos.com/servicemonitors/lws-controller-manager-metrics-monitor.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.842668123Z namespaces/openshift-lws-operator/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.842708074Z namespaces/openshift-lws-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.842761265Z namespaces/openshift-lws-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.842793925Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.842833316Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.8429922Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.843181924Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.843340417Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/leader-worker-set.v1.0.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.843584122Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.843771986Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.843983681Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.844181275Z namespaces/openshift-lws-operator/operators.coreos.com/installplans/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.844221706Z namespaces/openshift-lws-operator/operators.coreos.com/installplans/install-x6lqm.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.844326728Z namespaces/openshift-lws-operator/operators.coreos.com/operatorconditions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.844375319Z namespaces/openshift-lws-operator/operators.coreos.com/operatorconditions/leader-worker-set.v1.0.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.8444409Z namespaces/openshift-lws-operator/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.844489171Z namespaces/openshift-lws-operator/operators.coreos.com/operatorgroups/leader-worker-set.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.844554333Z namespaces/openshift-lws-operator/operators.coreos.com/subscriptions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.844596794Z namespaces/openshift-lws-operator/operators.coreos.com/subscriptions/leader-worker-set.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.844678225Z namespaces/openshift-lws-operator/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.844689985Z namespaces/openshift-lws-operator/pods/lws-controller-manager-5774f66dc9-c6c4h/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.844733246Z namespaces/openshift-lws-operator/pods/lws-controller-manager-5774f66dc9-c6c4h/lws-controller-manager-5774f66dc9-c6c4h.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.844823198Z namespaces/openshift-lws-operator/pods/lws-controller-manager-5774f66dc9-c6c4h/manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.844832668Z namespaces/openshift-lws-operator/pods/lws-controller-manager-5774f66dc9-c6c4h/manager/manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.844840549Z namespaces/openshift-lws-operator/pods/lws-controller-manager-5774f66dc9-c6c4h/manager/manager/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.84488622Z namespaces/openshift-lws-operator/pods/lws-controller-manager-5774f66dc9-c6c4h/manager/manager/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.845056253Z namespaces/openshift-lws-operator/pods/lws-controller-manager-5774f66dc9-c6c4h/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.845126835Z namespaces/openshift-lws-operator/pods/lws-controller-manager-5774f66dc9-c6c4h/manager/manager/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.845176326Z namespaces/openshift-lws-operator/pods/lws-controller-manager-5774f66dc9-rt46l/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.845247797Z namespaces/openshift-lws-operator/pods/lws-controller-manager-5774f66dc9-rt46l/lws-controller-manager-5774f66dc9-rt46l.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.845327239Z namespaces/openshift-lws-operator/pods/lws-controller-manager-5774f66dc9-rt46l/manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.845340849Z namespaces/openshift-lws-operator/pods/lws-controller-manager-5774f66dc9-rt46l/manager/manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.84534583Z namespaces/openshift-lws-operator/pods/lws-controller-manager-5774f66dc9-rt46l/manager/manager/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.845401661Z namespaces/openshift-lws-operator/pods/lws-controller-manager-5774f66dc9-rt46l/manager/manager/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.845541594Z namespaces/openshift-lws-operator/pods/lws-controller-manager-5774f66dc9-rt46l/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.845620255Z namespaces/openshift-lws-operator/pods/lws-controller-manager-5774f66dc9-rt46l/manager/manager/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.845672186Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-bfc7f696d-z7n4k/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.845731168Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-bfc7f696d-z7n4k/openshift-lws-operator-bfc7f696d-z7n4k.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.845806519Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-bfc7f696d-z7n4k/openshift-lws-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.8458209Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-bfc7f696d-z7n4k/openshift-lws-operator/openshift-lws-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.84583Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-bfc7f696d-z7n4k/openshift-lws-operator/openshift-lws-operator/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.845881741Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-bfc7f696d-z7n4k/openshift-lws-operator/openshift-lws-operator/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.846063605Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-bfc7f696d-z7n4k/openshift-lws-operator/openshift-lws-operator/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.846143146Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-bfc7f696d-z7n4k/openshift-lws-operator/openshift-lws-operator/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.846178287Z namespaces/openshift-lws-operator/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.846249029Z namespaces/openshift-lws-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.846392442Z namespaces/openshift-lws-operator/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.846439493Z namespaces/openshift-lws-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.846496744Z namespaces/openshift-machine-api/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.846506234Z namespaces/openshift-machine-api/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.846513194Z namespaces/openshift-machine-api/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.846563165Z namespaces/openshift-machine-api/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.846729949Z namespaces/openshift-machine-api/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.846913483Z namespaces/openshift-machine-api/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.847071006Z namespaces/openshift-machine-api/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.847307051Z namespaces/openshift-machine-api/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.847564617Z namespaces/openshift-machine-api/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.847834032Z namespaces/openshift-machine-config-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.847843582Z namespaces/openshift-machine-config-operator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.847847203Z namespaces/openshift-machine-config-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.847897424Z namespaces/openshift-machine-config-operator/monitoring.coreos.com/prometheusrules/machine-config-controller.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.847999266Z namespaces/openshift-machine-config-operator/monitoring.coreos.com/prometheusrules/machine-config-daemon.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.848071687Z namespaces/openshift-machine-config-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.848081088Z namespaces/openshift-machine-config-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.848137579Z namespaces/openshift-machine-config-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.848324633Z namespaces/openshift-machine-config-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.848495916Z namespaces/openshift-machine-config-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.848636659Z namespaces/openshift-machine-config-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.848834213Z namespaces/openshift-machine-config-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.849065608Z namespaces/openshift-machine-config-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.849289853Z namespaces/openshift-marketplace/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.849303823Z namespaces/openshift-marketplace/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.849308083Z namespaces/openshift-marketplace/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.849331764Z namespaces/openshift-marketplace/monitoring.coreos.com/prometheusrules/marketplace-alert-rules.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.849398925Z namespaces/openshift-marketplace/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.849408816Z namespaces/openshift-marketplace/operators.coreos.com/catalogsources/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.849441406Z namespaces/openshift-marketplace/operators.coreos.com/catalogsources/certified-operators.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.849531178Z namespaces/openshift-marketplace/operators.coreos.com/catalogsources/community-operators.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.84961078Z namespaces/openshift-marketplace/operators.coreos.com/catalogsources/redhat-marketplace.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.849692731Z namespaces/openshift-marketplace/operators.coreos.com/catalogsources/redhat-operators.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.849756733Z namespaces/openshift-marketplace/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.849796554Z namespaces/openshift-marketplace/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.849945197Z namespaces/openshift-marketplace/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.850124191Z namespaces/openshift-marketplace/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.850277034Z namespaces/openshift-marketplace/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.850472958Z namespaces/openshift-marketplace/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.850703173Z namespaces/openshift-marketplace/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.850936298Z namespaces/openshift-monitoring/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.850982459Z namespaces/openshift-monitoring/openshift-monitoring.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.851067711Z namespaces/openshift-monitoring/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.851098051Z namespaces/openshift-monitoring/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.851168563Z namespaces/openshift-monitoring/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.851202814Z namespaces/openshift-monitoring/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.851376177Z namespaces/openshift-monitoring/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.851803306Z namespaces/openshift-monitoring/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.852138634Z namespaces/openshift-monitoring/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.852381779Z namespaces/openshift-monitoring/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.852417249Z namespaces/openshift-monitoring/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.852472371Z namespaces/openshift-monitoring/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.852501591Z namespaces/openshift-monitoring/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.852593253Z namespaces/openshift-monitoring/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.852648154Z namespaces/openshift-monitoring/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.852691765Z namespaces/openshift-monitoring/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.852764897Z namespaces/openshift-monitoring/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.852820968Z namespaces/openshift-monitoring/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.852866699Z namespaces/openshift-monitoring/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.856059997Z namespaces/openshift-monitoring/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.856194489Z namespaces/openshift-monitoring/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.857326824Z namespaces/openshift-monitoring/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.857403975Z namespaces/openshift-monitoring/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.858288714Z namespaces/openshift-monitoring/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.858420847Z namespaces/openshift-monitoring/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.858908497Z namespaces/openshift-monitoring/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.85907176Z namespaces/openshift-monitoring/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.859104791Z namespaces/openshift-monitoring/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.859289145Z namespaces/openshift-monitoring/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.859333506Z namespaces/openshift-monitoring/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.859396477Z namespaces/openshift-monitoring/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.859438838Z namespaces/openshift-monitoring/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.85952312Z namespaces/openshift-monitoring/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.859602542Z namespaces/openshift-monitoring/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.859654733Z namespaces/openshift-monitoring/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.859703904Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.859854067Z namespaces/openshift-monitoring/monitoring.coreos.com/alertmanagers/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.859894518Z namespaces/openshift-monitoring/monitoring.coreos.com/alertmanagers/main.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.8599843Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheuses/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.86000989Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheuses/k8s.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.860116073Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.860164434Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/alertmanager-main-rules.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.860339147Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/cluster-monitoring-operator-prometheus-rules.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.860510191Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/kube-state-metrics-rules.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.860593323Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/kubernetes-monitoring-rules.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.860842038Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/node-exporter-rules.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.860976021Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/prometheus-k8s-prometheus-rules.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.861102493Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/prometheus-k8s-thanos-sidecar-rules.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.861199126Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/prometheus-operator-rules.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.861342479Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/telemetry.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.861441361Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/thanos-querier.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.861499392Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.861545683Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/alertmanager-main.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.861628965Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/cluster-monitoring-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.861716817Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/kube-state-metrics.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.861798938Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/kubelet.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.86190233Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/metrics-server.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.861984772Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/node-exporter.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.862136166Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/openshift-state-metrics.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.862266838Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/prometheus-k8s.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.86235966Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/prometheus-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.862447212Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/telemeter-client.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.862535004Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/thanos-querier.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.862620996Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/thanos-sidecar.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.862673927Z namespaces/openshift-monitoring/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.862719258Z namespaces/openshift-monitoring/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.862763969Z namespaces/openshift-monitoring/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.862772619Z namespaces/openshift-monitoring/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.86283078Z namespaces/openshift-monitoring/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.863047255Z namespaces/openshift-monitoring/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.86330533Z namespaces/openshift-monitoring/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.863517465Z namespaces/openshift-monitoring/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.863716529Z namespaces/openshift-monitoring/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.863969374Z namespaces/openshift-monitoring/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.8642256Z namespaces/openshift-monitoring/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.864306761Z namespaces/openshift-monitoring/operators.coreos.com/operatorgroups/openshift-cluster-monitoring.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.864396363Z namespaces/openshift-monitoring/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.864404783Z namespaces/openshift-monitoring/pods/alertmanager-main-0/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.864474595Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager-main-0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.864644379Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.864659799Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager/alertmanager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.864665089Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager/alertmanager/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.86470053Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager/alertmanager/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.864792962Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager/alertmanager/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.864863573Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager/alertmanager/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.864906464Z namespaces/openshift-monitoring/pods/alertmanager-main-0/config-reloader/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.864913514Z namespaces/openshift-monitoring/pods/alertmanager-main-0/config-reloader/config-reloader/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.864917004Z namespaces/openshift-monitoring/pods/alertmanager-main-0/config-reloader/config-reloader/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.864952525Z namespaces/openshift-monitoring/pods/alertmanager-main-0/config-reloader/config-reloader/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.865050717Z namespaces/openshift-monitoring/pods/alertmanager-main-0/config-reloader/config-reloader/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.865124389Z namespaces/openshift-monitoring/pods/alertmanager-main-0/config-reloader/config-reloader/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.86516603Z namespaces/openshift-monitoring/pods/alertmanager-main-0/init-config-reloader/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.86517387Z namespaces/openshift-monitoring/pods/alertmanager-main-0/init-config-reloader/init-config-reloader/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.86517829Z namespaces/openshift-monitoring/pods/alertmanager-main-0/init-config-reloader/init-config-reloader/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.865213811Z namespaces/openshift-monitoring/pods/alertmanager-main-0/init-config-reloader/init-config-reloader/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.865337213Z namespaces/openshift-monitoring/pods/alertmanager-main-0/init-config-reloader/init-config-reloader/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.865405135Z namespaces/openshift-monitoring/pods/alertmanager-main-0/init-config-reloader/init-config-reloader/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.865445945Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-metric/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.865453306Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-metric/kube-rbac-proxy-metric/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.865458526Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-metric/kube-rbac-proxy-metric/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.865492757Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-metric/kube-rbac-proxy-metric/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.865590719Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-metric/kube-rbac-proxy-metric/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.86565931Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-metric/kube-rbac-proxy-metric/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.865702691Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-web/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.865710131Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-web/kube-rbac-proxy-web/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.865715571Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.865750012Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.865838784Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.865909275Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.865947556Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.865953706Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.865960267Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.866007848Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.866095239Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.866165711Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.866205722Z namespaces/openshift-monitoring/pods/alertmanager-main-0/prom-label-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.866212022Z namespaces/openshift-monitoring/pods/alertmanager-main-0/prom-label-proxy/prom-label-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.866215442Z namespaces/openshift-monitoring/pods/alertmanager-main-0/prom-label-proxy/prom-label-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.866295183Z namespaces/openshift-monitoring/pods/alertmanager-main-0/prom-label-proxy/prom-label-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.866383036Z namespaces/openshift-monitoring/pods/alertmanager-main-0/prom-label-proxy/prom-label-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.866459367Z namespaces/openshift-monitoring/pods/alertmanager-main-0/prom-label-proxy/prom-label-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.866499268Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-75587bd455-542j7/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.866536969Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-75587bd455-542j7/cluster-monitoring-operator-75587bd455-542j7.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.866620921Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-75587bd455-542j7/cluster-monitoring-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.866627241Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-75587bd455-542j7/cluster-monitoring-operator/cluster-monitoring-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.866634091Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-75587bd455-542j7/cluster-monitoring-operator/cluster-monitoring-operator/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.866678002Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-75587bd455-542j7/cluster-monitoring-operator/cluster-monitoring-operator/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.867220333Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-75587bd455-542j7/cluster-monitoring-operator/cluster-monitoring-operator/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.867325605Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-75587bd455-542j7/cluster-monitoring-operator/cluster-monitoring-operator/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.867357056Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.867415967Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/kube-state-metrics-69db897b98-n9hgt.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.86753755Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/kube-rbac-proxy-main/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.86754621Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/kube-rbac-proxy-main/kube-rbac-proxy-main/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.86754982Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.867598591Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.867687703Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.867769735Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.867800275Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/kube-rbac-proxy-self/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.867807266Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/kube-rbac-proxy-self/kube-rbac-proxy-self/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.867818226Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.867867627Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.867964769Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.868038Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.868071801Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/kube-state-metrics/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.868078132Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/kube-state-metrics/kube-state-metrics/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.868089882Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/kube-state-metrics/kube-state-metrics/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.868129533Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/kube-state-metrics/kube-state-metrics/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.868292516Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/kube-state-metrics/kube-state-metrics/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.868365638Z namespaces/openshift-monitoring/pods/kube-state-metrics-69db897b98-n9hgt/kube-state-metrics/kube-state-metrics/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.868409799Z namespaces/openshift-monitoring/pods/metrics-server-7d7c9954dd-2z9dc/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.868455329Z namespaces/openshift-monitoring/pods/metrics-server-7d7c9954dd-2z9dc/metrics-server-7d7c9954dd-2z9dc.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.868558812Z namespaces/openshift-monitoring/pods/metrics-server-7d7c9954dd-2z9dc/metrics-server/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.868565292Z namespaces/openshift-monitoring/pods/metrics-server-7d7c9954dd-2z9dc/metrics-server/metrics-server/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.868568842Z namespaces/openshift-monitoring/pods/metrics-server-7d7c9954dd-2z9dc/metrics-server/metrics-server/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.868613383Z namespaces/openshift-monitoring/pods/metrics-server-7d7c9954dd-2z9dc/metrics-server/metrics-server/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.868707225Z namespaces/openshift-monitoring/pods/metrics-server-7d7c9954dd-2z9dc/metrics-server/metrics-server/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.868776616Z namespaces/openshift-monitoring/pods/metrics-server-7d7c9954dd-2z9dc/metrics-server/metrics-server/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.868820987Z namespaces/openshift-monitoring/pods/monitoring-plugin-7dccd58f55-w8ld8/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.868925219Z namespaces/openshift-monitoring/pods/monitoring-plugin-7dccd58f55-w8ld8/monitoring-plugin-7dccd58f55-w8ld8.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.869000711Z namespaces/openshift-monitoring/pods/monitoring-plugin-7dccd58f55-w8ld8/monitoring-plugin/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.869007481Z namespaces/openshift-monitoring/pods/monitoring-plugin-7dccd58f55-w8ld8/monitoring-plugin/monitoring-plugin/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.869015611Z namespaces/openshift-monitoring/pods/monitoring-plugin-7dccd58f55-w8ld8/monitoring-plugin/monitoring-plugin/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.869129854Z namespaces/openshift-monitoring/pods/monitoring-plugin-7dccd58f55-w8ld8/monitoring-plugin/monitoring-plugin/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.869247966Z namespaces/openshift-monitoring/pods/monitoring-plugin-7dccd58f55-w8ld8/monitoring-plugin/monitoring-plugin/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.869333908Z namespaces/openshift-monitoring/pods/monitoring-plugin-7dccd58f55-w8ld8/monitoring-plugin/monitoring-plugin/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.869379979Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.8694216Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/node-exporter-c5fkj.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.869521432Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/init-textfile/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.869531562Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/init-textfile/init-textfile/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.869535512Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/init-textfile/init-textfile/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.869573483Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/init-textfile/init-textfile/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.869653905Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/init-textfile/init-textfile/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.869720266Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/init-textfile/init-textfile/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.869743577Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.869752227Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.869760527Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.869813588Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.86990415Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.869974132Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870010972Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/node-exporter/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870017753Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/node-exporter/node-exporter/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870030013Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/node-exporter/node-exporter/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870064694Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/node-exporter/node-exporter/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870172876Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/node-exporter/node-exporter/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870269038Z namespaces/openshift-monitoring/pods/node-exporter-c5fkj/node-exporter/node-exporter/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870315739Z namespaces/openshift-monitoring/pods/node-exporter-k927f/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.87037393Z namespaces/openshift-monitoring/pods/node-exporter-k927f/node-exporter-k927f.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870476952Z namespaces/openshift-monitoring/pods/node-exporter-k927f/init-textfile/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870484272Z namespaces/openshift-monitoring/pods/node-exporter-k927f/init-textfile/init-textfile/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870487912Z namespaces/openshift-monitoring/pods/node-exporter-k927f/init-textfile/init-textfile/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870522203Z namespaces/openshift-monitoring/pods/node-exporter-k927f/init-textfile/init-textfile/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870599655Z namespaces/openshift-monitoring/pods/node-exporter-k927f/init-textfile/init-textfile/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870668096Z namespaces/openshift-monitoring/pods/node-exporter-k927f/init-textfile/init-textfile/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870704607Z namespaces/openshift-monitoring/pods/node-exporter-k927f/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870711127Z namespaces/openshift-monitoring/pods/node-exporter-k927f/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870716827Z namespaces/openshift-monitoring/pods/node-exporter-k927f/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870762138Z namespaces/openshift-monitoring/pods/node-exporter-k927f/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.87085438Z namespaces/openshift-monitoring/pods/node-exporter-k927f/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870926802Z namespaces/openshift-monitoring/pods/node-exporter-k927f/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870971853Z namespaces/openshift-monitoring/pods/node-exporter-k927f/node-exporter/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870978273Z namespaces/openshift-monitoring/pods/node-exporter-k927f/node-exporter/node-exporter/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.870984093Z namespaces/openshift-monitoring/pods/node-exporter-k927f/node-exporter/node-exporter/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.871046144Z namespaces/openshift-monitoring/pods/node-exporter-k927f/node-exporter/node-exporter/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.871162477Z namespaces/openshift-monitoring/pods/node-exporter-k927f/node-exporter/node-exporter/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.871245708Z namespaces/openshift-monitoring/pods/node-exporter-k927f/node-exporter/node-exporter/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.8713156Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.871364471Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/node-exporter-vtd9b.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.871470213Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/init-textfile/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.871476653Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/init-textfile/init-textfile/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.871494384Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/init-textfile/init-textfile/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.871526574Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/init-textfile/init-textfile/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.871602366Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/init-textfile/init-textfile/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.871677238Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/init-textfile/init-textfile/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.871723609Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.871730249Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.871735639Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.87177962Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.871872632Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.871942783Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.871973914Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/node-exporter/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.871978794Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/node-exporter/node-exporter/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.871986714Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/node-exporter/node-exporter/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.872043296Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/node-exporter/node-exporter/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.872182178Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/node-exporter/node-exporter/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.872219009Z namespaces/openshift-monitoring/pods/node-exporter-vtd9b/node-exporter/node-exporter/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.872298051Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.872348292Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/openshift-state-metrics-9d44df66c-zg5f5.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.872491345Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/kube-rbac-proxy-main/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.872502785Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/kube-rbac-proxy-main/kube-rbac-proxy-main/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.872508415Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.872532386Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.872623438Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.872694379Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.87273682Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/kube-rbac-proxy-self/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.87274317Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/kube-rbac-proxy-self/kube-rbac-proxy-self/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.872760581Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.872786921Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.872878733Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.872949215Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.872994165Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/openshift-state-metrics/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.873003066Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/openshift-state-metrics/openshift-state-metrics/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.873017996Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/openshift-state-metrics/openshift-state-metrics/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.873051637Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/openshift-state-metrics/openshift-state-metrics/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.873153349Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/openshift-state-metrics/openshift-state-metrics/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.873223441Z namespaces/openshift-monitoring/pods/openshift-state-metrics-9d44df66c-zg5f5/openshift-state-metrics/openshift-state-metrics/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.873303582Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.873390294Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus-k8s-0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.873547097Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/config-reloader/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.873557068Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/config-reloader/config-reloader/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.873560718Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/config-reloader/config-reloader/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.873599269Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/config-reloader/config-reloader/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.873698111Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/config-reloader/config-reloader/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.873767092Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/config-reloader/config-reloader/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.873811573Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/init-config-reloader/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.873820953Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/init-config-reloader/init-config-reloader/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.873824753Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/init-config-reloader/init-config-reloader/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.873856054Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/init-config-reloader/init-config-reloader/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.873943506Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/init-config-reloader/init-config-reloader/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874015477Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/init-config-reloader/init-config-reloader/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874057608Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-thanos/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874067708Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-thanos/kube-rbac-proxy-thanos/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874071339Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-thanos/kube-rbac-proxy-thanos/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.8741268Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-thanos/kube-rbac-proxy-thanos/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874217792Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-thanos/kube-rbac-proxy-thanos/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874324594Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-thanos/kube-rbac-proxy-thanos/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874371135Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-web/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874378725Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-web/kube-rbac-proxy-web/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874386505Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874427946Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874513608Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874583829Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.87462078Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.87462701Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874632811Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874671071Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874763123Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874831885Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874873965Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874880136Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus/prometheus/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874885116Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus/prometheus/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.874921997Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus/prometheus/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.875535299Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus/prometheus/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.875609961Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus/prometheus/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.875653012Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/thanos-sidecar/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.875660812Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/thanos-sidecar/thanos-sidecar/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.875664362Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/thanos-sidecar/thanos-sidecar/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.875700953Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/thanos-sidecar/thanos-sidecar/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.875795895Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/thanos-sidecar/thanos-sidecar/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.875863217Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/thanos-sidecar/thanos-sidecar/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.875911158Z namespaces/openshift-monitoring/pods/prometheus-operator-5676c8c784-569bb/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.875949178Z namespaces/openshift-monitoring/pods/prometheus-operator-5676c8c784-569bb/prometheus-operator-5676c8c784-569bb.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.87604133Z namespaces/openshift-monitoring/pods/prometheus-operator-5676c8c784-569bb/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.876049161Z namespaces/openshift-monitoring/pods/prometheus-operator-5676c8c784-569bb/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.876052561Z namespaces/openshift-monitoring/pods/prometheus-operator-5676c8c784-569bb/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.876089471Z namespaces/openshift-monitoring/pods/prometheus-operator-5676c8c784-569bb/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.876179203Z namespaces/openshift-monitoring/pods/prometheus-operator-5676c8c784-569bb/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.876272855Z namespaces/openshift-monitoring/pods/prometheus-operator-5676c8c784-569bb/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.876317146Z namespaces/openshift-monitoring/pods/prometheus-operator-5676c8c784-569bb/prometheus-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.876323916Z namespaces/openshift-monitoring/pods/prometheus-operator-5676c8c784-569bb/prometheus-operator/prometheus-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.876327736Z namespaces/openshift-monitoring/pods/prometheus-operator-5676c8c784-569bb/prometheus-operator/prometheus-operator/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.876364387Z namespaces/openshift-monitoring/pods/prometheus-operator-5676c8c784-569bb/prometheus-operator/prometheus-operator/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.876569232Z namespaces/openshift-monitoring/pods/prometheus-operator-5676c8c784-569bb/prometheus-operator/prometheus-operator/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.876641863Z namespaces/openshift-monitoring/pods/prometheus-operator-5676c8c784-569bb/prometheus-operator/prometheus-operator/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.876667634Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-57cf98b594-djlzh/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.876712824Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-57cf98b594-djlzh/prometheus-operator-admission-webhook-57cf98b594-djlzh.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.876836987Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-57cf98b594-djlzh/prometheus-operator-admission-webhook/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.876849277Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-57cf98b594-djlzh/prometheus-operator-admission-webhook/prometheus-operator-admission-webhook/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.876854738Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-57cf98b594-djlzh/prometheus-operator-admission-webhook/prometheus-operator-admission-webhook/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.876881328Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-57cf98b594-djlzh/prometheus-operator-admission-webhook/prometheus-operator-admission-webhook/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.87697616Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-57cf98b594-djlzh/prometheus-operator-admission-webhook/prometheus-operator-admission-webhook/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.877044851Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-57cf98b594-djlzh/prometheus-operator-admission-webhook/prometheus-operator-admission-webhook/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.877093083Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.877135473Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/telemeter-client-6bbc6c965b-tzqbm.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.877346608Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.877358798Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.877362428Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.877398369Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.877491901Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.877559182Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.877599053Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/reload/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.877608523Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/reload/reload/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.877611963Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/reload/reload/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.877664455Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/reload/reload/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.877753657Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/reload/reload/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.877821848Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/reload/reload/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.877874139Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/telemeter-client/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.877884479Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/telemeter-client/telemeter-client/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.877888109Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/telemeter-client/telemeter-client/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.87791767Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/telemeter-client/telemeter-client/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.878105794Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/telemeter-client/telemeter-client/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.878169205Z namespaces/openshift-monitoring/pods/telemeter-client-6bbc6c965b-tzqbm/telemeter-client/telemeter-client/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.878221487Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.878313018Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/thanos-querier-64fd45769b-zll9c.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.878440521Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy-metrics/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.878456832Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy-metrics/kube-rbac-proxy-metrics/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.878462152Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy-metrics/kube-rbac-proxy-metrics/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.878492662Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy-metrics/kube-rbac-proxy-metrics/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.878583844Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy-metrics/kube-rbac-proxy-metrics/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.878650196Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy-metrics/kube-rbac-proxy-metrics/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.878689706Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy-rules/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.878696077Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy-rules/kube-rbac-proxy-rules/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.878699486Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy-rules/kube-rbac-proxy-rules/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.878742467Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy-rules/kube-rbac-proxy-rules/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.87883418Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy-rules/kube-rbac-proxy-rules/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.878906421Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy-rules/kube-rbac-proxy-rules/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.878940372Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy-web/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.878946912Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy-web/kube-rbac-proxy-web/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.878960862Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.878989053Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.879091665Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.879160726Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.879206697Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.879213177Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.879221568Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.879304489Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.879379001Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.879451793Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.879515024Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/prom-label-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.879527404Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/prom-label-proxy/prom-label-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.879530934Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/prom-label-proxy/prom-label-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.879573915Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/prom-label-proxy/prom-label-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.879652597Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/prom-label-proxy/prom-label-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.879721288Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/prom-label-proxy/prom-label-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.879759489Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/thanos-query/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.879766629Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/thanos-query/thanos-query/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.879770049Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/thanos-query/thanos-query/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.87980346Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/thanos-query/thanos-query/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.879906342Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/thanos-query/thanos-query/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.879976704Z namespaces/openshift-monitoring/pods/thanos-querier-64fd45769b-zll9c/thanos-query/thanos-query/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.880013824Z namespaces/openshift-monitoring/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.880062686Z namespaces/openshift-monitoring/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.880101136Z namespaces/openshift-monitoring/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.880140927Z namespaces/openshift-monitoring/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.88026283Z namespaces/openshift-multus/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.880311631Z namespaces/openshift-multus/openshift-multus.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.880374452Z namespaces/openshift-multus/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.880408323Z namespaces/openshift-multus/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.880462074Z namespaces/openshift-multus/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.880504755Z namespaces/openshift-multus/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.88072298Z namespaces/openshift-multus/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.880799801Z namespaces/openshift-multus/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.880881793Z namespaces/openshift-multus/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.880932154Z namespaces/openshift-multus/apps/daemonsets/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.880970595Z namespaces/openshift-multus/apps/daemonsets/multus-additional-cni-plugins.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.881117558Z namespaces/openshift-multus/apps/daemonsets/multus.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.881249101Z namespaces/openshift-multus/apps/daemonsets/network-metrics-daemon.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.881322362Z namespaces/openshift-multus/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.881363533Z namespaces/openshift-multus/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.881413984Z namespaces/openshift-multus/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.881456115Z namespaces/openshift-multus/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.881538407Z namespaces/openshift-multus/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.881584568Z namespaces/openshift-multus/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.881629959Z namespaces/openshift-multus/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.88171127Z namespaces/openshift-multus/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.881766312Z namespaces/openshift-multus/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.881819713Z namespaces/openshift-multus/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.881957186Z namespaces/openshift-multus/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.882043337Z namespaces/openshift-multus/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.882524028Z namespaces/openshift-multus/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.88265012Z namespaces/openshift-multus/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.883278944Z namespaces/openshift-multus/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.883377136Z namespaces/openshift-multus/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.883516019Z namespaces/openshift-multus/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.88357893Z namespaces/openshift-multus/core/configmaps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.883636401Z namespaces/openshift-multus/core/configmaps/cni-copy-resources.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.883727733Z namespaces/openshift-multus/core/configmaps/default-cni-sysctl-allowlist.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.883825035Z namespaces/openshift-multus/core/configmaps/multus-daemon-config.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.883911867Z namespaces/openshift-multus/core/configmaps/whereabouts-flatfile-config.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.88402189Z namespaces/openshift-multus/core/serviceaccounts/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.884077751Z namespaces/openshift-multus/core/serviceaccounts/metrics-daemon-sa.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.884243014Z namespaces/openshift-multus/core/serviceaccounts/multus-ac.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.884350906Z namespaces/openshift-multus/core/serviceaccounts/multus-ancillary-tools.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.884436828Z namespaces/openshift-multus/core/serviceaccounts/multus.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.884487209Z namespaces/openshift-multus/core/services/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.88453606Z namespaces/openshift-multus/core/services/network-metrics-service.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.884587411Z namespaces/openshift-multus/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.884639903Z namespaces/openshift-multus/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.884691784Z namespaces/openshift-multus/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.884747165Z namespaces/openshift-multus/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.884792816Z namespaces/openshift-multus/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.884841567Z namespaces/openshift-multus/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.884933179Z namespaces/openshift-multus/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.88501882Z namespaces/openshift-multus/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.885061152Z namespaces/openshift-multus/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.885112653Z namespaces/openshift-multus/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.885171894Z namespaces/openshift-multus/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.885218915Z namespaces/openshift-multus/monitoring.coreos.com/servicemonitors/monitor-network.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.885368578Z namespaces/openshift-multus/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.885408419Z namespaces/openshift-multus/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.88546041Z namespaces/openshift-multus/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.88546704Z namespaces/openshift-multus/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.885517661Z namespaces/openshift-multus/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.885678454Z namespaces/openshift-multus/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.885859298Z namespaces/openshift-multus/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.886012592Z namespaces/openshift-multus/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.886215036Z namespaces/openshift-multus/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.886483102Z namespaces/openshift-multus/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.886690496Z namespaces/openshift-multus/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.886699126Z namespaces/openshift-multus/pods/multus-2f989/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.886735207Z namespaces/openshift-multus/pods/multus-2f989/multus-2f989.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.886836419Z namespaces/openshift-multus/pods/multus-2f989/kube-multus/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.886843309Z namespaces/openshift-multus/pods/multus-2f989/kube-multus/kube-multus/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.886846749Z namespaces/openshift-multus/pods/multus-2f989/kube-multus/kube-multus/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.88689595Z namespaces/openshift-multus/pods/multus-2f989/kube-multus/kube-multus/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.887487153Z namespaces/openshift-multus/pods/multus-2f989/kube-multus/kube-multus/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.887565465Z namespaces/openshift-multus/pods/multus-2f989/kube-multus/kube-multus/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.887591645Z namespaces/openshift-multus/pods/multus-4pwtf/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.887677267Z namespaces/openshift-multus/pods/multus-4pwtf/multus-4pwtf.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.887775589Z namespaces/openshift-multus/pods/multus-4pwtf/kube-multus/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.887782629Z namespaces/openshift-multus/pods/multus-4pwtf/kube-multus/kube-multus/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.887791409Z namespaces/openshift-multus/pods/multus-4pwtf/kube-multus/kube-multus/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.887853051Z namespaces/openshift-multus/pods/multus-4pwtf/kube-multus/kube-multus/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.888316141Z namespaces/openshift-multus/pods/multus-4pwtf/kube-multus/kube-multus/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.888401932Z namespaces/openshift-multus/pods/multus-4pwtf/kube-multus/kube-multus/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.888435273Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.888501674Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/multus-additional-cni-plugins-6hjtw.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.888632147Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/bond-cni-plugin/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.888644477Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/bond-cni-plugin/bond-cni-plugin/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.888648858Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/bond-cni-plugin/bond-cni-plugin/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.888681278Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/bond-cni-plugin/bond-cni-plugin/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.8887717Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/bond-cni-plugin/bond-cni-plugin/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.888848602Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/bond-cni-plugin/bond-cni-plugin/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.888903153Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/cni-plugins/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.888909993Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/cni-plugins/cni-plugins/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.888913573Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/cni-plugins/cni-plugins/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.888962544Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/cni-plugins/cni-plugins/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.889053736Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/cni-plugins/cni-plugins/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.889120548Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/cni-plugins/cni-plugins/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.889157928Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/egress-router-binary-copy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.889165419Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/egress-router-binary-copy/egress-router-binary-copy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.889176089Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/egress-router-binary-copy/egress-router-binary-copy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.88921468Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/egress-router-binary-copy/egress-router-binary-copy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.889396424Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/egress-router-binary-copy/egress-router-binary-copy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.889463815Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/egress-router-binary-copy/egress-router-binary-copy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.889506276Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/kube-multus-additional-cni-plugins/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.889512846Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.889521196Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.889570687Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.889636158Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.88970916Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.889740951Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/routeoverride-cni/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.889747681Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/routeoverride-cni/routeoverride-cni/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.889753291Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/routeoverride-cni/routeoverride-cni/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.889794982Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/routeoverride-cni/routeoverride-cni/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.889887084Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/routeoverride-cni/routeoverride-cni/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.889967625Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/routeoverride-cni/routeoverride-cni/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890013357Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/whereabouts-cni-bincopy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890023997Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/whereabouts-cni-bincopy/whereabouts-cni-bincopy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890027347Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890052487Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890141919Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890212411Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890282362Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/whereabouts-cni/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890300792Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/whereabouts-cni/whereabouts-cni/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890322183Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/whereabouts-cni/whereabouts-cni/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890374084Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/whereabouts-cni/whereabouts-cni/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890474486Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/whereabouts-cni/whereabouts-cni/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890536998Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6hjtw/whereabouts-cni/whereabouts-cni/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890578838Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890621369Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/multus-additional-cni-plugins-s9kdl.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890744872Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/bond-cni-plugin/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890754042Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/bond-cni-plugin/bond-cni-plugin/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890759342Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/bond-cni-plugin/bond-cni-plugin/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890788393Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/bond-cni-plugin/bond-cni-plugin/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890875495Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/bond-cni-plugin/bond-cni-plugin/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890947216Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/bond-cni-plugin/bond-cni-plugin/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890970447Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/cni-plugins/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890976057Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/cni-plugins/cni-plugins/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.890979717Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/cni-plugins/cni-plugins/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891038308Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/cni-plugins/cni-plugins/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.89113259Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/cni-plugins/cni-plugins/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891200712Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/cni-plugins/cni-plugins/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891258623Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/egress-router-binary-copy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891271833Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/egress-router-binary-copy/egress-router-binary-copy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891277443Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/egress-router-binary-copy/egress-router-binary-copy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891308704Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/egress-router-binary-copy/egress-router-binary-copy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891403246Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/egress-router-binary-copy/egress-router-binary-copy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891473548Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/egress-router-binary-copy/egress-router-binary-copy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891513178Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/kube-multus-additional-cni-plugins/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891521058Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891525098Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891554869Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891627711Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891704022Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891739383Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/routeoverride-cni/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891748583Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/routeoverride-cni/routeoverride-cni/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891753543Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/routeoverride-cni/routeoverride-cni/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891784004Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/routeoverride-cni/routeoverride-cni/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891868556Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/routeoverride-cni/routeoverride-cni/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891939987Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/routeoverride-cni/routeoverride-cni/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891980538Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/whereabouts-cni-bincopy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.891993799Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/whereabouts-cni-bincopy/whereabouts-cni-bincopy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892000148Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892047529Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892134342Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892203393Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892257704Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/whereabouts-cni/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892277885Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/whereabouts-cni/whereabouts-cni/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892287745Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/whereabouts-cni/whereabouts-cni/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892316195Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/whereabouts-cni/whereabouts-cni/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892400267Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/whereabouts-cni/whereabouts-cni/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892472569Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-s9kdl/whereabouts-cni/whereabouts-cni/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892504179Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.89255267Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/multus-additional-cni-plugins-x5xkp.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892674863Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/bond-cni-plugin/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892681553Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/bond-cni-plugin/bond-cni-plugin/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892684993Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/bond-cni-plugin/bond-cni-plugin/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892723514Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/bond-cni-plugin/bond-cni-plugin/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892811346Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/bond-cni-plugin/bond-cni-plugin/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892880907Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/bond-cni-plugin/bond-cni-plugin/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892920758Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/cni-plugins/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892927498Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/cni-plugins/cni-plugins/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892934268Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/cni-plugins/cni-plugins/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.892967849Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/cni-plugins/cni-plugins/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893055321Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/cni-plugins/cni-plugins/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893122642Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/cni-plugins/cni-plugins/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893165683Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/egress-router-binary-copy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893171953Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/egress-router-binary-copy/egress-router-binary-copy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893175273Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/egress-router-binary-copy/egress-router-binary-copy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893214904Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/egress-router-binary-copy/egress-router-binary-copy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893331317Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/egress-router-binary-copy/egress-router-binary-copy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893399928Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/egress-router-binary-copy/egress-router-binary-copy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893440719Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/kube-multus-additional-cni-plugins/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893447039Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893450259Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.89348957Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893564172Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893632943Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893677234Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/routeoverride-cni/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893684854Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/routeoverride-cni/routeoverride-cni/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893690334Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/routeoverride-cni/routeoverride-cni/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893758896Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/routeoverride-cni/routeoverride-cni/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893830927Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/routeoverride-cni/routeoverride-cni/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893904129Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/routeoverride-cni/routeoverride-cni/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.89394337Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/whereabouts-cni-bincopy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.89395938Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/whereabouts-cni-bincopy/whereabouts-cni-bincopy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.89396369Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.893985911Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.894080083Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.894141414Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.894185925Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/whereabouts-cni/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.894194665Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/whereabouts-cni/whereabouts-cni/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.894198865Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/whereabouts-cni/whereabouts-cni/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.894225046Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/whereabouts-cni/whereabouts-cni/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.894339668Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/whereabouts-cni/whereabouts-cni/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.89440982Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-x5xkp/whereabouts-cni/whereabouts-cni/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.894447471Z namespaces/openshift-multus/pods/multus-bvrnt/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.894490111Z namespaces/openshift-multus/pods/multus-bvrnt/multus-bvrnt.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.894575303Z namespaces/openshift-multus/pods/multus-bvrnt/kube-multus/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.894581903Z namespaces/openshift-multus/pods/multus-bvrnt/kube-multus/kube-multus/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.894585353Z namespaces/openshift-multus/pods/multus-bvrnt/kube-multus/kube-multus/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.894623034Z namespaces/openshift-multus/pods/multus-bvrnt/kube-multus/kube-multus/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.895127305Z namespaces/openshift-multus/pods/multus-bvrnt/kube-multus/kube-multus/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.895201406Z namespaces/openshift-multus/pods/multus-bvrnt/kube-multus/kube-multus/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.895252177Z namespaces/openshift-multus/pods/network-metrics-daemon-c8k6b/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.895311889Z namespaces/openshift-multus/pods/network-metrics-daemon-c8k6b/network-metrics-daemon-c8k6b.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.8953942Z namespaces/openshift-multus/pods/network-metrics-daemon-c8k6b/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.895403301Z namespaces/openshift-multus/pods/network-metrics-daemon-c8k6b/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.895406841Z namespaces/openshift-multus/pods/network-metrics-daemon-c8k6b/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.895445962Z namespaces/openshift-multus/pods/network-metrics-daemon-c8k6b/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.895548204Z namespaces/openshift-multus/pods/network-metrics-daemon-c8k6b/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.895617345Z namespaces/openshift-multus/pods/network-metrics-daemon-c8k6b/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.895666086Z namespaces/openshift-multus/pods/network-metrics-daemon-c8k6b/network-metrics-daemon/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.895674077Z namespaces/openshift-multus/pods/network-metrics-daemon-c8k6b/network-metrics-daemon/network-metrics-daemon/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.895677497Z namespaces/openshift-multus/pods/network-metrics-daemon-c8k6b/network-metrics-daemon/network-metrics-daemon/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.895717907Z namespaces/openshift-multus/pods/network-metrics-daemon-c8k6b/network-metrics-daemon/network-metrics-daemon/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.89584967Z namespaces/openshift-multus/pods/network-metrics-daemon-c8k6b/network-metrics-daemon/network-metrics-daemon/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.895923812Z namespaces/openshift-multus/pods/network-metrics-daemon-c8k6b/network-metrics-daemon/network-metrics-daemon/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.895959432Z namespaces/openshift-multus/pods/network-metrics-daemon-x6s8x/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.896047574Z namespaces/openshift-multus/pods/network-metrics-daemon-x6s8x/network-metrics-daemon-x6s8x.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.896122746Z namespaces/openshift-multus/pods/network-metrics-daemon-x6s8x/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.896130946Z namespaces/openshift-multus/pods/network-metrics-daemon-x6s8x/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.896135186Z namespaces/openshift-multus/pods/network-metrics-daemon-x6s8x/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.896176867Z namespaces/openshift-multus/pods/network-metrics-daemon-x6s8x/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.89630322Z namespaces/openshift-multus/pods/network-metrics-daemon-x6s8x/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.896374081Z namespaces/openshift-multus/pods/network-metrics-daemon-x6s8x/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.896414072Z namespaces/openshift-multus/pods/network-metrics-daemon-x6s8x/network-metrics-daemon/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.896421152Z namespaces/openshift-multus/pods/network-metrics-daemon-x6s8x/network-metrics-daemon/network-metrics-daemon/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.896424602Z namespaces/openshift-multus/pods/network-metrics-daemon-x6s8x/network-metrics-daemon/network-metrics-daemon/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.896460893Z namespaces/openshift-multus/pods/network-metrics-daemon-x6s8x/network-metrics-daemon/network-metrics-daemon/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.896603106Z namespaces/openshift-multus/pods/network-metrics-daemon-x6s8x/network-metrics-daemon/network-metrics-daemon/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.896674678Z namespaces/openshift-multus/pods/network-metrics-daemon-x6s8x/network-metrics-daemon/network-metrics-daemon/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.896713899Z namespaces/openshift-multus/pods/network-metrics-daemon-xrlcl/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.896754429Z namespaces/openshift-multus/pods/network-metrics-daemon-xrlcl/network-metrics-daemon-xrlcl.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.896827051Z namespaces/openshift-multus/pods/network-metrics-daemon-xrlcl/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.896833321Z namespaces/openshift-multus/pods/network-metrics-daemon-xrlcl/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.896838161Z namespaces/openshift-multus/pods/network-metrics-daemon-xrlcl/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.896877862Z namespaces/openshift-multus/pods/network-metrics-daemon-xrlcl/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.896971214Z namespaces/openshift-multus/pods/network-metrics-daemon-xrlcl/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.897042046Z namespaces/openshift-multus/pods/network-metrics-daemon-xrlcl/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.897081816Z namespaces/openshift-multus/pods/network-metrics-daemon-xrlcl/network-metrics-daemon/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.897088727Z namespaces/openshift-multus/pods/network-metrics-daemon-xrlcl/network-metrics-daemon/network-metrics-daemon/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.897092837Z namespaces/openshift-multus/pods/network-metrics-daemon-xrlcl/network-metrics-daemon/network-metrics-daemon/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.897132968Z namespaces/openshift-multus/pods/network-metrics-daemon-xrlcl/network-metrics-daemon/network-metrics-daemon/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.897357712Z namespaces/openshift-multus/pods/network-metrics-daemon-xrlcl/network-metrics-daemon/network-metrics-daemon/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.897429294Z namespaces/openshift-multus/pods/network-metrics-daemon-xrlcl/network-metrics-daemon/network-metrics-daemon/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.897464844Z namespaces/openshift-multus/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.897509405Z namespaces/openshift-multus/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.897566657Z namespaces/openshift-multus/rbac.authorization.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.897572867Z namespaces/openshift-multus/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.897611347Z namespaces/openshift-multus/rbac.authorization.k8s.io/rolebindings/multus-whereabouts.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.89773645Z namespaces/openshift-multus/rbac.authorization.k8s.io/rolebindings/prometheus-k8s.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.897785911Z namespaces/openshift-multus/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.897831452Z namespaces/openshift-multus/rbac.authorization.k8s.io/roles/prometheus-k8s.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.897915654Z namespaces/openshift-multus/rbac.authorization.k8s.io/roles/whereabouts-cni.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.897988706Z namespaces/openshift-multus/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.898032047Z namespaces/openshift-multus/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.898080728Z namespaces/openshift-must-gather-5ch7l/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.898087118Z namespaces/openshift-must-gather-5ch7l/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.898093488Z namespaces/openshift-must-gather-5ch7l/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.898137209Z namespaces/openshift-must-gather-5ch7l/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.898309152Z namespaces/openshift-must-gather-5ch7l/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.898494396Z namespaces/openshift-must-gather-5ch7l/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.898630229Z namespaces/openshift-must-gather-5ch7l/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.898887825Z namespaces/openshift-must-gather-5ch7l/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.89915759Z namespaces/openshift-must-gather-5ch7l/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.899423786Z namespaces/openshift-must-gather-wmq6v/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.899455337Z namespaces/openshift-must-gather-wmq6v/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.899458987Z namespaces/openshift-must-gather-wmq6v/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.899466167Z namespaces/openshift-must-gather-wmq6v/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.899634001Z namespaces/openshift-must-gather-wmq6v/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.899813124Z namespaces/openshift-must-gather-wmq6v/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.899948797Z namespaces/openshift-must-gather-wmq6v/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.900145791Z namespaces/openshift-must-gather-wmq6v/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.900399337Z namespaces/openshift-must-gather-wmq6v/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.900606981Z namespaces/openshift-network-console/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.900650232Z namespaces/openshift-network-console/openshift-network-console.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.900708333Z namespaces/openshift-network-console/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.900756024Z namespaces/openshift-network-console/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.900808785Z namespaces/openshift-network-console/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.900849396Z namespaces/openshift-network-console/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.900943308Z namespaces/openshift-network-console/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.901077581Z namespaces/openshift-network-console/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.901180873Z namespaces/openshift-network-console/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.901247185Z namespaces/openshift-network-console/apps/deployments/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.901286845Z namespaces/openshift-network-console/apps/deployments/networking-console-plugin.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.901373097Z namespaces/openshift-network-console/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.901410448Z namespaces/openshift-network-console/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.901459499Z namespaces/openshift-network-console/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.90150072Z namespaces/openshift-network-console/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.901582582Z namespaces/openshift-network-console/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.901627903Z namespaces/openshift-network-console/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.901667204Z namespaces/openshift-network-console/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.901748405Z namespaces/openshift-network-console/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.901802116Z namespaces/openshift-network-console/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.901838547Z namespaces/openshift-network-console/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.90195361Z namespaces/openshift-network-console/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.902042072Z namespaces/openshift-network-console/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.902154014Z namespaces/openshift-network-console/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.902253736Z namespaces/openshift-network-console/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.902421109Z namespaces/openshift-network-console/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.902543032Z namespaces/openshift-network-console/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.902660945Z namespaces/openshift-network-console/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.902720876Z namespaces/openshift-network-console/core/configmaps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.902766267Z namespaces/openshift-network-console/core/configmaps/networking-console-plugin.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.902818028Z namespaces/openshift-network-console/core/services/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.902860249Z namespaces/openshift-network-console/core/services/networking-console-plugin.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.90291381Z namespaces/openshift-network-console/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.902957941Z namespaces/openshift-network-console/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.903019842Z namespaces/openshift-network-console/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.903065363Z namespaces/openshift-network-console/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.903110224Z namespaces/openshift-network-console/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.903153785Z namespaces/openshift-network-console/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.903247827Z namespaces/openshift-network-console/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.903335679Z namespaces/openshift-network-console/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.90338717Z namespaces/openshift-network-console/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.903428371Z namespaces/openshift-network-console/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.903473002Z namespaces/openshift-network-console/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.903518943Z namespaces/openshift-network-console/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.903563124Z namespaces/openshift-network-console/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.903569844Z namespaces/openshift-network-console/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.903611435Z namespaces/openshift-network-console/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.903759618Z namespaces/openshift-network-console/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.903952632Z namespaces/openshift-network-console/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.904081905Z namespaces/openshift-network-console/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.90430398Z namespaces/openshift-network-console/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.904540154Z namespaces/openshift-network-console/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.904730629Z namespaces/openshift-network-console/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.904737059Z namespaces/openshift-network-console/pods/networking-console-plugin-cb95c66f6-m7fp2/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.904771589Z namespaces/openshift-network-console/pods/networking-console-plugin-cb95c66f6-m7fp2/networking-console-plugin-cb95c66f6-m7fp2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.904853091Z namespaces/openshift-network-console/pods/networking-console-plugin-cb95c66f6-m7fp2/networking-console-plugin/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.904860131Z namespaces/openshift-network-console/pods/networking-console-plugin-cb95c66f6-m7fp2/networking-console-plugin/networking-console-plugin/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.904863421Z namespaces/openshift-network-console/pods/networking-console-plugin-cb95c66f6-m7fp2/networking-console-plugin/networking-console-plugin/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.904901132Z namespaces/openshift-network-console/pods/networking-console-plugin-cb95c66f6-m7fp2/networking-console-plugin/networking-console-plugin/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.904994374Z namespaces/openshift-network-console/pods/networking-console-plugin-cb95c66f6-m7fp2/networking-console-plugin/networking-console-plugin/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.905065566Z namespaces/openshift-network-console/pods/networking-console-plugin-cb95c66f6-m7fp2/networking-console-plugin/networking-console-plugin/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.905102786Z namespaces/openshift-network-console/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.905142887Z namespaces/openshift-network-console/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.905191298Z namespaces/openshift-network-console/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.905247629Z namespaces/openshift-network-console/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.905306101Z namespaces/openshift-network-diagnostics/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.905350792Z namespaces/openshift-network-diagnostics/openshift-network-diagnostics.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.905403043Z namespaces/openshift-network-diagnostics/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.905453314Z namespaces/openshift-network-diagnostics/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.905499275Z namespaces/openshift-network-diagnostics/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.905542386Z namespaces/openshift-network-diagnostics/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.905653328Z namespaces/openshift-network-diagnostics/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.90575176Z namespaces/openshift-network-diagnostics/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.905838632Z namespaces/openshift-network-diagnostics/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.905892583Z namespaces/openshift-network-diagnostics/apps/daemonsets/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.905934844Z namespaces/openshift-network-diagnostics/apps/daemonsets/network-check-target.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.905991615Z namespaces/openshift-network-diagnostics/apps/deployments/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.906041586Z namespaces/openshift-network-diagnostics/apps/deployments/network-check-source.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.906098598Z namespaces/openshift-network-diagnostics/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.906136378Z namespaces/openshift-network-diagnostics/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.906188049Z namespaces/openshift-network-diagnostics/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.906253901Z namespaces/openshift-network-diagnostics/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.906330832Z namespaces/openshift-network-diagnostics/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.906378073Z namespaces/openshift-network-diagnostics/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.906424974Z namespaces/openshift-network-diagnostics/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.906501386Z namespaces/openshift-network-diagnostics/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.906549837Z namespaces/openshift-network-diagnostics/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.906594688Z namespaces/openshift-network-diagnostics/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.90669185Z namespaces/openshift-network-diagnostics/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.906785152Z namespaces/openshift-network-diagnostics/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.906971546Z namespaces/openshift-network-diagnostics/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.907067588Z namespaces/openshift-network-diagnostics/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.907292123Z namespaces/openshift-network-diagnostics/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.907379255Z namespaces/openshift-network-diagnostics/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.907493437Z namespaces/openshift-network-diagnostics/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.907546678Z namespaces/openshift-network-diagnostics/core/serviceaccounts/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.907593429Z namespaces/openshift-network-diagnostics/core/serviceaccounts/network-diagnostics.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.90764375Z namespaces/openshift-network-diagnostics/core/services/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.907683271Z namespaces/openshift-network-diagnostics/core/services/network-check-source.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.907769573Z namespaces/openshift-network-diagnostics/core/services/network-check-target.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.907819374Z namespaces/openshift-network-diagnostics/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.907860955Z namespaces/openshift-network-diagnostics/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.907939897Z namespaces/openshift-network-diagnostics/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.907982427Z namespaces/openshift-network-diagnostics/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.908030539Z namespaces/openshift-network-diagnostics/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.908072239Z namespaces/openshift-network-diagnostics/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.908223812Z namespaces/openshift-network-diagnostics/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.908333905Z namespaces/openshift-network-diagnostics/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.908402496Z namespaces/openshift-network-diagnostics/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.908448307Z namespaces/openshift-network-diagnostics/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.908503598Z namespaces/openshift-network-diagnostics/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.908544039Z namespaces/openshift-network-diagnostics/monitoring.coreos.com/servicemonitors/network-check-source.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.9085926Z namespaces/openshift-network-diagnostics/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.908635241Z namespaces/openshift-network-diagnostics/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.908687082Z namespaces/openshift-network-diagnostics/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.908695382Z namespaces/openshift-network-diagnostics/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.908730573Z namespaces/openshift-network-diagnostics/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.908886777Z namespaces/openshift-network-diagnostics/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.90906023Z namespaces/openshift-network-diagnostics/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.909194843Z namespaces/openshift-network-diagnostics/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.90949653Z namespaces/openshift-network-diagnostics/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.909719714Z namespaces/openshift-network-diagnostics/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.909917388Z namespaces/openshift-network-diagnostics/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.909925809Z namespaces/openshift-network-diagnostics/pods/network-check-source-8894fc9bd-hwxfm/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.9099601Z namespaces/openshift-network-diagnostics/pods/network-check-source-8894fc9bd-hwxfm/network-check-source-8894fc9bd-hwxfm.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.910059931Z namespaces/openshift-network-diagnostics/pods/network-check-source-8894fc9bd-hwxfm/check-endpoints/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.910066892Z namespaces/openshift-network-diagnostics/pods/network-check-source-8894fc9bd-hwxfm/check-endpoints/check-endpoints/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.910070292Z namespaces/openshift-network-diagnostics/pods/network-check-source-8894fc9bd-hwxfm/check-endpoints/check-endpoints/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.910108583Z namespaces/openshift-network-diagnostics/pods/network-check-source-8894fc9bd-hwxfm/check-endpoints/check-endpoints/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.910218475Z namespaces/openshift-network-diagnostics/pods/network-check-source-8894fc9bd-hwxfm/check-endpoints/check-endpoints/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.910314987Z namespaces/openshift-network-diagnostics/pods/network-check-source-8894fc9bd-hwxfm/check-endpoints/check-endpoints/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.910349578Z namespaces/openshift-network-diagnostics/pods/network-check-target-7k8nd/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.910389789Z namespaces/openshift-network-diagnostics/pods/network-check-target-7k8nd/network-check-target-7k8nd.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.91046419Z namespaces/openshift-network-diagnostics/pods/network-check-target-7k8nd/network-check-target-container/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.91047052Z namespaces/openshift-network-diagnostics/pods/network-check-target-7k8nd/network-check-target-container/network-check-target-container/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.91047401Z namespaces/openshift-network-diagnostics/pods/network-check-target-7k8nd/network-check-target-container/network-check-target-container/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.910513081Z namespaces/openshift-network-diagnostics/pods/network-check-target-7k8nd/network-check-target-container/network-check-target-container/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.910603263Z namespaces/openshift-network-diagnostics/pods/network-check-target-7k8nd/network-check-target-container/network-check-target-container/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.910669295Z namespaces/openshift-network-diagnostics/pods/network-check-target-7k8nd/network-check-target-container/network-check-target-container/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.910700575Z namespaces/openshift-network-diagnostics/pods/network-check-target-jjnzv/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.910749026Z namespaces/openshift-network-diagnostics/pods/network-check-target-jjnzv/network-check-target-jjnzv.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.910817898Z namespaces/openshift-network-diagnostics/pods/network-check-target-jjnzv/network-check-target-container/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.910830918Z namespaces/openshift-network-diagnostics/pods/network-check-target-jjnzv/network-check-target-container/network-check-target-container/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.910835238Z namespaces/openshift-network-diagnostics/pods/network-check-target-jjnzv/network-check-target-container/network-check-target-container/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.910866599Z namespaces/openshift-network-diagnostics/pods/network-check-target-jjnzv/network-check-target-container/network-check-target-container/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.910950641Z namespaces/openshift-network-diagnostics/pods/network-check-target-jjnzv/network-check-target-container/network-check-target-container/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.911035362Z namespaces/openshift-network-diagnostics/pods/network-check-target-jjnzv/network-check-target-container/network-check-target-container/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.911071573Z namespaces/openshift-network-diagnostics/pods/network-check-target-js4dn/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.911112234Z namespaces/openshift-network-diagnostics/pods/network-check-target-js4dn/network-check-target-js4dn.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.911183625Z namespaces/openshift-network-diagnostics/pods/network-check-target-js4dn/network-check-target-container/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.911192315Z namespaces/openshift-network-diagnostics/pods/network-check-target-js4dn/network-check-target-container/network-check-target-container/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.911196506Z namespaces/openshift-network-diagnostics/pods/network-check-target-js4dn/network-check-target-container/network-check-target-container/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.911247357Z namespaces/openshift-network-diagnostics/pods/network-check-target-js4dn/network-check-target-container/network-check-target-container/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.911340209Z namespaces/openshift-network-diagnostics/pods/network-check-target-js4dn/network-check-target-container/network-check-target-container/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.91141171Z namespaces/openshift-network-diagnostics/pods/network-check-target-js4dn/network-check-target-container/network-check-target-container/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.911446771Z namespaces/openshift-network-diagnostics/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.911492172Z namespaces/openshift-network-diagnostics/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.911538253Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.911545583Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.911582224Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/rolebindings/network-diagnostics.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.911668236Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/rolebindings/prometheus-k8s.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.911721647Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.911767838Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/roles/network-diagnostics.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.911848789Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/roles/prometheus-k8s.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.91189889Z namespaces/openshift-network-diagnostics/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.911944882Z namespaces/openshift-network-diagnostics/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.911986602Z namespaces/openshift-network-node-identity/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.912037193Z namespaces/openshift-network-node-identity/openshift-network-node-identity.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.912093945Z namespaces/openshift-network-node-identity/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.912141736Z namespaces/openshift-network-node-identity/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.912189857Z namespaces/openshift-network-node-identity/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.912222897Z namespaces/openshift-network-node-identity/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.91233716Z namespaces/openshift-network-node-identity/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.912413432Z namespaces/openshift-network-node-identity/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.912494173Z namespaces/openshift-network-node-identity/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.912539584Z namespaces/openshift-network-node-identity/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.912583135Z namespaces/openshift-network-node-identity/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.912633696Z namespaces/openshift-network-node-identity/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.912678517Z namespaces/openshift-network-node-identity/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.912750928Z namespaces/openshift-network-node-identity/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.91279632Z namespaces/openshift-network-node-identity/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.91283833Z namespaces/openshift-network-node-identity/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.912916632Z namespaces/openshift-network-node-identity/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.912966853Z namespaces/openshift-network-node-identity/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.912973873Z namespaces/openshift-network-node-identity/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.913016704Z namespaces/openshift-network-node-identity/coordination.k8s.io/leases/ovnkube-identity.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.913063085Z namespaces/openshift-network-node-identity/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.913113096Z namespaces/openshift-network-node-identity/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.913206298Z namespaces/openshift-network-node-identity/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.913315371Z namespaces/openshift-network-node-identity/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.913392002Z namespaces/openshift-network-node-identity/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.913467464Z namespaces/openshift-network-node-identity/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.913553656Z namespaces/openshift-network-node-identity/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.913689379Z namespaces/openshift-network-node-identity/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.913796551Z namespaces/openshift-network-node-identity/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.913840522Z namespaces/openshift-network-node-identity/core/serviceaccounts/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.913919463Z namespaces/openshift-network-node-identity/core/serviceaccounts/network-node-identity.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.913967044Z namespaces/openshift-network-node-identity/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.914012075Z namespaces/openshift-network-node-identity/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.914055856Z namespaces/openshift-network-node-identity/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.914106727Z namespaces/openshift-network-node-identity/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.914148648Z namespaces/openshift-network-node-identity/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.914191369Z namespaces/openshift-network-node-identity/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.914298341Z namespaces/openshift-network-node-identity/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.914378973Z namespaces/openshift-network-node-identity/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.914426034Z namespaces/openshift-network-node-identity/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.914470955Z namespaces/openshift-network-node-identity/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.914512566Z namespaces/openshift-network-node-identity/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.914560447Z namespaces/openshift-network-node-identity/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.914602868Z namespaces/openshift-network-node-identity/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.914612118Z namespaces/openshift-network-node-identity/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.914644619Z namespaces/openshift-network-node-identity/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.914801912Z namespaces/openshift-network-node-identity/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.914980476Z namespaces/openshift-network-node-identity/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.915131129Z namespaces/openshift-network-node-identity/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.915386174Z namespaces/openshift-network-node-identity/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.915615479Z namespaces/openshift-network-node-identity/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.915812464Z namespaces/openshift-network-node-identity/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.915858614Z namespaces/openshift-network-node-identity/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.915907626Z namespaces/openshift-network-node-identity/rbac.authorization.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.915915876Z namespaces/openshift-network-node-identity/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.915941626Z namespaces/openshift-network-node-identity/rbac.authorization.k8s.io/rolebindings/network-node-identity-leases.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.915995727Z namespaces/openshift-network-node-identity/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.916037068Z namespaces/openshift-network-node-identity/rbac.authorization.k8s.io/roles/network-node-identity-leases.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.916089329Z namespaces/openshift-network-node-identity/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.9161277Z namespaces/openshift-network-node-identity/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.916171001Z namespaces/openshift-network-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.916217032Z namespaces/openshift-network-operator/openshift-network-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.916297424Z namespaces/openshift-network-operator/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.916329924Z namespaces/openshift-network-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.916380356Z namespaces/openshift-network-operator/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.916427286Z namespaces/openshift-network-operator/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.916527819Z namespaces/openshift-network-operator/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.91660922Z namespaces/openshift-network-operator/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.916686892Z namespaces/openshift-network-operator/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.916732713Z namespaces/openshift-network-operator/apps/daemonsets/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.916778984Z namespaces/openshift-network-operator/apps/daemonsets/iptables-alerter.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.916835725Z namespaces/openshift-network-operator/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.916878206Z namespaces/openshift-network-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.916933527Z namespaces/openshift-network-operator/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.916970938Z namespaces/openshift-network-operator/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.91704815Z namespaces/openshift-network-operator/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.917090141Z namespaces/openshift-network-operator/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.917135721Z namespaces/openshift-network-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.917218413Z namespaces/openshift-network-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.917285555Z namespaces/openshift-network-operator/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.917300295Z namespaces/openshift-network-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.917334976Z namespaces/openshift-network-operator/coordination.k8s.io/leases/network-operator-lock.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.917383287Z namespaces/openshift-network-operator/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.917427848Z namespaces/openshift-network-operator/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.91754062Z namespaces/openshift-network-operator/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.917620912Z namespaces/openshift-network-operator/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.917773635Z namespaces/openshift-network-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.917851197Z namespaces/openshift-network-operator/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.91801623Z namespaces/openshift-network-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.918101512Z namespaces/openshift-network-operator/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.918247055Z namespaces/openshift-network-operator/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.918305386Z namespaces/openshift-network-operator/core/configmaps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.918348687Z namespaces/openshift-network-operator/core/configmaps/applied-cluster.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.918436949Z namespaces/openshift-network-operator/core/configmaps/iptables-alerter-script.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.91849608Z namespaces/openshift-network-operator/core/serviceaccounts/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.918544691Z namespaces/openshift-network-operator/core/serviceaccounts/iptables-alerter.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.918594952Z namespaces/openshift-network-operator/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.918633043Z namespaces/openshift-network-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.918686734Z namespaces/openshift-network-operator/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.918734595Z namespaces/openshift-network-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.918780396Z namespaces/openshift-network-operator/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.918823287Z namespaces/openshift-network-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.918902499Z namespaces/openshift-network-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.918980611Z namespaces/openshift-network-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.919038022Z namespaces/openshift-network-operator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.919073193Z namespaces/openshift-network-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.919155554Z namespaces/openshift-network-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.919201805Z namespaces/openshift-network-operator/monitoring.coreos.com/prometheusrules/openshift-network-operator-ipsec-rules.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.919274227Z namespaces/openshift-network-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.919321998Z namespaces/openshift-network-operator/monitoring.coreos.com/servicemonitors/network-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.919385249Z namespaces/openshift-network-operator/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.91942466Z namespaces/openshift-network-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.919468951Z namespaces/openshift-network-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.919476971Z namespaces/openshift-network-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.919513372Z namespaces/openshift-network-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.919657745Z namespaces/openshift-network-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.919834899Z namespaces/openshift-network-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.919972462Z namespaces/openshift-network-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.920177936Z namespaces/openshift-network-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.920441522Z namespaces/openshift-network-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.920636956Z namespaces/openshift-network-operator/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.920646756Z namespaces/openshift-network-operator/pods/iptables-alerter-dhdqg/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.920683147Z namespaces/openshift-network-operator/pods/iptables-alerter-dhdqg/iptables-alerter-dhdqg.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.920760898Z namespaces/openshift-network-operator/pods/iptables-alerter-dhdqg/iptables-alerter/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.920768329Z namespaces/openshift-network-operator/pods/iptables-alerter-dhdqg/iptables-alerter/iptables-alerter/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.920771929Z namespaces/openshift-network-operator/pods/iptables-alerter-dhdqg/iptables-alerter/iptables-alerter/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.920807589Z namespaces/openshift-network-operator/pods/iptables-alerter-dhdqg/iptables-alerter/iptables-alerter/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.920893221Z namespaces/openshift-network-operator/pods/iptables-alerter-dhdqg/iptables-alerter/iptables-alerter/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.920957353Z namespaces/openshift-network-operator/pods/iptables-alerter-dhdqg/iptables-alerter/iptables-alerter/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921010254Z namespaces/openshift-network-operator/pods/iptables-alerter-fkdvz/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921026444Z namespaces/openshift-network-operator/pods/iptables-alerter-fkdvz/iptables-alerter-fkdvz.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921113976Z namespaces/openshift-network-operator/pods/iptables-alerter-fkdvz/iptables-alerter/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921122106Z namespaces/openshift-network-operator/pods/iptables-alerter-fkdvz/iptables-alerter/iptables-alerter/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921126166Z namespaces/openshift-network-operator/pods/iptables-alerter-fkdvz/iptables-alerter/iptables-alerter/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921150087Z namespaces/openshift-network-operator/pods/iptables-alerter-fkdvz/iptables-alerter/iptables-alerter/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921262709Z namespaces/openshift-network-operator/pods/iptables-alerter-fkdvz/iptables-alerter/iptables-alerter/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921334641Z namespaces/openshift-network-operator/pods/iptables-alerter-fkdvz/iptables-alerter/iptables-alerter/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921373241Z namespaces/openshift-network-operator/pods/iptables-alerter-zx9c4/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921410532Z namespaces/openshift-network-operator/pods/iptables-alerter-zx9c4/iptables-alerter-zx9c4.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921481574Z namespaces/openshift-network-operator/pods/iptables-alerter-zx9c4/iptables-alerter/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921489124Z namespaces/openshift-network-operator/pods/iptables-alerter-zx9c4/iptables-alerter/iptables-alerter/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921492534Z namespaces/openshift-network-operator/pods/iptables-alerter-zx9c4/iptables-alerter/iptables-alerter/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921526674Z namespaces/openshift-network-operator/pods/iptables-alerter-zx9c4/iptables-alerter/iptables-alerter/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921612887Z namespaces/openshift-network-operator/pods/iptables-alerter-zx9c4/iptables-alerter/iptables-alerter/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921683558Z namespaces/openshift-network-operator/pods/iptables-alerter-zx9c4/iptables-alerter/iptables-alerter/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921722279Z namespaces/openshift-network-operator/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921755839Z namespaces/openshift-network-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.92180792Z namespaces/openshift-network-operator/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921851712Z namespaces/openshift-network-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921898422Z namespaces/openshift-node/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921908053Z namespaces/openshift-node/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921913313Z namespaces/openshift-node/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.921942313Z namespaces/openshift-node/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.922102747Z namespaces/openshift-node/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.922390223Z namespaces/openshift-node/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.922536766Z namespaces/openshift-node/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.92272884Z namespaces/openshift-node/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.922972235Z namespaces/openshift-node/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.923176369Z namespaces/openshift-operator-lifecycle-manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.92322067Z namespaces/openshift-operator-lifecycle-manager/openshift-operator-lifecycle-manager.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.923303082Z namespaces/openshift-operator-lifecycle-manager/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.923346423Z namespaces/openshift-operator-lifecycle-manager/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.923396114Z namespaces/openshift-operator-lifecycle-manager/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.923444725Z namespaces/openshift-operator-lifecycle-manager/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.923521057Z namespaces/openshift-operator-lifecycle-manager/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.923599849Z namespaces/openshift-operator-lifecycle-manager/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.92368056Z namespaces/openshift-operator-lifecycle-manager/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.923727611Z namespaces/openshift-operator-lifecycle-manager/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.923772112Z namespaces/openshift-operator-lifecycle-manager/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.923815833Z namespaces/openshift-operator-lifecycle-manager/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.923860584Z namespaces/openshift-operator-lifecycle-manager/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.923938086Z namespaces/openshift-operator-lifecycle-manager/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.923983197Z namespaces/openshift-operator-lifecycle-manager/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.924024138Z namespaces/openshift-operator-lifecycle-manager/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.924104399Z namespaces/openshift-operator-lifecycle-manager/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.92415137Z namespaces/openshift-operator-lifecycle-manager/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.924194651Z namespaces/openshift-operator-lifecycle-manager/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.924316654Z namespaces/openshift-operator-lifecycle-manager/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.924401066Z namespaces/openshift-operator-lifecycle-manager/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.924489937Z namespaces/openshift-operator-lifecycle-manager/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.924567289Z namespaces/openshift-operator-lifecycle-manager/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.924652241Z namespaces/openshift-operator-lifecycle-manager/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.924769033Z namespaces/openshift-operator-lifecycle-manager/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.924950477Z namespaces/openshift-operator-lifecycle-manager/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.925010939Z namespaces/openshift-operator-lifecycle-manager/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.925051569Z namespaces/openshift-operator-lifecycle-manager/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.92510727Z namespaces/openshift-operator-lifecycle-manager/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.925151631Z namespaces/openshift-operator-lifecycle-manager/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.925186312Z namespaces/openshift-operator-lifecycle-manager/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.925245773Z namespaces/openshift-operator-lifecycle-manager/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.925338986Z namespaces/openshift-operator-lifecycle-manager/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.925416467Z namespaces/openshift-operator-lifecycle-manager/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.925469768Z namespaces/openshift-operator-lifecycle-manager/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.925517229Z namespaces/openshift-operator-lifecycle-manager/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.92556001Z namespaces/openshift-operator-lifecycle-manager/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.925606911Z namespaces/openshift-operator-lifecycle-manager/monitoring.coreos.com/prometheusrules/olm-alert-rules.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.925663852Z namespaces/openshift-operator-lifecycle-manager/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.925707673Z namespaces/openshift-operator-lifecycle-manager/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.925773395Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.925782775Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.925814856Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.925962589Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.926167373Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.926374237Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.926568792Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.926797716Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.92699555Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.927054382Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/operatorgroups/olm-operators.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.927108963Z namespaces/openshift-operator-lifecycle-manager/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.927153644Z namespaces/openshift-operator-lifecycle-manager/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.927210515Z namespaces/openshift-operator-lifecycle-manager/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.927269686Z namespaces/openshift-operator-lifecycle-manager/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.927319057Z namespaces/openshift-operators/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.927323948Z namespaces/openshift-operators/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.927327918Z namespaces/openshift-operators/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.927368709Z namespaces/openshift-operators/coordination.k8s.io/leases/sail-operator-lock.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.92742416Z namespaces/openshift-operators/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.92743458Z namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.927468681Z namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.927631644Z namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.927809868Z namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.927947711Z namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.928144755Z namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.928433671Z namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.928633265Z namespaces/openshift-operators/operators.coreos.com/installplans/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.928665156Z namespaces/openshift-operators/operators.coreos.com/installplans/install-k4tl7.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.929039554Z namespaces/openshift-operators/operators.coreos.com/installplans/install-vq5hk.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.929368641Z namespaces/openshift-operators/operators.coreos.com/operatorconditions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.929395521Z namespaces/openshift-operators/operators.coreos.com/operatorconditions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.929461033Z namespaces/openshift-operators/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.929488553Z namespaces/openshift-operators/operators.coreos.com/operatorgroups/global-operators.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.929559455Z namespaces/openshift-operators/operators.coreos.com/subscriptions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.929583245Z namespaces/openshift-operators/operators.coreos.com/subscriptions/servicemeshoperator3.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.929661957Z namespaces/openshift-ovn-kubernetes/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.929705738Z namespaces/openshift-ovn-kubernetes/openshift-ovn-kubernetes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.929764809Z namespaces/openshift-ovn-kubernetes/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.92979804Z namespaces/openshift-ovn-kubernetes/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.929847861Z namespaces/openshift-ovn-kubernetes/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.929948423Z namespaces/openshift-ovn-kubernetes/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.930128977Z namespaces/openshift-ovn-kubernetes/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.930208209Z namespaces/openshift-ovn-kubernetes/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.930366892Z namespaces/openshift-ovn-kubernetes/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.930418863Z namespaces/openshift-ovn-kubernetes/apps/daemonsets/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.930458394Z namespaces/openshift-ovn-kubernetes/apps/daemonsets/ovnkube-node.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.930594877Z namespaces/openshift-ovn-kubernetes/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.930639368Z namespaces/openshift-ovn-kubernetes/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.930696999Z namespaces/openshift-ovn-kubernetes/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.93073441Z namespaces/openshift-ovn-kubernetes/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.930817402Z namespaces/openshift-ovn-kubernetes/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.930859152Z namespaces/openshift-ovn-kubernetes/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.930905653Z namespaces/openshift-ovn-kubernetes/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.930982305Z namespaces/openshift-ovn-kubernetes/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.931040976Z namespaces/openshift-ovn-kubernetes/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.931048907Z namespaces/openshift-ovn-kubernetes/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.931097677Z namespaces/openshift-ovn-kubernetes/coordination.k8s.io/leases/ovn-kubernetes-master.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.931147818Z namespaces/openshift-ovn-kubernetes/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.93119217Z namespaces/openshift-ovn-kubernetes/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.931406524Z namespaces/openshift-ovn-kubernetes/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.931491206Z namespaces/openshift-ovn-kubernetes/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.931806703Z namespaces/openshift-ovn-kubernetes/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.931928345Z namespaces/openshift-ovn-kubernetes/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.932406565Z namespaces/openshift-ovn-kubernetes/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.932493647Z namespaces/openshift-ovn-kubernetes/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.93265079Z namespaces/openshift-ovn-kubernetes/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.932704002Z namespaces/openshift-ovn-kubernetes/core/configmaps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.932733832Z namespaces/openshift-ovn-kubernetes/core/configmaps/ovnkube-config.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.932829254Z namespaces/openshift-ovn-kubernetes/core/configmaps/ovnkube-script-lib.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.932967867Z namespaces/openshift-ovn-kubernetes/core/serviceaccounts/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.933030329Z namespaces/openshift-ovn-kubernetes/core/serviceaccounts/ovn-kubernetes-control-plane.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.933130031Z namespaces/openshift-ovn-kubernetes/core/serviceaccounts/ovn-kubernetes-node.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.933170772Z namespaces/openshift-ovn-kubernetes/core/services/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.933223913Z namespaces/openshift-ovn-kubernetes/core/services/ovn-kubernetes-node.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.933332445Z namespaces/openshift-ovn-kubernetes/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.933377736Z namespaces/openshift-ovn-kubernetes/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.933454198Z namespaces/openshift-ovn-kubernetes/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.933511719Z namespaces/openshift-ovn-kubernetes/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.933541709Z namespaces/openshift-ovn-kubernetes/k8s.cni.cncf.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.933548009Z namespaces/openshift-ovn-kubernetes/k8s.cni.cncf.io/network-attachment-definitions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.933605741Z namespaces/openshift-ovn-kubernetes/k8s.cni.cncf.io/network-attachment-definitions/default.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.933658042Z namespaces/openshift-ovn-kubernetes/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.933706523Z namespaces/openshift-ovn-kubernetes/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.933781234Z namespaces/openshift-ovn-kubernetes/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.933860896Z namespaces/openshift-ovn-kubernetes/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.933908017Z namespaces/openshift-ovn-kubernetes/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.933951558Z namespaces/openshift-ovn-kubernetes/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.934003859Z namespaces/openshift-ovn-kubernetes/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.93404685Z namespaces/openshift-ovn-kubernetes/monitoring.coreos.com/prometheusrules/networking-rules.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.934120412Z namespaces/openshift-ovn-kubernetes/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.934162113Z namespaces/openshift-ovn-kubernetes/monitoring.coreos.com/servicemonitors/monitor-ovn-node.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.934213054Z namespaces/openshift-ovn-kubernetes/network.operator.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.934220284Z namespaces/openshift-ovn-kubernetes/network.operator.openshift.io/operatorpkis/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.934280945Z namespaces/openshift-ovn-kubernetes/network.operator.openshift.io/operatorpkis/ovn.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.934367997Z namespaces/openshift-ovn-kubernetes/network.operator.openshift.io/operatorpkis/signer.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.934414988Z namespaces/openshift-ovn-kubernetes/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.934458969Z namespaces/openshift-ovn-kubernetes/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.93450245Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.93450963Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.934549341Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.934705874Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.934879888Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.935030401Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.935250516Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.93548709Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.935755296Z namespaces/openshift-ovn-kubernetes/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.935768676Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.935819228Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/ovnkube-node-bt4zz.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.935984691Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/kube-rbac-proxy-node/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.935991711Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/kube-rbac-proxy-node/kube-rbac-proxy-node/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.935995611Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.936031102Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.936158595Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.936242446Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.936350249Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/kube-rbac-proxy-ovn-metrics/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.936358309Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.936362019Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.93639595Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.936517732Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.936585694Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.936625685Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/nbdb/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.936633455Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/nbdb/nbdb/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.936636965Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/nbdb/nbdb/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.936667435Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/nbdb/nbdb/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.936763598Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/nbdb/nbdb/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.936834309Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/nbdb/nbdb/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.93687047Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/northd/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.93687699Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/northd/northd/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.93688029Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/northd/northd/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.936918571Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/northd/northd/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.937021633Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/northd/northd/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.937090955Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/northd/northd/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.937126075Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/ovn-acl-logging/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.937132925Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/ovn-acl-logging/ovn-acl-logging/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.937138756Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/ovn-acl-logging/ovn-acl-logging/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.937172646Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/ovn-acl-logging/ovn-acl-logging/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.937453272Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/ovn-acl-logging/ovn-acl-logging/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.937506173Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/ovn-controller/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.937513924Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/ovn-controller/ovn-controller/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.937517413Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/ovn-controller/ovn-controller/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.937552094Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/ovn-controller/ovn-controller/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.937791629Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/ovn-controller/ovn-controller/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.937858731Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/ovn-controller/ovn-controller/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.937895262Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/ovnkube-controller/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.937901572Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/ovnkube-controller/ovnkube-controller/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.937905232Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/ovnkube-controller/ovnkube-controller/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.937949423Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/ovnkube-controller/ovnkube-controller/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.942459709Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/ovnkube-controller/ovnkube-controller/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.94252536Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/ovnkube-controller/ovnkube-controller/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.942555131Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/sbdb/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.94256168Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/sbdb/sbdb/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.942565701Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/sbdb/sbdb/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.942610602Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/sbdb/sbdb/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.942703614Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/sbdb/sbdb/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.942777885Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-bt4zz/sbdb/sbdb/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.942805396Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.942917348Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/ovnkube-node-c6xp2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943119262Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/kube-rbac-proxy-node/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943132353Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/kube-rbac-proxy-node/kube-rbac-proxy-node/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943139083Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943148223Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943292456Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943363148Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943405218Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/kube-rbac-proxy-ovn-metrics/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943413229Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943417019Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943446319Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943577072Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943634213Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943667614Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/nbdb/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943674074Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/nbdb/nbdb/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943677344Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/nbdb/nbdb/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943720085Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/nbdb/nbdb/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943809347Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/nbdb/nbdb/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943877439Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/nbdb/nbdb/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943915949Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/northd/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.9439234Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/northd/northd/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.94392692Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/northd/northd/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.943963Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/northd/northd/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.944068632Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/northd/northd/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.944144744Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/northd/northd/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.944176445Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/ovn-acl-logging/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.944184315Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/ovn-acl-logging/ovn-acl-logging/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.944187735Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/ovn-acl-logging/ovn-acl-logging/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.944217696Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/ovn-acl-logging/ovn-acl-logging/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.944513092Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/ovn-acl-logging/ovn-acl-logging/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.944568763Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/ovn-controller/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.944578603Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/ovn-controller/ovn-controller/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.944581893Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/ovn-controller/ovn-controller/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.944625354Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/ovn-controller/ovn-controller/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.944852599Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/ovn-controller/ovn-controller/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.94492263Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/ovn-controller/ovn-controller/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.944960701Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/ovnkube-controller/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.944968471Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/ovnkube-controller/ovnkube-controller/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.944974222Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/ovnkube-controller/ovnkube-controller/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.945007102Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/ovnkube-controller/ovnkube-controller/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.949692222Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/ovnkube-controller/ovnkube-controller/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.949760643Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/ovnkube-controller/ovnkube-controller/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.949802634Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/sbdb/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.949814864Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/sbdb/sbdb/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.949823025Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/sbdb/sbdb/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.949835425Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/sbdb/sbdb/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.949945927Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/sbdb/sbdb/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.950015619Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-c6xp2/sbdb/sbdb/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.95005355Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.950123691Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ovnkube-node-mxnmf.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.950327785Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/kube-rbac-proxy-node/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.950344265Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/kube-rbac-proxy-node/kube-rbac-proxy-node/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.950350996Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.950375056Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.950496729Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.95056514Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.950604371Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/kube-rbac-proxy-ovn-metrics/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.950614851Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.950619491Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.950656822Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.950766614Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.950838876Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.950870237Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/nbdb/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.950881387Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/nbdb/nbdb/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.950887767Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/nbdb/nbdb/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.950923498Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/nbdb/nbdb/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.95102994Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/nbdb/nbdb/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.951092981Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/nbdb/nbdb/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.951126392Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/northd/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.951134782Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/northd/northd/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.951140682Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/northd/northd/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.951175693Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/northd/northd/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.951409018Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/northd/northd/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.95148847Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/northd/northd/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.951525651Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ovn-acl-logging/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.951532191Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ovn-acl-logging/ovn-acl-logging/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.951535731Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ovn-acl-logging/ovn-acl-logging/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.951574562Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ovn-acl-logging/ovn-acl-logging/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.951846737Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ovn-acl-logging/ovn-acl-logging/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.951915599Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ovn-acl-logging/ovn-acl-logging/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.9519566Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ovn-controller/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.9519664Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ovn-controller/ovn-controller/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.95197188Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ovn-controller/ovn-controller/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.95198471Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ovn-controller/ovn-controller/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.952255386Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ovn-controller/ovn-controller/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.952341278Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ovn-controller/ovn-controller/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.952383449Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ovnkube-controller/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.952392309Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ovnkube-controller/ovnkube-controller/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.952397859Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ovnkube-controller/ovnkube-controller/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.95242657Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ovnkube-controller/ovnkube-controller/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.957214671Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ovnkube-controller/ovnkube-controller/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.957310853Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/ovnkube-controller/ovnkube-controller/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.957334774Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/sbdb/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.957352014Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/sbdb/sbdb/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.957360544Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/sbdb/sbdb/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.957395145Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/sbdb/sbdb/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.957498487Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/sbdb/sbdb/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.957561869Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-mxnmf/sbdb/sbdb/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.957590979Z namespaces/openshift-ovn-kubernetes/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.95764027Z namespaces/openshift-ovn-kubernetes/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.957685601Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.957695092Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.957728962Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/rolebindings/openshift-ovn-kubernetes-control-plane-limited.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.957824464Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/rolebindings/openshift-ovn-kubernetes-nodes-identity-limited.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.957950297Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/rolebindings/prometheus-k8s.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.957994278Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.958038569Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/roles/openshift-ovn-kubernetes-control-plane-limited.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.958121401Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/roles/openshift-ovn-kubernetes-node-limited.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.958204892Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/roles/prometheus-k8s.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.958285014Z namespaces/openshift-ovn-kubernetes/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.958328485Z namespaces/openshift-ovn-kubernetes/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.958385916Z namespaces/openshift-route-controller-manager/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.958393126Z namespaces/openshift-route-controller-manager/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.958396846Z namespaces/openshift-route-controller-manager/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.958428657Z namespaces/openshift-route-controller-manager/coordination.k8s.io/leases/openshift-route-controllers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.958481068Z namespaces/openshift-route-controller-manager/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.958489238Z namespaces/openshift-route-controller-manager/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.958524379Z namespaces/openshift-route-controller-manager/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.958700463Z namespaces/openshift-route-controller-manager/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.958906507Z namespaces/openshift-route-controller-manager/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.959073021Z namespaces/openshift-route-controller-manager/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.959340036Z namespaces/openshift-route-controller-manager/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.959592602Z namespaces/openshift-route-controller-manager/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.959827777Z namespaces/openshift-service-ca-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.959870598Z namespaces/openshift-service-ca-operator/openshift-service-ca-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.959934429Z namespaces/openshift-service-ca-operator/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.95997173Z namespaces/openshift-service-ca-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.960034991Z namespaces/openshift-service-ca-operator/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.960051351Z namespaces/openshift-service-ca-operator/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.960143233Z namespaces/openshift-service-ca-operator/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.960254046Z namespaces/openshift-service-ca-operator/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.960373208Z namespaces/openshift-service-ca-operator/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.960417379Z namespaces/openshift-service-ca-operator/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.96045645Z namespaces/openshift-service-ca-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.960501871Z namespaces/openshift-service-ca-operator/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.960540852Z namespaces/openshift-service-ca-operator/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.960619094Z namespaces/openshift-service-ca-operator/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.960661024Z namespaces/openshift-service-ca-operator/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.960703295Z namespaces/openshift-service-ca-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.960787107Z namespaces/openshift-service-ca-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.960844178Z namespaces/openshift-service-ca-operator/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.960855968Z namespaces/openshift-service-ca-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.960880279Z namespaces/openshift-service-ca-operator/coordination.k8s.io/leases/service-ca-operator-lock.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.96092756Z namespaces/openshift-service-ca-operator/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.960974141Z namespaces/openshift-service-ca-operator/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.961100204Z namespaces/openshift-service-ca-operator/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.961192326Z namespaces/openshift-service-ca-operator/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.96140649Z namespaces/openshift-service-ca-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.961490032Z namespaces/openshift-service-ca-operator/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.961598464Z namespaces/openshift-service-ca-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.961720667Z namespaces/openshift-service-ca-operator/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.96188694Z namespaces/openshift-service-ca-operator/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.961943631Z namespaces/openshift-service-ca-operator/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.962040774Z namespaces/openshift-service-ca-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.962094335Z namespaces/openshift-service-ca-operator/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.962132255Z namespaces/openshift-service-ca-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.962186157Z namespaces/openshift-service-ca-operator/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.962221668Z namespaces/openshift-service-ca-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.96233492Z namespaces/openshift-service-ca-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.962412772Z namespaces/openshift-service-ca-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.962459473Z namespaces/openshift-service-ca-operator/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.962500063Z namespaces/openshift-service-ca-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.962551135Z namespaces/openshift-service-ca-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.962593805Z namespaces/openshift-service-ca-operator/monitoring.coreos.com/servicemonitors/service-ca-operator.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.962653937Z namespaces/openshift-service-ca-operator/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.962691027Z namespaces/openshift-service-ca-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.962733668Z namespaces/openshift-service-ca-operator/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.962741079Z namespaces/openshift-service-ca-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.962782829Z namespaces/openshift-service-ca-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.962921052Z namespaces/openshift-service-ca-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.963107806Z namespaces/openshift-service-ca-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.96327159Z namespaces/openshift-service-ca-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.963469664Z namespaces/openshift-service-ca-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.963702329Z namespaces/openshift-service-ca-operator/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.963888893Z namespaces/openshift-service-ca-operator/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.963897063Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-d6fc45fc5-4kn9f/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.963927654Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-d6fc45fc5-4kn9f/service-ca-operator-d6fc45fc5-4kn9f.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.964014935Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-d6fc45fc5-4kn9f/service-ca-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.964025846Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-d6fc45fc5-4kn9f/service-ca-operator/service-ca-operator/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.964032426Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-d6fc45fc5-4kn9f/service-ca-operator/service-ca-operator/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.964058996Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-d6fc45fc5-4kn9f/service-ca-operator/service-ca-operator/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.964200389Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-d6fc45fc5-4kn9f/service-ca-operator/service-ca-operator/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.964417314Z namespaces/openshift-service-ca-operator/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.964448685Z namespaces/openshift-service-ca-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.964505526Z namespaces/openshift-service-ca-operator/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.964544017Z namespaces/openshift-service-ca-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.964595778Z namespaces/openshift-service-ca/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.964638819Z namespaces/openshift-service-ca/openshift-service-ca.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.96468846Z namespaces/openshift-service-ca/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.96472903Z namespaces/openshift-service-ca/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.964775091Z namespaces/openshift-service-ca/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.964817083Z namespaces/openshift-service-ca/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.964901954Z namespaces/openshift-service-ca/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.964997716Z namespaces/openshift-service-ca/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.965093438Z namespaces/openshift-service-ca/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.965137309Z namespaces/openshift-service-ca/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.96517448Z namespaces/openshift-service-ca/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.965212581Z namespaces/openshift-service-ca/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.965290082Z namespaces/openshift-service-ca/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.965379944Z namespaces/openshift-service-ca/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.965421745Z namespaces/openshift-service-ca/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.965469356Z namespaces/openshift-service-ca/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.965541108Z namespaces/openshift-service-ca/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.965586049Z namespaces/openshift-service-ca/coordination.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.965592579Z namespaces/openshift-service-ca/coordination.k8s.io/leases/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.96562662Z namespaces/openshift-service-ca/coordination.k8s.io/leases/service-ca-controller-lock.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.965684591Z namespaces/openshift-service-ca/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.965721642Z namespaces/openshift-service-ca/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.965826934Z namespaces/openshift-service-ca/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.965903155Z namespaces/openshift-service-ca/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.966013218Z namespaces/openshift-service-ca/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.96609199Z namespaces/openshift-service-ca/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.966201422Z namespaces/openshift-service-ca/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.966359465Z namespaces/openshift-service-ca/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.966530189Z namespaces/openshift-service-ca/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.96657583Z namespaces/openshift-service-ca/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.966621611Z namespaces/openshift-service-ca/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.966668682Z namespaces/openshift-service-ca/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.966703672Z namespaces/openshift-service-ca/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.966760644Z namespaces/openshift-service-ca/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.966799594Z namespaces/openshift-service-ca/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.966879046Z namespaces/openshift-service-ca/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.966959528Z namespaces/openshift-service-ca/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.967018239Z namespaces/openshift-service-ca/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.96705877Z namespaces/openshift-service-ca/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.967106321Z namespaces/openshift-service-ca/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.967143772Z namespaces/openshift-service-ca/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.967190683Z namespaces/openshift-service-ca/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.967200383Z namespaces/openshift-service-ca/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.967260844Z namespaces/openshift-service-ca/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.967428608Z namespaces/openshift-service-ca/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.967601771Z namespaces/openshift-service-ca/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.967742745Z namespaces/openshift-service-ca/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.967937659Z namespaces/openshift-service-ca/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.968173474Z namespaces/openshift-service-ca/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.968390988Z namespaces/openshift-service-ca/pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.968402359Z namespaces/openshift-service-ca/pods/service-ca-865cb79987-phvc9/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.968433149Z namespaces/openshift-service-ca/pods/service-ca-865cb79987-phvc9/service-ca-865cb79987-phvc9.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.968537261Z namespaces/openshift-service-ca/pods/service-ca-865cb79987-phvc9/service-ca-controller/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.968550422Z namespaces/openshift-service-ca/pods/service-ca-865cb79987-phvc9/service-ca-controller/service-ca-controller/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.968555572Z namespaces/openshift-service-ca/pods/service-ca-865cb79987-phvc9/service-ca-controller/service-ca-controller/logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.968587943Z namespaces/openshift-service-ca/pods/service-ca-865cb79987-phvc9/service-ca-controller/service-ca-controller/logs/current.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.968791777Z namespaces/openshift-service-ca/pods/service-ca-865cb79987-phvc9/service-ca-controller/service-ca-controller/logs/previous.insecure.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.968859988Z namespaces/openshift-service-ca/pods/service-ca-865cb79987-phvc9/service-ca-controller/service-ca-controller/logs/previous.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.968907919Z namespaces/openshift-service-ca/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.9689384Z namespaces/openshift-service-ca/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.968989451Z namespaces/openshift-service-ca/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.969039822Z namespaces/openshift-service-ca/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.969082783Z namespaces/openshift-user-workload-monitoring/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.969122674Z namespaces/openshift-user-workload-monitoring/openshift-user-workload-monitoring.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.969182245Z namespaces/openshift-user-workload-monitoring/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.969219076Z namespaces/openshift-user-workload-monitoring/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.969294158Z namespaces/openshift-user-workload-monitoring/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.969338728Z namespaces/openshift-user-workload-monitoring/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.96941577Z namespaces/openshift-user-workload-monitoring/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.969500902Z namespaces/openshift-user-workload-monitoring/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.969585844Z namespaces/openshift-user-workload-monitoring/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.969638265Z namespaces/openshift-user-workload-monitoring/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.969678346Z namespaces/openshift-user-workload-monitoring/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.969724567Z namespaces/openshift-user-workload-monitoring/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.969764777Z namespaces/openshift-user-workload-monitoring/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.969846559Z namespaces/openshift-user-workload-monitoring/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.96989313Z namespaces/openshift-user-workload-monitoring/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.969934111Z namespaces/openshift-user-workload-monitoring/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.970011283Z namespaces/openshift-user-workload-monitoring/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.970060854Z namespaces/openshift-user-workload-monitoring/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.970100035Z namespaces/openshift-user-workload-monitoring/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.970195097Z namespaces/openshift-user-workload-monitoring/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.970298039Z namespaces/openshift-user-workload-monitoring/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.97038095Z namespaces/openshift-user-workload-monitoring/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.970455302Z namespaces/openshift-user-workload-monitoring/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.970536534Z namespaces/openshift-user-workload-monitoring/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.970658966Z namespaces/openshift-user-workload-monitoring/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.971182958Z namespaces/openshift-user-workload-monitoring/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.971248989Z namespaces/openshift-user-workload-monitoring/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.97131353Z namespaces/openshift-user-workload-monitoring/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.971355721Z namespaces/openshift-user-workload-monitoring/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.971396062Z namespaces/openshift-user-workload-monitoring/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.971444073Z namespaces/openshift-user-workload-monitoring/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.971491684Z namespaces/openshift-user-workload-monitoring/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.971572676Z namespaces/openshift-user-workload-monitoring/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.971645717Z namespaces/openshift-user-workload-monitoring/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.971727359Z namespaces/openshift-user-workload-monitoring/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.97177157Z namespaces/openshift-user-workload-monitoring/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.971819341Z namespaces/openshift-user-workload-monitoring/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.971858752Z namespaces/openshift-user-workload-monitoring/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.971906413Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.971913333Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.971945243Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.972125617Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.972332852Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.972476685Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.972673719Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.972903904Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.973093478Z namespaces/openshift-user-workload-monitoring/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.973131439Z namespaces/openshift-user-workload-monitoring/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.97317818Z namespaces/openshift-user-workload-monitoring/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.97320946Z namespaces/openshift-user-workload-monitoring/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.973285072Z namespaces/openshift/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.973329293Z namespaces/openshift/openshift.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.973389444Z namespaces/openshift/apps.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.973423075Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.973469986Z namespaces/openshift/apps/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.973514087Z namespaces/openshift/apps/daemonsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.973594569Z namespaces/openshift/apps/deployments.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.97366317Z namespaces/openshift/apps/replicasets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.973742192Z namespaces/openshift/apps/statefulsets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.973793683Z namespaces/openshift/autoscaling/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.973827603Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.973879064Z namespaces/openshift/batch/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.973916105Z namespaces/openshift/batch/cronjobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.974012767Z namespaces/openshift/batch/jobs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.974048138Z namespaces/openshift/build.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.974090399Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.974168551Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.974219132Z namespaces/openshift/core/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.974299944Z namespaces/openshift/core/configmaps.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.974399075Z namespaces/openshift/core/endpoints.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.974474127Z namespaces/openshift/core/events.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.974550739Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.97462966Z namespaces/openshift/core/pods.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.974705132Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.974825705Z namespaces/openshift/core/secrets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.974986248Z namespaces/openshift/core/services.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.9750565Z namespaces/openshift/discovery.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.975103781Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.975145911Z namespaces/openshift/image.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.975190492Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.976407768Z namespaces/openshift/image.openshift.io/imagestreams/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.97647794Z namespaces/openshift/image.openshift.io/imagestreams/cli-artifacts.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.976573322Z namespaces/openshift/image.openshift.io/imagestreams/cli.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.976652014Z namespaces/openshift/image.openshift.io/imagestreams/dotnet-runtime.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.976762086Z namespaces/openshift/image.openshift.io/imagestreams/dotnet.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.976870988Z namespaces/openshift/image.openshift.io/imagestreams/driver-toolkit.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.97695341Z namespaces/openshift/image.openshift.io/imagestreams/fuse7-eap-openshift-java11.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.977103663Z namespaces/openshift/image.openshift.io/imagestreams/fuse7-eap-openshift.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.977283547Z namespaces/openshift/image.openshift.io/imagestreams/fuse7-java-openshift.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.977405799Z namespaces/openshift/image.openshift.io/imagestreams/fuse7-java11-openshift.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.977497871Z namespaces/openshift/image.openshift.io/imagestreams/fuse7-karaf-openshift-jdk11.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.977587643Z namespaces/openshift/image.openshift.io/imagestreams/fuse7-karaf-openshift.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.977705086Z namespaces/openshift/image.openshift.io/imagestreams/golang.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.977812758Z namespaces/openshift/image.openshift.io/imagestreams/httpd.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.97791666Z namespaces/openshift/image.openshift.io/imagestreams/installer-artifacts.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.978009022Z namespaces/openshift/image.openshift.io/imagestreams/installer.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.978098914Z namespaces/openshift/image.openshift.io/imagestreams/java-runtime.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.978195906Z namespaces/openshift/image.openshift.io/imagestreams/java.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.978336609Z namespaces/openshift/image.openshift.io/imagestreams/jboss-datagrid73-openshift.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.978446661Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap-xp3-openjdk11-openshift.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.978543423Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap-xp3-openjdk11-runtime-openshift.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.978638176Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap-xp4-openjdk11-openshift.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.978740998Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap-xp4-openjdk11-runtime-openshift.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.97883711Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap74-openjdk11-openshift.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.978940872Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap74-openjdk11-runtime-openshift.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.979052464Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap74-openjdk8-openshift.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.979147496Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap74-openjdk8-runtime-openshift.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.979276739Z namespaces/openshift/image.openshift.io/imagestreams/jboss-webserver57-openjdk11-tomcat9-openshift-ubi8.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.979386911Z namespaces/openshift/image.openshift.io/imagestreams/jboss-webserver57-openjdk8-tomcat9-openshift-ubi8.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.979522354Z namespaces/openshift/image.openshift.io/imagestreams/jenkins-agent-base.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.979624596Z namespaces/openshift/image.openshift.io/imagestreams/jenkins.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.979749309Z namespaces/openshift/image.openshift.io/imagestreams/mariadb.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.979888712Z namespaces/openshift/image.openshift.io/imagestreams/must-gather.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.979980184Z namespaces/openshift/image.openshift.io/imagestreams/mysql.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.980083886Z namespaces/openshift/image.openshift.io/imagestreams/network-tools.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.980176198Z namespaces/openshift/image.openshift.io/imagestreams/nginx.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.980315281Z namespaces/openshift/image.openshift.io/imagestreams/nodejs.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.980462544Z namespaces/openshift/image.openshift.io/imagestreams/oauth-proxy.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.980549536Z namespaces/openshift/image.openshift.io/imagestreams/openjdk-11-rhel7.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.980664598Z namespaces/openshift/image.openshift.io/imagestreams/perl.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.980765201Z namespaces/openshift/image.openshift.io/imagestreams/php.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.980879033Z namespaces/openshift/image.openshift.io/imagestreams/postgresql.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.981006866Z namespaces/openshift/image.openshift.io/imagestreams/postgresql13-for-sso75-openshift-rhel8.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.981098577Z namespaces/openshift/image.openshift.io/imagestreams/postgresql13-for-sso76-openshift-rhel8.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.981187419Z namespaces/openshift/image.openshift.io/imagestreams/python.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.981328353Z namespaces/openshift/image.openshift.io/imagestreams/redhat-openjdk18-openshift.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.981464395Z namespaces/openshift/image.openshift.io/imagestreams/redis.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.981570818Z namespaces/openshift/image.openshift.io/imagestreams/ruby.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.98167139Z namespaces/openshift/image.openshift.io/imagestreams/sso75-openshift-rhel8.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.981767462Z namespaces/openshift/image.openshift.io/imagestreams/sso76-openshift-rhel8.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.981856314Z namespaces/openshift/image.openshift.io/imagestreams/tests.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.981951136Z namespaces/openshift/image.openshift.io/imagestreams/tools.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.982064158Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-11-runtime.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.982185051Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-11.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.982406685Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-17-runtime.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.982520468Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-17.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.98263408Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-21-runtime.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.982724582Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-21.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.982817964Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-8-runtime.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.982951777Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-8.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.983050319Z namespaces/openshift/k8s.ovn.org/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.98308633Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.983173652Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.983267894Z namespaces/openshift/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.983329475Z namespaces/openshift/monitoring.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.983393026Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.983443778Z namespaces/openshift/networking.k8s.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.983487988Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.983530429Z namespaces/openshift/operators.coreos.com/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.983537039Z namespaces/openshift/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.98357379Z namespaces/openshift/operators.coreos.com/clusterserviceversions/authorino-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.983721993Z namespaces/openshift/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.19.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.983904057Z namespaces/openshift/operators.coreos.com/clusterserviceversions/dns-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.98403743Z namespaces/openshift/operators.coreos.com/clusterserviceversions/limitador-operator.v1.3.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.984221254Z namespaces/openshift/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.3.2.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.984472769Z namespaces/openshift/operators.coreos.com/clusterserviceversions/servicemeshoperator3.v3.1.0.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.984660723Z namespaces/openshift/policy/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.984700634Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.984743475Z namespaces/openshift/route.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.984784116Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.984829517Z namespaces/openshift/template.openshift.io/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.984836027Z namespaces/openshift/template.openshift.io/templates/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.984870598Z namespaces/openshift/template.openshift.io/templates/cache-service.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.9849765Z namespaces/openshift/template.openshift.io/templates/cakephp-mysql-example.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.985118013Z namespaces/openshift/template.openshift.io/templates/cakephp-mysql-persistent.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.985252976Z namespaces/openshift/template.openshift.io/templates/dancer-mysql-example.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.985364598Z namespaces/openshift/template.openshift.io/templates/dancer-mysql-persistent.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.985525871Z namespaces/openshift/template.openshift.io/templates/datagrid-service.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.985631884Z namespaces/openshift/template.openshift.io/templates/django-psql-example.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.985743936Z namespaces/openshift/template.openshift.io/templates/django-psql-persistent.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.985851498Z namespaces/openshift/template.openshift.io/templates/eap-xp3-basic-s2i.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.985970011Z namespaces/openshift/template.openshift.io/templates/eap-xp4-basic-s2i.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.986078923Z namespaces/openshift/template.openshift.io/templates/eap74-basic-s2i.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.986190966Z namespaces/openshift/template.openshift.io/templates/eap74-https-s2i.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.986334439Z namespaces/openshift/template.openshift.io/templates/eap74-sso-s2i.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.986473191Z namespaces/openshift/template.openshift.io/templates/httpd-example.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.986570084Z namespaces/openshift/template.openshift.io/templates/jenkins-ephemeral-monitored.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.986726977Z namespaces/openshift/template.openshift.io/templates/jenkins-ephemeral.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.986839079Z namespaces/openshift/template.openshift.io/templates/jenkins-persistent-monitored.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.986947472Z namespaces/openshift/template.openshift.io/templates/jenkins-persistent.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.987130656Z namespaces/openshift/template.openshift.io/templates/jws57-openjdk11-tomcat9-ubi8-basic-s2i.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.987258068Z namespaces/openshift/template.openshift.io/templates/jws57-openjdk11-tomcat9-ubi8-https-s2i.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.987375921Z namespaces/openshift/template.openshift.io/templates/jws57-openjdk8-tomcat9-ubi8-basic-s2i.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.987472513Z namespaces/openshift/template.openshift.io/templates/jws57-openjdk8-tomcat9-ubi8-https-s2i.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.987575175Z namespaces/openshift/template.openshift.io/templates/mariadb-ephemeral.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.987690057Z namespaces/openshift/template.openshift.io/templates/mariadb-persistent.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.98778933Z namespaces/openshift/template.openshift.io/templates/mysql-ephemeral.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.987887941Z namespaces/openshift/template.openshift.io/templates/mysql-persistent.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.987988914Z namespaces/openshift/template.openshift.io/templates/nginx-example.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.988082776Z namespaces/openshift/template.openshift.io/templates/nodejs-postgresql-example.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.988197738Z namespaces/openshift/template.openshift.io/templates/nodejs-postgresql-persistent.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.988331901Z namespaces/openshift/template.openshift.io/templates/openjdk-web-basic-s2i.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.988436343Z namespaces/openshift/template.openshift.io/templates/postgresql-ephemeral.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.988532455Z namespaces/openshift/template.openshift.io/templates/postgresql-persistent.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.988630137Z namespaces/openshift/template.openshift.io/templates/rails-pgsql-persistent.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.98876339Z namespaces/openshift/template.openshift.io/templates/rails-postgresql-example.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.988900013Z namespaces/openshift/template.openshift.io/templates/react-web-app-example.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.989002425Z namespaces/openshift/template.openshift.io/templates/redis-ephemeral.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.989103627Z namespaces/openshift/template.openshift.io/templates/redis-persistent.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.989200329Z namespaces/openshift/template.openshift.io/templates/s2i-fuse712-spring-boot-2-camel-rest-3scale.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.989338112Z namespaces/openshift/template.openshift.io/templates/s2i-fuse712-spring-boot-2-camel-xml.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.989447645Z namespaces/openshift/template.openshift.io/templates/s2i-fuse712-spring-boot-2-camel.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.989552987Z namespaces/openshift/template.openshift.io/templates/sso75-https.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.989669439Z namespaces/openshift/template.openshift.io/templates/sso75-ocp4-x509-https.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.989779202Z namespaces/openshift/template.openshift.io/templates/sso75-ocp4-x509-postgresql-persistent.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.989901794Z namespaces/openshift/template.openshift.io/templates/sso75-postgresql-persistent.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.990036537Z namespaces/openshift/template.openshift.io/templates/sso75-postgresql.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.99016595Z namespaces/openshift/template.openshift.io/templates/sso76-ocp4-https.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.990396795Z namespaces/openshift/template.openshift.io/templates/sso76-ocp4-postgresql-persistent.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.990539888Z namespaces/openshift/template.openshift.io/templates/sso76-ocp4-postgresql.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.99066244Z namespaces/openshift/template.openshift.io/templates/sso76-ocp4-x509-https.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.990773473Z namespaces/openshift/template.openshift.io/templates/sso76-ocp4-x509-postgresql-persistent.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.990880685Z network_logs/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.990920496Z network_logs/cluster_scale [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.991020178Z network_logs/ippools.whereabouts.cni.cncf.io [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.991084889Z network_logs/multi-networkpolicy [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.991164001Z network_logs/net-attach-def [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.991264183Z network_logs/overlappingrangeipreservations.whereabouts.cni.cncf.io [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.991407296Z network_logs/ovn_kubernetes_top_pods [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.991501078Z network_logs/ovnk_database_store.tar.gz [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.993152323Z nodes/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.993179204Z nodes/debug [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.993308476Z nodes/ip-10-0-133-36.ec2.internal/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.993341027Z nodes/ip-10-0-133-36.ec2.internal/cpu_affinities.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.993595002Z nodes/ip-10-0-133-36.ec2.internal/dmesg [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.993871059Z nodes/ip-10-0-133-36.ec2.internal/ethtool_channels [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.99395082Z nodes/ip-10-0-133-36.ec2.internal/ethtool_features [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.994037702Z nodes/ip-10-0-133-36.ec2.internal/ip-10-0-133-36.ec2.internal_logs_kubelet.gz [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.994470061Z nodes/ip-10-0-133-36.ec2.internal/irq_affinities.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.994614324Z nodes/ip-10-0-133-36.ec2.internal/lscpu [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.994733417Z nodes/ip-10-0-133-36.ec2.internal/lspci [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.994827589Z nodes/ip-10-0-133-36.ec2.internal/podresources.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.994927681Z nodes/ip-10-0-133-36.ec2.internal/pods_info.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.995047163Z nodes/ip-10-0-133-36.ec2.internal/proc_cmdline [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.995128325Z nodes/ip-10-0-133-36.ec2.internal/sysinfo.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.996827711Z nodes/ip-10-0-133-36.ec2.internal/sysinfo.tgz [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.996970504Z nodes/ip-10-0-134-232.ec2.internal/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.997011115Z nodes/ip-10-0-134-232.ec2.internal/cpu_affinities.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.997439374Z nodes/ip-10-0-134-232.ec2.internal/dmesg [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.9977051Z nodes/ip-10-0-134-232.ec2.internal/ethtool_channels [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.997783222Z nodes/ip-10-0-134-232.ec2.internal/ethtool_features [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.997864453Z nodes/ip-10-0-134-232.ec2.internal/ip-10-0-134-232.ec2.internal_logs_kubelet.gz [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.998215461Z nodes/ip-10-0-134-232.ec2.internal/irq_affinities.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.998378394Z nodes/ip-10-0-134-232.ec2.internal/lscpu [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.998500517Z nodes/ip-10-0-134-232.ec2.internal/lspci [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.998587819Z nodes/ip-10-0-134-232.ec2.internal/podresources.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.998699691Z nodes/ip-10-0-134-232.ec2.internal/pods_info.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.998813043Z nodes/ip-10-0-134-232.ec2.internal/proc_cmdline [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:01.998888855Z nodes/ip-10-0-134-232.ec2.internal/sysinfo.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.0005591Z nodes/ip-10-0-134-232.ec2.internal/sysinfo.tgz [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.000762634Z nodes/ip-10-0-142-242.ec2.internal/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.000799575Z nodes/ip-10-0-142-242.ec2.internal/cpu_affinities.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.001117412Z nodes/ip-10-0-142-242.ec2.internal/dmesg [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.001394778Z nodes/ip-10-0-142-242.ec2.internal/ethtool_channels [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.00147106Z nodes/ip-10-0-142-242.ec2.internal/ethtool_features [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.001590592Z nodes/ip-10-0-142-242.ec2.internal/ip-10-0-142-242.ec2.internal_logs_kubelet.gz [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.001940899Z nodes/ip-10-0-142-242.ec2.internal/irq_affinities.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.002078213Z nodes/ip-10-0-142-242.ec2.internal/lscpu [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.002196925Z nodes/ip-10-0-142-242.ec2.internal/lspci [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.002307597Z nodes/ip-10-0-142-242.ec2.internal/podresources.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.002405709Z nodes/ip-10-0-142-242.ec2.internal/pods_info.json [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.002521812Z nodes/ip-10-0-142-242.ec2.internal/proc_cmdline [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.002602453Z nodes/ip-10-0-142-242.ec2.internal/sysinfo.log [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.004297909Z nodes/ip-10-0-142-242.ec2.internal/sysinfo.tgz [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.004445773Z pod_network_connectivity_check/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.004472433Z pod_network_connectivity_check/podnetworkconnectivitychecks.yaml [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.004582206Z static-pods/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.004589066Z static-pods/kube-apiserver/ [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.013027145Z [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.013042975Z sent 70,722 bytes received 6,711,273 bytes 4,521,330.00 bytes/sec [must-gather] [must-gather-qrvlz] OUT 2026-04-24T22:17:02.013047685Z total size is 81,731,780 speedup is 12.05 [must-gather] [must-gather ] OUT 2026-04-24T22:17:02.31845697Z namespace/openshift-must-gather-wmq6v deleted [must-gather] [must-gather] [must-gather] Reprinting Cluster State: [must-gather] When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: [must-gather] ClusterID: 570d497c-e2e1-4bdb-af5f-93d2fedcb369 [must-gather] ClientVersion: 4.21.5 [must-gather] ClusterVersion: Stable at "4.20.19" [must-gather] ClusterOperators: [must-gather] clusteroperator/authentication is missing [must-gather] clusteroperator/cloud-credential is missing [must-gather] clusteroperator/cluster-autoscaler is missing [must-gather] clusteroperator/config-operator is missing [must-gather] clusteroperator/etcd is missing [must-gather] clusteroperator/machine-api is missing [must-gather] clusteroperator/machine-approver is missing [must-gather] clusteroperator/machine-config is missing [must-gather] clusteroperator/marketplace is missing [must-gather] [must-gather] [git-push-artifacts] WORK_DIR: /workspace/odh-ci-artifacts [git-push-artifacts] REPO_PATH: opendatahub-io/odh-build-metadata [git-push-artifacts] REPO_BRANCH: ci-artifacts [git-push-artifacts] SPARSE_FILE_PATH: test-artifacts/docs [git-push-artifacts] SOURCE_PATH: /workspace/artifacts-dir [git-push-artifacts] DEST_PATH: test-artifacts/kserve-group-test-jl5k8 [git-push-artifacts] ALWAYS_PASS: false [git-push-artifacts] configuring gh token [git-push-artifacts] taking github token from Konflux bot [git-push-artifacts] Initialized empty Git repository in /workspace/odh-ci-artifacts/.git/ [git-push-artifacts] Using partial fetch with sparse checkout for: test-artifacts/docs [git-push-artifacts] From https://github.com/opendatahub-io/odh-build-metadata [git-push-artifacts] * branch ci-artifacts -> FETCH_HEAD [git-push-artifacts] * [new branch] ci-artifacts -> origin/ci-artifacts [git-push-artifacts] Already on 'ci-artifacts' [git-push-artifacts] branch 'ci-artifacts' set up to track 'origin/ci-artifacts'. [git-push-artifacts] TASK_NAME=kserve-group-test-jl5k8-e2e-llm-inference-service [git-push-artifacts] PIPELINERUN_NAME=kserve-group-test-jl5k8 [git-push-artifacts] From https://github.com/opendatahub-io/odh-build-metadata [git-push-artifacts] * branch ci-artifacts -> FETCH_HEAD [git-push-artifacts] 12b26ac..4c3822b ci-artifacts -> origin/ci-artifacts [git-push-artifacts] Updating 12b26ac..4c3822b [git-push-artifacts] Fast-forward [git-push-artifacts] .../kserve-group-test-xx566/e2e-graph.tar.gz | Bin 0 -> 7303298 bytes [git-push-artifacts] 1 file changed, 0 insertions(+), 0 deletions(-) [git-push-artifacts] create mode 100644 test-artifacts/kserve-group-test-xx566/e2e-graph.tar.gz [git-push-artifacts] -rw-r--r--. 1 root 1001540000 15292786 Apr 24 22:18 /workspace/odh-ci-artifacts/test-artifacts/kserve-group-test-jl5k8/e2e-llm-inference-service.tar.gz [git-push-artifacts] [ci-artifacts f64663a] Updating CI Artifacts in e2e-llm-inference-service [git-push-artifacts] 1 file changed, 0 insertions(+), 0 deletions(-) [git-push-artifacts] create mode 100644 test-artifacts/kserve-group-test-jl5k8/e2e-llm-inference-service.tar.gz [git-push-artifacts] From https://github.com/opendatahub-io/odh-build-metadata [git-push-artifacts] * branch ci-artifacts -> FETCH_HEAD [git-push-artifacts] Already up to date. [git-push-artifacts] To https://github.com/opendatahub-io/odh-build-metadata.git [git-push-artifacts] 4c3822b..f64663a ci-artifacts -> ci-artifacts [fail-if-needed] Failing pipeline because deploy-and-e2e step failed container step-fail-if-needed has failed : [{"key":"StartedAt","value":"2026-04-24T22:18:29.310Z","type":3}]