task e2e-llm-inference-service has failed: "step-fail-if-needed" exited with code 1: Error [get-kubeconfig] Found kubeconfig secret: cluster-4n55p-admin-kubeconfig [get-kubeconfig] Wrote kubeconfig to /credentials/cluster-4n55p-kubeconfig [get-kubeconfig] Found admin password secret: cluster-4n55p-admin-password [get-kubeconfig] Retrieved username [get-kubeconfig] Wrote password to /credentials/cluster-4n55p-password [get-kubeconfig] API Server URL: https://acedd55ad419b4b75b7beb4cbae0c7a2-ffb7c518e1932034.elb.us-east-1.amazonaws.com:6443 [get-kubeconfig] Console URL: https://console-openshift-console.apps.4aa91c40-e787-4671-b288-3d23c862e314.prod.konfluxeaas.com [clone-repo] dependabot/go_modules/kserve-module/golang.org/x/crypto-0.52.0 [clone-repo] https://github.com/opendatahub-io/kserve [clone-repo] Cloning into '/workspace/source'... [clone-repo] Updating files: 91% (2860/3110) Updating files: 92% (2862/3110) Updating files: 93% (2893/3110) Updating files: 94% (2924/3110) Updating files: 95% (2955/3110) Updating files: 96% (2986/3110) Updating files: 97% (3017/3110) Updating files: 98% (3048/3110) Updating files: 99% (3079/3110) Updating files: 100% (3110/3110) Updating files: 100% (3110/3110), done. [e2e-llm-inference-service] + bash [e2e-llm-inference-service] + STATUS_FILE=/test-status/deploy-and-e2e-status [e2e-llm-inference-service] + echo failed [e2e-llm-inference-service] + COMPONENT_NAME=kserve-agent-ci [e2e-llm-inference-service] ++ jq -r --arg component_name kserve-agent-ci '.[$component_name].image' [e2e-llm-inference-service] + export KSERVE_AGENT_IMAGE=quay.io/opendatahub/kserve-agent@sha256:a8af8a2170a3b8493ae189c8989df58dc741117c4c685b6dd5257bb2fa023732 [e2e-llm-inference-service] + KSERVE_AGENT_IMAGE=quay.io/opendatahub/kserve-agent@sha256:a8af8a2170a3b8493ae189c8989df58dc741117c4c685b6dd5257bb2fa023732 [e2e-llm-inference-service] + COMPONENT_NAME=kserve-controller-ci [e2e-llm-inference-service] ++ jq -r --arg component_name kserve-controller-ci '.[$component_name].image' [e2e-llm-inference-service] + export KSERVE_CONTROLLER_IMAGE=quay.io/opendatahub/kserve-controller@sha256:69aadb523525e06186640a0b5c2784a130c3fd1d21ca10bf6be99d8ac31ceb31 [e2e-llm-inference-service] + KSERVE_CONTROLLER_IMAGE=quay.io/opendatahub/kserve-controller@sha256:69aadb523525e06186640a0b5c2784a130c3fd1d21ca10bf6be99d8ac31ceb31 [e2e-llm-inference-service] + COMPONENT_NAME=kserve-router-ci [e2e-llm-inference-service] ++ jq -r --arg component_name kserve-router-ci '.[$component_name].image' [e2e-llm-inference-service] + export KSERVE_ROUTER_IMAGE=quay.io/opendatahub/kserve-router@sha256:e73cf00d90f73d1d01a06b6ae2314be097a351767b51977a258bb8a2a00529db [e2e-llm-inference-service] + KSERVE_ROUTER_IMAGE=quay.io/opendatahub/kserve-router@sha256:e73cf00d90f73d1d01a06b6ae2314be097a351767b51977a258bb8a2a00529db [e2e-llm-inference-service] + COMPONENT_NAME=kserve-storage-initializer-ci [e2e-llm-inference-service] ++ jq -r --arg component_name kserve-storage-initializer-ci '.[$component_name].image' [e2e-llm-inference-service] + export STORAGE_INITIALIZER_IMAGE=quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85 [e2e-llm-inference-service] + STORAGE_INITIALIZER_IMAGE=quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85 [e2e-llm-inference-service] + COMPONENT_NAME=odh-kserve-llmisvc-controller-ci [e2e-llm-inference-service] ++ jq -r --arg component_name odh-kserve-llmisvc-controller-ci '.[$component_name].image' [e2e-llm-inference-service] + export LLMISVC_CONTROLLER_IMAGE=quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:5bb0bc80cc63ed263b0380b8cf38a317e489337ef8efdf9a5eb9ba9189da6598 [e2e-llm-inference-service] + LLMISVC_CONTROLLER_IMAGE=quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:5bb0bc80cc63ed263b0380b8cf38a317e489337ef8efdf9a5eb9ba9189da6598 [e2e-llm-inference-service] + ./test/scripts/openshift-ci/run-e2e-tests.sh 'llminferenceservice and cluster_cpu and not autoscaling and not tracing' 2 llm-d [e2e-llm-inference-service] INFERENCE_POOL_GROUP=inference.networking.k8s.io (detected from OCP 4.21.24) [e2e-llm-inference-service] Installing on cluster [e2e-llm-inference-service] Using namespace: kserve for KServe components [e2e-llm-inference-service] SKLEARN_IMAGE=quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1717 [e2e-llm-inference-service] OPT_125M_MODEL_URI=s3://example-models/facebook/opt-125m [e2e-llm-inference-service] ERROR_404_ISVC_IMAGE=quay.io/opendatahub/error-404-isvc:odh-pr-1717 [e2e-llm-inference-service] SUCCESS_200_ISVC_IMAGE=quay.io/opendatahub/success-200-isvc:odh-pr-1717 [e2e-llm-inference-service] [INFO] Installing Kustomize v5.8.1 for linux/amd64... [e2e-llm-inference-service] [SUCCESS] Successfully installed Kustomize v5.8.1 to /workspace/source/bin/kustomize [e2e-llm-inference-service] v5.8.1 [e2e-llm-inference-service] make: Entering directory '/workspace/source' [e2e-llm-inference-service] [INFO] Installing yq v4.52.1 for linux/amd64... [e2e-llm-inference-service] [SUCCESS] Successfully installed yq v4.52.1 to /workspace/source/bin/yq [e2e-llm-inference-service] yq (https://github.com/mikefarah/yq/) version v4.52.1 [e2e-llm-inference-service] make: Leaving directory '/workspace/source' [e2e-llm-inference-service] Installing KServe Python SDK ... [e2e-llm-inference-service] [INFO] Installing uv 0.7.8 for linux/amd64... [e2e-llm-inference-service] [SUCCESS] Successfully installed uv 0.7.8 to /workspace/source/bin/uv [e2e-llm-inference-service] warning: Failed to read project metadata (No `pyproject.toml` found in current directory or any parent directory). Running `uv self version` for compatibility. This fallback will be removed in the future; pass `--preview` to force an error. [e2e-llm-inference-service] uv 0.7.8 [e2e-llm-inference-service] Creating virtual environment... [e2e-llm-inference-service] warning: virtualenv's `--clear` has no effect (uv always clears the virtual environment) [e2e-llm-inference-service] Using CPython 3.9.25 interpreter at: /usr/bin/python3 [e2e-llm-inference-service] Creating virtual environment at: .venv [e2e-llm-inference-service] /workspace/source [e2e-llm-inference-service] Using CPython 3.11.13 interpreter at: /usr/bin/python3.11 [e2e-llm-inference-service] Creating virtual environment at: .venv [e2e-llm-inference-service] Resolved 266 packages in 1ms [e2e-llm-inference-service] Building kserve @ file:///workspace/source/python/kserve [e2e-llm-inference-service] Downloading pydantic-core (2.0MiB) [e2e-llm-inference-service] Downloading cryptography (4.3MiB) [e2e-llm-inference-service] Downloading kubernetes (1.9MiB) [e2e-llm-inference-service] Downloading numpy (15.7MiB) [e2e-llm-inference-service] Downloading aiohttp (1.7MiB) [e2e-llm-inference-service] Downloading botocore (12.9MiB) [e2e-llm-inference-service] Downloading setuptools (1.2MiB) [e2e-llm-inference-service] Downloading pyarrow (40.1MiB) [e2e-llm-inference-service] Downloading pandas (12.5MiB) [e2e-llm-inference-service] Downloading grpcio (6.4MiB) [e2e-llm-inference-service] Downloading black (1.6MiB) [e2e-llm-inference-service] Downloading uvloop (3.8MiB) [e2e-llm-inference-service] Downloading mypy (17.2MiB) [e2e-llm-inference-service] Downloading grpcio-tools (2.5MiB) [e2e-llm-inference-service] Downloading portforward (3.9MiB) [e2e-llm-inference-service] Building timeout-sampler==1.0.3 [e2e-llm-inference-service] Building python-simple-logger==2.0.19 [e2e-llm-inference-service] Downloading aiohttp [e2e-llm-inference-service] Downloading pydantic-core [e2e-llm-inference-service] Downloading black [e2e-llm-inference-service] Downloading grpcio-tools [e2e-llm-inference-service] Downloading setuptools [e2e-llm-inference-service] Built python-simple-logger==2.0.19 [e2e-llm-inference-service] Downloading portforward [e2e-llm-inference-service] Downloading uvloop [e2e-llm-inference-service] Downloading cryptography [e2e-llm-inference-service] Downloading grpcio [e2e-llm-inference-service] Downloading kubernetes [e2e-llm-inference-service] Built timeout-sampler==1.0.3 [e2e-llm-inference-service] Built kserve @ file:///workspace/source/python/kserve [e2e-llm-inference-service] Downloading numpy [e2e-llm-inference-service] Downloading pandas [e2e-llm-inference-service] Downloading botocore [e2e-llm-inference-service] Downloading pyarrow [e2e-llm-inference-service] Downloading mypy [e2e-llm-inference-service] Prepared 101 packages in 2.05s [e2e-llm-inference-service] warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance. [e2e-llm-inference-service] If the cache and target directories are on different filesystems, hardlinking may not be supported. [e2e-llm-inference-service] If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning. [e2e-llm-inference-service] Installed 101 packages in 298ms [e2e-llm-inference-service] + aiohappyeyeballs==2.6.1 [e2e-llm-inference-service] + aiohttp==3.13.3 [e2e-llm-inference-service] + aiosignal==1.4.0 [e2e-llm-inference-service] + annotated-doc==0.0.4 [e2e-llm-inference-service] + annotated-types==0.7.0 [e2e-llm-inference-service] + anyio==4.9.0 [e2e-llm-inference-service] + attrs==25.3.0 [e2e-llm-inference-service] + avro==1.12.0 [e2e-llm-inference-service] + black==24.3.0 [e2e-llm-inference-service] + boto3==1.37.35 [e2e-llm-inference-service] + botocore==1.37.35 [e2e-llm-inference-service] + cachetools==5.5.2 [e2e-llm-inference-service] + certifi==2025.1.31 [e2e-llm-inference-service] + cffi==2.0.0 [e2e-llm-inference-service] + charset-normalizer==3.4.1 [e2e-llm-inference-service] + click==8.1.8 [e2e-llm-inference-service] + cloudevents==1.11.0 [e2e-llm-inference-service] + colorama==0.4.6 [e2e-llm-inference-service] + colorlog==6.10.1 [e2e-llm-inference-service] + coverage==7.8.0 [e2e-llm-inference-service] + cryptography==46.0.5 [e2e-llm-inference-service] + deprecation==2.1.0 [e2e-llm-inference-service] + durationpy==0.9 [e2e-llm-inference-service] + execnet==2.1.1 [e2e-llm-inference-service] + fastapi==0.136.3 [e2e-llm-inference-service] + frozenlist==1.5.0 [e2e-llm-inference-service] + google-auth==2.39.0 [e2e-llm-inference-service] + grpc-interceptor==0.15.4 [e2e-llm-inference-service] + grpcio==1.78.1 [e2e-llm-inference-service] + grpcio-testing==1.78.1 [e2e-llm-inference-service] + grpcio-tools==1.78.1 [e2e-llm-inference-service] + h11==0.16.0 [e2e-llm-inference-service] + httpcore==1.0.9 [e2e-llm-inference-service] + httptools==0.6.4 [e2e-llm-inference-service] + httpx==0.27.2 [e2e-llm-inference-service] + httpx-retries==0.4.5 [e2e-llm-inference-service] + idna==3.10 [e2e-llm-inference-service] + iniconfig==2.1.0 [e2e-llm-inference-service] + jinja2==3.1.6 [e2e-llm-inference-service] + jmespath==1.0.1 [e2e-llm-inference-service] + kserve==0.19.0 (from file:///workspace/source/python/kserve) [e2e-llm-inference-service] + kubernetes==32.0.1 [e2e-llm-inference-service] + markupsafe==3.0.2 [e2e-llm-inference-service] + multidict==6.4.3 [e2e-llm-inference-service] + mypy==0.991 [e2e-llm-inference-service] + mypy-extensions==1.0.0 [e2e-llm-inference-service] + numpy==2.2.4 [e2e-llm-inference-service] + oauthlib==3.2.2 [e2e-llm-inference-service] + orjson==3.10.16 [e2e-llm-inference-service] + packaging==24.2 [e2e-llm-inference-service] + pandas==2.2.3 [e2e-llm-inference-service] + pathspec==0.12.1 [e2e-llm-inference-service] + platformdirs==4.3.7 [e2e-llm-inference-service] + pluggy==1.5.0 [e2e-llm-inference-service] + portforward==0.7.1 [e2e-llm-inference-service] + prometheus-client==0.21.1 [e2e-llm-inference-service] + propcache==0.3.1 [e2e-llm-inference-service] + protobuf==6.33.5 [e2e-llm-inference-service] + psutil==5.9.8 [e2e-llm-inference-service] + pyarrow==19.0.1 [e2e-llm-inference-service] + pyasn1==0.6.3 [e2e-llm-inference-service] + pyasn1-modules==0.4.2 [e2e-llm-inference-service] + pycparser==2.22 [e2e-llm-inference-service] + pydantic==2.12.4 [e2e-llm-inference-service] + pydantic-core==2.41.5 [e2e-llm-inference-service] + pyjwt==2.12.1 [e2e-llm-inference-service] + pytest==7.4.4 [e2e-llm-inference-service] + pytest-asyncio==0.23.8 [e2e-llm-inference-service] + pytest-cov==5.0.0 [e2e-llm-inference-service] + pytest-httpx==0.30.0 [e2e-llm-inference-service] + pytest-json-report==1.5.0 [e2e-llm-inference-service] + pytest-metadata==3.1.1 [e2e-llm-inference-service] + pytest-xdist==3.6.1 [e2e-llm-inference-service] + python-dateutil==2.9.0.post0 [e2e-llm-inference-service] + python-dotenv==1.1.0 [e2e-llm-inference-service] + python-multipart==0.0.22 [e2e-llm-inference-service] + python-simple-logger==2.0.19 [e2e-llm-inference-service] + pytz==2025.2 [e2e-llm-inference-service] + pyyaml==6.0.2 [e2e-llm-inference-service] + requests==2.32.3 [e2e-llm-inference-service] + requests-oauthlib==2.0.0 [e2e-llm-inference-service] + rsa==4.9.1 [e2e-llm-inference-service] + s3transfer==0.11.4 [e2e-llm-inference-service] + setuptools==78.1.0 [e2e-llm-inference-service] + six==1.17.0 [e2e-llm-inference-service] + sniffio==1.3.1 [e2e-llm-inference-service] + starlette==1.2.1 [e2e-llm-inference-service] + tabulate==0.9.0 [e2e-llm-inference-service] + timeout-sampler==1.0.3 [e2e-llm-inference-service] + timing-asgi==0.3.1 [e2e-llm-inference-service] + tomlkit==0.13.2 [e2e-llm-inference-service] + typing-extensions==4.15.0 [e2e-llm-inference-service] + typing-inspection==0.4.2 [e2e-llm-inference-service] + tzdata==2025.2 [e2e-llm-inference-service] + urllib3==2.6.2 [e2e-llm-inference-service] + uvicorn==0.34.1 [e2e-llm-inference-service] + uvloop==0.21.0 [e2e-llm-inference-service] + watchfiles==1.0.5 [e2e-llm-inference-service] + websocket-client==1.8.0 [e2e-llm-inference-service] + websockets==15.0.1 [e2e-llm-inference-service] + yarl==1.20.0 [e2e-llm-inference-service] Audited 1 package in 48ms [e2e-llm-inference-service] /workspace/source [e2e-llm-inference-service] [INFO] Installing Kustomize v5.8.1 for linux/amd64... [e2e-llm-inference-service] [INFO] Kustomize v5.8.1 is already installed in /workspace/source/bin (>= v5.8.1) [e2e-llm-inference-service] make: Entering directory '/workspace/source' [e2e-llm-inference-service] make: Leaving directory '/workspace/source' [e2e-llm-inference-service] Now using project "kserve" on server "https://acedd55ad419b4b75b7beb4cbae0c7a2-ffb7c518e1932034.elb.us-east-1.amazonaws.com:6443". [e2e-llm-inference-service] [e2e-llm-inference-service] You can add applications to this project with the 'new-app' command. For example, try: [e2e-llm-inference-service] [e2e-llm-inference-service] oc new-app rails-postgresql-example [e2e-llm-inference-service] [e2e-llm-inference-service] to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: [e2e-llm-inference-service] [e2e-llm-inference-service] kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname [e2e-llm-inference-service] [e2e-llm-inference-service] [INFO] Installing Kustomize v5.8.1 for linux/amd64... [e2e-llm-inference-service] [INFO] Kustomize v5.8.1 is already installed in /workspace/source/bin (>= v5.8.1) [e2e-llm-inference-service] make: Entering directory '/workspace/source' [e2e-llm-inference-service] make: Leaving directory '/workspace/source' [e2e-llm-inference-service] Creating namespace openshift-keda... [e2e-llm-inference-service] namespace/openshift-keda created [e2e-llm-inference-service] Namespace openshift-keda created/ensured. [e2e-llm-inference-service] --- [e2e-llm-inference-service] Creating OperatorGroup openshift-keda... [e2e-llm-inference-service] operatorgroup.operators.coreos.com/openshift-keda created [e2e-llm-inference-service] OperatorGroup openshift-keda created/ensured. [e2e-llm-inference-service] --- [e2e-llm-inference-service] Creating Subscription for openshift-custom-metrics-autoscaler-operator... [e2e-llm-inference-service] subscription.operators.coreos.com/openshift-custom-metrics-autoscaler-operator created [e2e-llm-inference-service] Subscription openshift-custom-metrics-autoscaler-operator created/ensured. [e2e-llm-inference-service] --- [e2e-llm-inference-service] Waiting for openshift-custom-metrics-autoscaler-operator CSV to become ready... [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-custom-metrics-autoscaler-operator... (0/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-custom-metrics-autoscaler-operator... (5/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-custom-metrics-autoscaler-operator... (10/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-custom-metrics-autoscaler-operator... (15/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-custom-metrics-autoscaler-operator... (20/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-custom-metrics-autoscaler-operator... (25/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-custom-metrics-autoscaler-operator... (30/600) [e2e-llm-inference-service] CSV custom-metrics-autoscaler.v2.19.0-1 found, but not yet Succeeded (Phase: Installing). Waiting... (35/600) [e2e-llm-inference-service] CSV custom-metrics-autoscaler.v2.19.0-1 found, but not yet Succeeded (Phase: Installing). Waiting... (40/600) [e2e-llm-inference-service] CSV custom-metrics-autoscaler.v2.19.0-1 found, but not yet Succeeded (Phase: Installing). Waiting... (45/600) [e2e-llm-inference-service] CSV custom-metrics-autoscaler.v2.19.0-1 found, but not yet Succeeded (Phase: Installing). Waiting... (50/600) [e2e-llm-inference-service] CSV custom-metrics-autoscaler.v2.19.0-1 found, but not yet Succeeded (Phase: Installing). Waiting... (55/600) [e2e-llm-inference-service] CSV custom-metrics-autoscaler.v2.19.0-1 is ready (Phase: Succeeded). [e2e-llm-inference-service] --- [e2e-llm-inference-service] Applying KedaController custom resource... [e2e-llm-inference-service] Warning: resource kedacontrollers/keda is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically. [e2e-llm-inference-service] kedacontroller.keda.sh/keda configured [e2e-llm-inference-service] KedaController custom resource applied. [e2e-llm-inference-service] --- [e2e-llm-inference-service] Allowing time for KEDA components to be provisioned by the operator ... [e2e-llm-inference-service] Waiting for KEDA Operator pod (selector: "app=keda-operator") to be ready in namespace openshift-keda... [e2e-llm-inference-service] Waiting for pod -l "app=keda-operator" in namespace "openshift-keda" to be created... [e2e-llm-inference-service] Pod -l "app=keda-operator" in namespace "openshift-keda" found. [e2e-llm-inference-service] Current pods for -l "app=keda-operator" in namespace "openshift-keda": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] keda-operator-68bff59c-6sppq 1/1 Running 0 41s [e2e-llm-inference-service] Waiting up to 120s for pod(s) -l "app=keda-operator" in namespace "openshift-keda" to become ready... [e2e-llm-inference-service] pod/keda-operator-68bff59c-6sppq condition met [e2e-llm-inference-service] Pod(s) -l "app=keda-operator" in namespace "openshift-keda" are ready. [e2e-llm-inference-service] KEDA Operator pod is ready. [e2e-llm-inference-service] Waiting for KEDA Metrics API Server pod (selector: "app=keda-metrics-apiserver") to be ready in namespace openshift-keda... [e2e-llm-inference-service] Waiting for pod -l "app=keda-metrics-apiserver" in namespace "openshift-keda" to be created... [e2e-llm-inference-service] Pod -l "app=keda-metrics-apiserver" in namespace "openshift-keda" found. [e2e-llm-inference-service] Current pods for -l "app=keda-metrics-apiserver" in namespace "openshift-keda": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] keda-metrics-apiserver-559f75f947-8nj5q 1/1 Running 0 45s [e2e-llm-inference-service] Waiting up to 120s for pod(s) -l "app=keda-metrics-apiserver" in namespace "openshift-keda" to become ready... [e2e-llm-inference-service] pod/keda-metrics-apiserver-559f75f947-8nj5q condition met [e2e-llm-inference-service] Pod(s) -l "app=keda-metrics-apiserver" in namespace "openshift-keda" are ready. [e2e-llm-inference-service] KEDA Metrics API Server pod is ready. [e2e-llm-inference-service] Waiting for KEDA Webhook pod (selector: "app=keda-admission-webhooks") to be ready in namespace openshift-keda... [e2e-llm-inference-service] Waiting for pod -l "app=keda-admission-webhooks" in namespace "openshift-keda" to be created... [e2e-llm-inference-service] Pod -l "app=keda-admission-webhooks" in namespace "openshift-keda" found. [e2e-llm-inference-service] Current pods for -l "app=keda-admission-webhooks" in namespace "openshift-keda": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] keda-admission-5fbd5c4644-22qgs 1/1 Running 0 51s [e2e-llm-inference-service] Waiting up to 120s for pod(s) -l "app=keda-admission-webhooks" in namespace "openshift-keda" to become ready... [e2e-llm-inference-service] pod/keda-admission-5fbd5c4644-22qgs condition met [e2e-llm-inference-service] Pod(s) -l "app=keda-admission-webhooks" in namespace "openshift-keda" are ready. [e2e-llm-inference-service] KEDA Webhook pod is ready. [e2e-llm-inference-service] --- [e2e-llm-inference-service] ✅ KEDA deployment script finished successfully. [e2e-llm-inference-service] KSERVE_CONTROLLER_IMAGE=quay.io/opendatahub/kserve-controller@sha256:69aadb523525e06186640a0b5c2784a130c3fd1d21ca10bf6be99d8ac31ceb31 [e2e-llm-inference-service] LLMISVC_CONTROLLER_IMAGE=quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:5bb0bc80cc63ed263b0380b8cf38a317e489337ef8efdf9a5eb9ba9189da6598 [e2e-llm-inference-service] KSERVE_AGENT_IMAGE=quay.io/opendatahub/kserve-agent@sha256:a8af8a2170a3b8493ae189c8989df58dc741117c4c685b6dd5257bb2fa023732 [e2e-llm-inference-service] KSERVE_ROUTER_IMAGE=quay.io/opendatahub/kserve-router@sha256:e73cf00d90f73d1d01a06b6ae2314be097a351767b51977a258bb8a2a00529db [e2e-llm-inference-service] STORAGE_INITIALIZER_IMAGE=quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85 [e2e-llm-inference-service] Installing KServe via kustomize... [e2e-llm-inference-service] # Warning: 'commonLabels' is deprecated. Please use 'labels' instead. Run 'kustomize edit fix' to update your Kustomization automatically. [e2e-llm-inference-service] # Warning: 'commonLabels' is deprecated. Please use 'labels' instead. Run 'kustomize edit fix' to update your Kustomization automatically. [e2e-llm-inference-service] # Warning: 'commonLabels' is deprecated. Please use 'labels' instead. Run 'kustomize edit fix' to update your Kustomization automatically. [e2e-llm-inference-service] # Warning: 'commonLabels' is deprecated. Please use 'labels' instead. Run 'kustomize edit fix' to update your Kustomization automatically. [e2e-llm-inference-service] # Warning: 'commonLabels' is deprecated. Please use 'labels' instead. Run 'kustomize edit fix' to update your Kustomization automatically. [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/clusterstoragecontainers.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/datascienceclusters.datasciencecluster.opendatahub.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/dscinitializations.dscinitialization.opendatahub.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencegraphs.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencemodelrewrites.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferenceobjectives.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencepoolimports.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencepools.inference.networking.k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencepools.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferenceservices.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/llminferenceserviceconfigs.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/llminferenceservices.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/servingruntimes.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/trainedmodels.serving.kserve.io serverside-applied [e2e-llm-inference-service] Waiting for CRDs to be established... [e2e-llm-inference-service] Waiting for CRD inferenceservices.serving.kserve.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD inferenceservices.serving.kserve.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferenceservices.serving.kserve.io condition met [e2e-llm-inference-service] Waiting for CRD llminferenceserviceconfigs.serving.kserve.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD llminferenceserviceconfigs.serving.kserve.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/llminferenceserviceconfigs.serving.kserve.io condition met [e2e-llm-inference-service] Waiting for CRD clusterstoragecontainers.serving.kserve.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD clusterstoragecontainers.serving.kserve.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/clusterstoragecontainers.serving.kserve.io condition met [e2e-llm-inference-service] Waiting for CRD datascienceclusters.datasciencecluster.opendatahub.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD datascienceclusters.datasciencecluster.opendatahub.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/datascienceclusters.datasciencecluster.opendatahub.io condition met [e2e-llm-inference-service] Applying all resources... [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/clusterstoragecontainers.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/datascienceclusters.datasciencecluster.opendatahub.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/dscinitializations.dscinitialization.opendatahub.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencegraphs.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencemodelrewrites.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferenceobjectives.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencepoolimports.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencepools.inference.networking.k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencepools.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferenceservices.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/llminferenceserviceconfigs.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/llminferenceservices.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/servingruntimes.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/trainedmodels.serving.kserve.io serverside-applied [e2e-llm-inference-service] serviceaccount/kserve-controller-manager serverside-applied [e2e-llm-inference-service] serviceaccount/llmisvc-controller-manager serverside-applied [e2e-llm-inference-service] role.rbac.authorization.k8s.io/kserve-leader-election-role serverside-applied [e2e-llm-inference-service] role.rbac.authorization.k8s.io/kserve-llmisvcconfig-read-access serverside-applied [e2e-llm-inference-service] role.rbac.authorization.k8s.io/llmisvc-leader-election-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-admin serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-edit serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-inferenceservice-distro-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-llmisvc-distro-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-llmisvc-manager-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-manager-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-metrics-reader-cluster-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-proxy-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-view serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/openshift-ai-inferenceservice-image-volume-scc serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/openshift-ai-llminferenceservice-scc serverside-applied [e2e-llm-inference-service] rolebinding.rbac.authorization.k8s.io/kserve-leader-election-rolebinding serverside-applied [e2e-llm-inference-service] rolebinding.rbac.authorization.k8s.io/kserve-llmisvcconfig-read-access serverside-applied [e2e-llm-inference-service] rolebinding.rbac.authorization.k8s.io/llmisvc-leader-election-rolebinding serverside-applied [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/kserve-inferenceservice-distro-rolebinding serverside-applied [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/kserve-llmisvc-distro-rolebinding serverside-applied [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/kserve-manager-rolebinding serverside-applied [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/kserve-proxy-rolebinding serverside-applied [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/llmisvc-manager-rolebinding serverside-applied [e2e-llm-inference-service] configmap/inferenceservice-config serverside-applied [e2e-llm-inference-service] configmap/kserve-parameters serverside-applied [e2e-llm-inference-service] secret/kserve-webhook-server-secret serverside-applied [e2e-llm-inference-service] secret/mlpipeline-s3-artifact serverside-applied [e2e-llm-inference-service] service/kserve-controller-manager-metrics-service serverside-applied [e2e-llm-inference-service] service/kserve-controller-manager-service serverside-applied [e2e-llm-inference-service] service/kserve-webhook-server-service serverside-applied [e2e-llm-inference-service] service/llmisvc-controller-manager-service serverside-applied [e2e-llm-inference-service] service/llmisvc-webhook-server-service serverside-applied [e2e-llm-inference-service] service/s3-service serverside-applied [e2e-llm-inference-service] deployment.apps/kserve-controller-manager serverside-applied [e2e-llm-inference-service] deployment.apps/llmisvc-controller-manager serverside-applied [e2e-llm-inference-service] deployment.apps/seaweedfs serverside-applied [e2e-llm-inference-service] networkpolicy.networking.k8s.io/kserve-controller-manager serverside-applied [e2e-llm-inference-service] securitycontextconstraints.security.openshift.io/openshift-ai-inferenceservice-image-volume-scc serverside-applied [e2e-llm-inference-service] securitycontextconstraints.security.openshift.io/openshift-ai-llminferenceservice-scc serverside-applied [e2e-llm-inference-service] clusterstoragecontainer.serving.kserve.io/default serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-decode-template serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-decode-worker-data-parallel serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-multi-node-pd-template-nvidia-cuda serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-multi-node-pd-template-nvidia-cuda-fast-1 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-multi-node-pd-template-nvidia-cuda-fast-2 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-multi-node-template-nvidia-cuda serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-multi-node-template-nvidia-cuda-fast-1 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-multi-node-template-nvidia-cuda-fast-2 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-prefill-template serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-prefill-worker-data-parallel serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-router-route serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-scheduler serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-single-node-pd-template-nvidia-cuda serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-single-node-pd-template-nvidia-cuda-fast-1 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-single-node-pd-template-nvidia-cuda-fast-2 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-single-node-template-nvidia-cuda serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-single-node-template-nvidia-cuda-fast-1 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-single-node-template-nvidia-cuda-fast-2 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-amd-rocm serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-amd-rocm-fast-1 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-amd-rocm-fast-2 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-ppc64le serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-ppc64le-fast-1 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-ppc64le-fast-2 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-s390x serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-s390x-fast-1 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-s390x-fast-2 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-x86 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-x86-fast-1 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-x86-fast-2 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-intel-gaudi serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-intel-gaudi-fast-1 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-intel-gaudi-fast-2 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-tracing serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-worker-data-parallel serverside-applied [e2e-llm-inference-service] mutatingwebhookconfiguration.admissionregistration.k8s.io/inferenceservice.serving.kserve.io serverside-applied [e2e-llm-inference-service] mutatingwebhookconfiguration.admissionregistration.k8s.io/llminferenceservice.serving.kserve.io serverside-applied [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/inferencegraph.serving.kserve.io serverside-applied [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/inferenceservice.serving.kserve.io serverside-applied [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/llminferenceservice.serving.kserve.io serverside-applied [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/llminferenceserviceconfig.serving.kserve.io serverside-applied [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/servingruntime.serving.kserve.io serverside-applied [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/trainedmodel.serving.kserve.io serverside-applied [e2e-llm-inference-service] Waiting for llmisvc-controller-manager to be ready... [e2e-llm-inference-service] Waiting for pod -l "control-plane=llmisvc-controller-manager" in namespace "kserve" to be created... [e2e-llm-inference-service] Pod -l "control-plane=llmisvc-controller-manager" in namespace "kserve" found. [e2e-llm-inference-service] Current pods for -l "control-plane=llmisvc-controller-manager" in namespace "kserve": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] llmisvc-controller-manager-fbfcc4968-m62ct 0/1 ContainerCreating 0 7s [e2e-llm-inference-service] Waiting up to 600s for pod(s) -l "control-plane=llmisvc-controller-manager" in namespace "kserve" to become ready... [e2e-llm-inference-service] pod/llmisvc-controller-manager-fbfcc4968-m62ct condition met [e2e-llm-inference-service] Pod(s) -l "control-plane=llmisvc-controller-manager" in namespace "kserve" are ready. [e2e-llm-inference-service] Re-applying LLMInferenceServiceConfig resources with webhook validation... [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-decode-template is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-decode-template serverside-applied [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-decode-worker-data-parallel is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-decode-worker-data-parallel serverside-applied [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-prefill-template is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-prefill-template serverside-applied [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-prefill-worker-data-parallel is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-prefill-worker-data-parallel serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-router-route serverside-applied [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-scheduler is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-scheduler serverside-applied [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-template is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-tracing serverside-applied [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-worker-data-parallel is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-worker-data-parallel serverside-applied [e2e-llm-inference-service] Applying DSC/DSCI resources... [e2e-llm-inference-service] dscinitialization.dscinitialization.opendatahub.io/test-dsci created [e2e-llm-inference-service] datasciencecluster.datasciencecluster.opendatahub.io/test-dsc created [e2e-llm-inference-service] KServe manual installation complete [e2e-llm-inference-service] 🔧 Configuration: [e2e-llm-inference-service] KServe deployment: ❌ disabled [e2e-llm-inference-service] Kuadrant deployment: ✅ enabled [e2e-llm-inference-service] [e2e-llm-inference-service] Checking OpenShift server version...(4.21.24) [e2e-llm-inference-service] 🎯 Server version (4.21.24) is 4.19.9 or higher - continue with the script [e2e-llm-inference-service] ⏳ Installing cert-manager [e2e-llm-inference-service] namespace/cert-manager-operator created [e2e-llm-inference-service] operatorgroup.operators.coreos.com/openshift-cert-manager-operator created [e2e-llm-inference-service] subscription.operators.coreos.com/openshift-cert-manager-operator created [e2e-llm-inference-service] Waiting for openshift-cert-manager-operator CSV to become ready... [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-cert-manager-operator... (0/300) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-cert-manager-operator... (5/300) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-cert-manager-operator... (10/300) [e2e-llm-inference-service] CSV cert-manager-operator.v1.20.0 found, but not yet Succeeded (Phase: Installing). Waiting... (15/300) [e2e-llm-inference-service] CSV cert-manager-operator.v1.20.0 is ready (Phase: Succeeded). [e2e-llm-inference-service] Waiting for CRD certificates.cert-manager.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD certificates.cert-manager.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/certificates.cert-manager.io condition met [e2e-llm-inference-service] ✅ Cert-manager installed [e2e-llm-inference-service] ⏳ Installing openshift-lws-operator [e2e-llm-inference-service] namespace/openshift-lws-operator created [e2e-llm-inference-service] operatorgroup.operators.coreos.com/leader-worker-set created [e2e-llm-inference-service] subscription.operators.coreos.com/leader-worker-set created [e2e-llm-inference-service] Waiting for leader-worker-set CSV to become ready... [e2e-llm-inference-service] Waiting for CSV to be installed for subscription leader-worker-set... (0/300) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription leader-worker-set... (5/300) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription leader-worker-set... (10/300) [e2e-llm-inference-service] CSV leader-worker-set.v1.0.0 found, but not yet Succeeded (Phase: Installing). Waiting... (15/300) [e2e-llm-inference-service] CSV leader-worker-set.v1.0.0 is ready (Phase: Succeeded). [e2e-llm-inference-service] Waiting for CRD leaderworkersetoperators.operator.openshift.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD leaderworkersetoperators.operator.openshift.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/leaderworkersetoperators.operator.openshift.io condition met [e2e-llm-inference-service] leaderworkersetoperator.operator.openshift.io/cluster created [e2e-llm-inference-service] ⏳ waiting for openshift-lws-operator to be ready.… [e2e-llm-inference-service] Waiting for pod -l "name=openshift-lws-operator" in namespace "openshift-lws-operator" to be created... [e2e-llm-inference-service] Pod -l "name=openshift-lws-operator" in namespace "openshift-lws-operator" found. [e2e-llm-inference-service] Current pods for -l "name=openshift-lws-operator" in namespace "openshift-lws-operator": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] openshift-lws-operator-fd8ccff4c-rdqn6 1/1 Running 0 14s [e2e-llm-inference-service] Waiting up to 600s for pod(s) -l "name=openshift-lws-operator" in namespace "openshift-lws-operator" to become ready... [e2e-llm-inference-service] pod/openshift-lws-operator-fd8ccff4c-rdqn6 condition met [e2e-llm-inference-service] Pod(s) -l "name=openshift-lws-operator" in namespace "openshift-lws-operator" are ready. [e2e-llm-inference-service] ✅ openshift-lws-operator installed [e2e-llm-inference-service] gatewayclass.gateway.networking.k8s.io/openshift-default created [e2e-llm-inference-service] Waiting for pod -l "app=istiod" in namespace "openshift-ingress" to be created... [e2e-llm-inference-service] Pod -l "app=istiod" in namespace "openshift-ingress" found. [e2e-llm-inference-service] Current pods for -l "app=istiod" in namespace "openshift-ingress": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] istiod-openshift-gateway-94bb8fbfd-4wpb9 0/1 ContainerCreating 0 5s [e2e-llm-inference-service] Waiting up to 600s for pod(s) -l "app=istiod" in namespace "openshift-ingress" to become ready... [e2e-llm-inference-service] pod/istiod-openshift-gateway-94bb8fbfd-4wpb9 condition met [e2e-llm-inference-service] Pod(s) -l "app=istiod" in namespace "openshift-ingress" are ready. [e2e-llm-inference-service] ⏳ Creating a Gateway [e2e-llm-inference-service] Error from server (AlreadyExists): namespaces "openshift-ingress" already exists [e2e-llm-inference-service] ⏳ Creating gateway memory ConfigMap for parametersRef (2Gi) [e2e-llm-inference-service] configmap/gateway-proxy-config created [e2e-llm-inference-service] gateway.gateway.networking.k8s.io/openshift-ai-inference created [e2e-llm-inference-service] Waiting for pod -l "serving.kserve.io/gateway=kserve-ingress-gateway" in namespace "openshift-ingress" to be created... [e2e-llm-inference-service] Pod -l "serving.kserve.io/gateway=kserve-ingress-gateway" in namespace "openshift-ingress" found. [e2e-llm-inference-service] Current pods for -l "serving.kserve.io/gateway=kserve-ingress-gateway" in namespace "openshift-ingress": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] openshift-ai-inference-openshift-default-655f7c58b4-wqvjb 0/1 ContainerCreating 0 5s [e2e-llm-inference-service] Waiting up to 600s for pod(s) -l "serving.kserve.io/gateway=kserve-ingress-gateway" in namespace "openshift-ingress" to become ready... [e2e-llm-inference-service] pod/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb condition met [e2e-llm-inference-service] Pod(s) -l "serving.kserve.io/gateway=kserve-ingress-gateway" in namespace "openshift-ingress" are ready. [e2e-llm-inference-service] ⏳ Installing RHCL(Kuadrant) operator [e2e-llm-inference-service] namespace/kuadrant-system created [e2e-llm-inference-service] subscription.operators.coreos.com/rhcl-operator created [e2e-llm-inference-service] operatorgroup.operators.coreos.com/kuadrant created [e2e-llm-inference-service] Waiting for rhcl-operator CSV to become ready... [e2e-llm-inference-service] Waiting for CSV to be installed for subscription rhcl-operator... (0/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription rhcl-operator... (5/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription rhcl-operator... (10/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription rhcl-operator... (15/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription rhcl-operator... (20/600) [e2e-llm-inference-service] CSV rhcl-operator.v1.4.1 found, but not yet Succeeded (Phase: Installing). Waiting... (25/600) [e2e-llm-inference-service] CSV rhcl-operator.v1.4.1 found, but not yet Succeeded (Phase: Installing). Waiting... (30/600) [e2e-llm-inference-service] CSV rhcl-operator.v1.4.1 found, but not yet Succeeded (Phase: Installing). Waiting... (35/600) [e2e-llm-inference-service] CSV rhcl-operator.v1.4.1 is ready (Phase: Succeeded). [e2e-llm-inference-service] Waiting for CRD kuadrants.kuadrant.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD kuadrants.kuadrant.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/kuadrants.kuadrant.io condition met [e2e-llm-inference-service] Waiting for apiserver discovery /apis/kuadrant.io/v1beta1 to list kuadrants (timeout: 120s)… [e2e-llm-inference-service] Discovery for kuadrant.io/v1beta1 includes kuadrants. [e2e-llm-inference-service] ⏳ sleeping 30s after discovery (RESTMapper can trail discovery)… [e2e-llm-inference-service] kuadrant.kuadrant.io/kuadrant created [e2e-llm-inference-service] ⏳ waiting for Kuadrant Ready (attempt 1/2, timeout 5m)… [e2e-llm-inference-service] kuadrant.kuadrant.io/kuadrant condition met [e2e-llm-inference-service] Waiting for pod -l "control-plane=authorino-operator" in namespace "kuadrant-system" to be created... [e2e-llm-inference-service] Pod -l "control-plane=authorino-operator" in namespace "kuadrant-system" found. [e2e-llm-inference-service] Current pods for -l "control-plane=authorino-operator" in namespace "kuadrant-system": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] authorino-operator-6d85f6564-trkjt 1/1 Running 0 75s [e2e-llm-inference-service] Waiting up to 600s for pod(s) -l "control-plane=authorino-operator" in namespace "kuadrant-system" to become ready... [e2e-llm-inference-service] pod/authorino-operator-6d85f6564-trkjt condition met [e2e-llm-inference-service] Pod(s) -l "control-plane=authorino-operator" in namespace "kuadrant-system" are ready. [e2e-llm-inference-service] ⏳ waiting for authorino service to be created... [e2e-llm-inference-service] service/authorino-authorino-authorization condition met [e2e-llm-inference-service] service/authorino-authorino-authorization annotated [e2e-llm-inference-service] Warning: resource authorinos/authorino is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically. [e2e-llm-inference-service] authorino.operator.authorino.kuadrant.io/authorino configured [e2e-llm-inference-service] Waiting for pod -l "control-plane=authorino-operator" in namespace "kuadrant-system" to be created... [e2e-llm-inference-service] Pod -l "control-plane=authorino-operator" in namespace "kuadrant-system" found. [e2e-llm-inference-service] Current pods for -l "control-plane=authorino-operator" in namespace "kuadrant-system": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] authorino-operator-6d85f6564-trkjt 1/1 Running 0 85s [e2e-llm-inference-service] Waiting up to 600s for pod(s) -l "control-plane=authorino-operator" in namespace "kuadrant-system" to become ready... [e2e-llm-inference-service] pod/authorino-operator-6d85f6564-trkjt condition met [e2e-llm-inference-service] Pod(s) -l "control-plane=authorino-operator" in namespace "kuadrant-system" are ready. [e2e-llm-inference-service] ✅ kuadrant(authorino) installed [e2e-llm-inference-service] Patching ingress domain... [e2e-llm-inference-service] configmap/inferenceservice-config patched [e2e-llm-inference-service] pod "kserve-controller-manager-748bdf6488-9nthj" deleted [e2e-llm-inference-service] Waiting for kserve-controller-manager to be ready... [e2e-llm-inference-service] pod/kserve-controller-manager-748bdf6488-jqrkk condition met [e2e-llm-inference-service] Installing ODH Model Controller manually... [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/accounts.nim.opendatahub.io created [e2e-llm-inference-service] serviceaccount/model-serving-api created [e2e-llm-inference-service] serviceaccount/odh-model-controller created [e2e-llm-inference-service] role.rbac.authorization.k8s.io/leader-election-role created [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/account-editor-role created [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/account-viewer-role created [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-prometheus-k8s created [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/metrics-reader created [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/model-serving-api created [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/odh-model-controller-role created [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/proxy-role created [e2e-llm-inference-service] rolebinding.rbac.authorization.k8s.io/leader-election-rolebinding created [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/model-serving-api created [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/odh-model-controller-rolebinding-opendatahub created [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/proxy-rolebinding created [e2e-llm-inference-service] configmap/odh-model-controller-parameters created [e2e-llm-inference-service] service/model-serving-api created [e2e-llm-inference-service] service/odh-model-controller-metrics-service created [e2e-llm-inference-service] service/odh-model-controller-webhook-service created [e2e-llm-inference-service] deployment.apps/model-serving-api created [e2e-llm-inference-service] deployment.apps/odh-model-controller created [e2e-llm-inference-service] servicemonitor.monitoring.coreos.com/model-serving-api-metrics created [e2e-llm-inference-service] servicemonitor.monitoring.coreos.com/odh-model-controller-metrics-monitor created [e2e-llm-inference-service] template.template.openshift.io/autogluon-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/guardrails-detector-huggingface-serving-template created [e2e-llm-inference-service] template.template.openshift.io/kserve-ovms created [e2e-llm-inference-service] template.template.openshift.io/mlserver-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-cpu-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-cpu-runtime-template-fast-1 created [e2e-llm-inference-service] template.template.openshift.io/vllm-cpu-runtime-template-fast-2 created [e2e-llm-inference-service] template.template.openshift.io/vllm-cpu-x86-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-cpu-x86-runtime-template-fast-1 created [e2e-llm-inference-service] template.template.openshift.io/vllm-cpu-x86-runtime-template-fast-2 created [e2e-llm-inference-service] template.template.openshift.io/vllm-cuda-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-cuda-runtime-template-fast-1 created [e2e-llm-inference-service] template.template.openshift.io/vllm-cuda-runtime-template-fast-2 created [e2e-llm-inference-service] template.template.openshift.io/vllm-gaudi-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-gaudi-runtime-template-fast-1 created [e2e-llm-inference-service] template.template.openshift.io/vllm-gaudi-runtime-template-fast-2 created [e2e-llm-inference-service] template.template.openshift.io/vllm-multinode-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-multinode-runtime-template-fast-1 created [e2e-llm-inference-service] template.template.openshift.io/vllm-multinode-runtime-template-fast-2 created [e2e-llm-inference-service] template.template.openshift.io/vllm-rocm-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-rocm-runtime-template-fast-1 created [e2e-llm-inference-service] template.template.openshift.io/vllm-rocm-runtime-template-fast-2 created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-ppc64le-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-ppc64le-runtime-template-fast-1 created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-ppc64le-runtime-template-fast-2 created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-s390x-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-s390x-runtime-template-fast-1 created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-s390x-runtime-template-fast-2 created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-x86-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-x86-runtime-template-fast-1 created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-x86-runtime-template-fast-2 created [e2e-llm-inference-service] mutatingwebhookconfiguration.admissionregistration.k8s.io/mutating.odh-model-controller.opendatahub.io created [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/validating.odh-model-controller.opendatahub.io created [e2e-llm-inference-service] Waiting for deployment "odh-model-controller" rollout to finish: 0 of 1 updated replicas are available... [e2e-llm-inference-service] deployment "odh-model-controller" successfully rolled out [e2e-llm-inference-service] networkpolicy.networking.k8s.io/allow-all created [e2e-llm-inference-service] KServe setup complete (namespace: kserve) [e2e-llm-inference-service] Add testing models to SeaweedFS S3 storage ... [e2e-llm-inference-service] Waiting for SeaweedFS deployment to be ready... [e2e-llm-inference-service] deployment "seaweedfs" successfully rolled out [e2e-llm-inference-service] S3 init job not completed, re-creating... [e2e-llm-inference-service] job.batch/s3-init replaced [e2e-llm-inference-service] Waiting for S3 init job to complete... [e2e-llm-inference-service] job.batch/s3-init condition met [e2e-llm-inference-service] Prepare CI namespace and install ServingRuntimes [e2e-llm-inference-service] Setting up CI namespace: kserve-ci-e2e-test [e2e-llm-inference-service] Tearing down CI namespace: kserve-ci-e2e-test [e2e-llm-inference-service] Namespace kserve-ci-e2e-test does not exist, skipping deletion [e2e-llm-inference-service] CI namespace teardown complete [e2e-llm-inference-service] Creating namespace kserve-ci-e2e-test [e2e-llm-inference-service] namespace/kserve-ci-e2e-test created [e2e-llm-inference-service] Applying S3 artifact secret [e2e-llm-inference-service] secret/mlpipeline-s3-artifact created [e2e-llm-inference-service] Applying storage-config secret [e2e-llm-inference-service] secret/storage-config created [e2e-llm-inference-service] Applying SeaweedFS S3 credentials secret [e2e-llm-inference-service] secret/seaweedfs-s3-creds created [e2e-llm-inference-service] Linking seaweedfs-s3-creds to default service account [e2e-llm-inference-service] Creating odh-trusted-ca-bundle configmap [e2e-llm-inference-service] configmap/odh-trusted-ca-bundle created [e2e-llm-inference-service] Installing ServingRuntimes [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-autogluonserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-huggingfaceserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-huggingfaceserver-multinode created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-lgbserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-mlserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-paddleserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-pmmlserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-predictiveserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-sklearnserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-tensorflow-serving created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-torchserve created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-tritonserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-vllmserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-xgbserver created [e2e-llm-inference-service] CI namespace setup complete [e2e-llm-inference-service] Setup complete [e2e-llm-inference-service] === E2E cluster / operator summary === [e2e-llm-inference-service] Client Version: 4.20.11 [e2e-llm-inference-service] Kustomize Version: v5.6.0 [e2e-llm-inference-service] Server Version: 4.21.24 [e2e-llm-inference-service] Kubernetes Version: v1.34.9 [e2e-llm-inference-service] ClusterVersion desired: 4.21.24 [e2e-llm-inference-service] ClusterVersion history (latest): 4.21.24 (Completed) [e2e-llm-inference-service] CSVs in kuadrant-system: [e2e-llm-inference-service] authorino-operator.v1.4.1 Succeeded [e2e-llm-inference-service] cert-manager-operator.v1.20.0 Succeeded [e2e-llm-inference-service] dns-operator.v1.4.0 Succeeded [e2e-llm-inference-service] limitador-operator.v1.4.0 Succeeded [e2e-llm-inference-service] rhcl-operator.v1.4.1 Succeeded [e2e-llm-inference-service] CSVs in openshift-keda: [e2e-llm-inference-service] authorino-operator.v1.4.1 Succeeded [e2e-llm-inference-service] cert-manager-operator.v1.20.0 Succeeded [e2e-llm-inference-service] custom-metrics-autoscaler.v2.19.0-1 Succeeded [e2e-llm-inference-service] dns-operator.v1.4.0 Succeeded [e2e-llm-inference-service] limitador-operator.v1.4.0 Succeeded [e2e-llm-inference-service] rhcl-operator.v1.4.1 Succeeded [e2e-llm-inference-service] CSVs in cert-manager-operator: [e2e-llm-inference-service] authorino-operator.v1.4.1 Succeeded [e2e-llm-inference-service] cert-manager-operator.v1.20.0 Succeeded [e2e-llm-inference-service] dns-operator.v1.4.0 Succeeded [e2e-llm-inference-service] limitador-operator.v1.4.0 Succeeded [e2e-llm-inference-service] rhcl-operator.v1.4.1 Succeeded [e2e-llm-inference-service] CSVs in openshift-lws-operator: [e2e-llm-inference-service] authorino-operator.v1.4.1 Succeeded [e2e-llm-inference-service] cert-manager-operator.v1.20.0 Succeeded [e2e-llm-inference-service] dns-operator.v1.4.0 Succeeded [e2e-llm-inference-service] leader-worker-set.v1.0.0 Succeeded [e2e-llm-inference-service] limitador-operator.v1.4.0 Succeeded [e2e-llm-inference-service] rhcl-operator.v1.4.1 Succeeded [e2e-llm-inference-service] CSVs in openshift-operators (ODH / shared operators, filtered): [e2e-llm-inference-service] authorino-operator.v1.4.1 Succeeded [e2e-llm-inference-service] dns-operator.v1.4.0 Succeeded [e2e-llm-inference-service] limitador-operator.v1.4.0 Succeeded [e2e-llm-inference-service] rhcl-operator.v1.4.1 Succeeded [e2e-llm-inference-service] Kuadrant / Authorino (diagnostics): [e2e-llm-inference-service] CRD kuadrants.kuadrant.io versions: v1beta1 served=true storage=true [e2e-llm-inference-service] Subscriptions in kuadrant-system: [e2e-llm-inference-service] authorino-operator-stable-redhat-operators-openshift-marketplace stable redhat-operators authorino-operator.v1.4.1 [e2e-llm-inference-service] dns-operator-stable-redhat-operators-openshift-marketplace stable redhat-operators dns-operator.v1.4.0 [e2e-llm-inference-service] limitador-operator-stable-redhat-operators-openshift-marketplace stable redhat-operators limitador-operator.v1.4.0 [e2e-llm-inference-service] rhcl-operator stable redhat-operators rhcl-operator.v1.4.1 [e2e-llm-inference-service] Kuadrant CR conditions (kuadrant/kuadrant-system): [e2e-llm-inference-service] Ready=True (Ready) [e2e-llm-inference-service] KServe deployments in kserve: [e2e-llm-inference-service] kserve-controller-manager: ready=1 image=quay.io/opendatahub/kserve-controller@sha256:69aadb523525e06186640a0b5c2784a130c3fd1d21ca10bf6be99d8ac31ceb31 [e2e-llm-inference-service] imageID: quay.io/opendatahub/kserve-controller@sha256:072964076bcf00b8165d048542cb0338df04edddf0a5452de1db292faae37f71 [e2e-llm-inference-service] odh-model-controller: ready=1 image=quay.io/opendatahub/odh-model-controller:fast [e2e-llm-inference-service] imageID: quay.io/opendatahub/odh-model-controller@sha256:5ce69c3ae5bc6b3b4888343ec0c55c7e1c8a05304b25bfbd157358fc4c26ee52 [e2e-llm-inference-service] llmisvc-controller-manager: ready=1 image=quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:5bb0bc80cc63ed263b0380b8cf38a317e489337ef8efdf9a5eb9ba9189da6598 [e2e-llm-inference-service] imageID: quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:392daa80a047fdbd83dbbc24b63587a56e565d216524b6291a4bb93baa8187da [e2e-llm-inference-service] === End E2E cluster / operator summary === [e2e-llm-inference-service] /workspace/source [e2e-llm-inference-service] CA certificate extracted [e2e-llm-inference-service] REQUESTS_CA_BUNDLE=/tmp/ca.crt [e2e-llm-inference-service] Run E2E tests: llminferenceservice and cluster_cpu and not autoscaling and not tracing [e2e-llm-inference-service] Starting E2E functional tests ... [e2e-llm-inference-service] Parallelism requested for pytest is 2 [e2e-llm-inference-service] ============================= test session starts ============================== [e2e-llm-inference-service] platform linux -- Python 3.11.13, pytest-7.4.4, pluggy-1.5.0 -- /workspace/source/python/kserve/.venv/bin/python [e2e-llm-inference-service] cachedir: .pytest_cache [e2e-llm-inference-service] metadata: {'Python': '3.11.13', 'Platform': 'Linux-5.14.0-570.122.1.el9_6.x86_64-x86_64-with-glibc2.34', 'Packages': {'pytest': '7.4.4', 'pluggy': '1.5.0'}, 'Plugins': {'json-report': '1.5.0', 'anyio': '4.9.0', 'metadata': '3.1.1', 'httpx': '0.30.0', 'xdist': '3.6.1', 'cov': '5.0.0', 'asyncio': '0.23.8'}, 'PLATFORM': 'el9'} [e2e-llm-inference-service] rootdir: /workspace/source/test/e2e [e2e-llm-inference-service] configfile: pytest.ini [e2e-llm-inference-service] plugins: json-report-1.5.0, anyio-4.9.0, metadata-3.1.1, httpx-0.30.0, xdist-3.6.1, cov-5.0.0, asyncio-0.23.8 [e2e-llm-inference-service] asyncio: mode=Mode.STRICT [e2e-llm-inference-service] created: 2/2 workers [e2e-llm-inference-service] 2 workers [42 items] [e2e-llm-inference-service] [e2e-llm-inference-service] scheduling tests via WorkStealingScheduling [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_gateway_section_name.py::test_gateway_section_name_propagation[cluster_single_node-cluster_cpu-with-section-name] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-precise-prefix-cache-inline-config-workload-llmd-simulator-kvcache] 2026-07-09 18:16:49.859 6320 kserve INFO [conftest.py:configure_logger():40] Logger configured [e2e-llm-inference-service] 2026-07-09 18:16:49.859 6317 kserve INFO [conftest.py:configure_logger():40] Logger configured [e2e-llm-inference-service] 2026-07-09 18:16:49.918 6317 kserve.trace Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-09 18:16:49.918 6317 kserve.trace INFO [gw_api.py:create_or_update_gateway():34] Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-09 18:16:49.940 6317 kserve.trace Resource not found, creating Gateway router-gateway-1 [e2e-llm-inference-service] 2026-07-09 18:16:49.940 6317 kserve.trace INFO [gw_api.py:create_or_update_gateway():62] Resource not found, creating Gateway router-gateway-1 [e2e-llm-inference-service] 2026-07-09 18:16:49.948 6317 kserve.trace ✓ Successfully created Gateway router-gateway-1 [e2e-llm-inference-service] 2026-07-09 18:16:49.948 6317 kserve.trace INFO [gw_api.py:create_or_update_gateway():70] ✓ Successfully created Gateway router-gateway-1 [e2e-llm-inference-service] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_gateway_section_name.py::test_gateway_section_name_propagation[cluster_single_node-cluster_cpu-with-section-name] [e2e-llm-inference-service] llmisvc/test_gateway_section_name.py::test_gateway_section_name_propagation[cluster_single_node-cluster_cpu-without-section-name] 2026-07-09 18:17:02.910 6317 kserve.trace Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-09 18:17:02.910 6317 kserve.trace INFO [gw_api.py:create_or_update_gateway():34] Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-09 18:17:02.949 6317 kserve.trace ✓ Successfully updated Gateway router-gateway-1 [e2e-llm-inference-service] 2026-07-09 18:17:02.949 6317 kserve.trace INFO [gw_api.py:create_or_update_gateway():57] ✓ Successfully updated Gateway router-gateway-1 [e2e-llm-inference-service] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_gateway_section_name.py::test_gateway_section_name_propagation[cluster_single_node-cluster_cpu-without-section-name] [e2e-llm-inference-service] llmisvc/test_llm_auth.py::test_llm_auth_enabled_requires_token[cluster_cpu-cluster_single_node-auth-enabled-default] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-precise-prefix-cache-inline-config-workload-llmd-simulator-kvcache] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator0] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator0] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator1] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_auth.py::test_llm_auth_enabled_requires_token[cluster_cpu-cluster_single_node-auth-enabled-default] [e2e-llm-inference-service] llmisvc/test_llm_auth.py::test_llm_auth_invalid_token_rejected[cluster_cpu-cluster_single_node-auth-invalid-token] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator1] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator2] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_auth.py::test_llm_auth_invalid_token_rejected[cluster_cpu-cluster_single_node-auth-invalid-token] [e2e-llm-inference-service] llmisvc/test_llm_auth.py::test_llm_auth_disabled_no_token_required[cluster_cpu-cluster_single_node-auth-disabled] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator2] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m-with-lora-hf0] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_auth.py::test_llm_auth_disabled_no_token_required[cluster_cpu-cluster_single_node-auth-disabled] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-gateway-ref-router-with-managed-route-model-fb-opt-125m-workload-llmd-simulator] 2026-07-09 18:26:43.768 6317 kserve.trace Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-09 18:26:43.768 6317 kserve.trace INFO [gw_api.py:create_or_update_gateway():34] Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-09 18:26:43.813 6317 kserve.trace ✓ Successfully updated Gateway router-gateway-1 [e2e-llm-inference-service] 2026-07-09 18:26:43.813 6317 kserve.trace INFO [gw_api.py:create_or_update_gateway():57] ✓ Successfully updated Gateway router-gateway-1 [e2e-llm-inference-service] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m-with-lora-hf0] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m-with-lora-hf1] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-gateway-ref-router-with-managed-route-model-fb-opt-125m-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m-with-lora-hf1] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-pvc] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-custom-route-timeout-scheduler-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-pvc] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-pd-cpu-model-pvc] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-custom-route-timeout-scheduler-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-refs-scheduler-managed-workload-single-cpu-model-fb-opt-125m] 2026-07-09 18:34:01.549 6317 kserve.trace Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-09 18:34:01.549 6317 kserve.trace INFO [gw_api.py:create_or_update_gateway():34] Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-09 18:34:01.594 6317 kserve.trace ✓ Successfully updated Gateway router-gateway-1 [e2e-llm-inference-service] 2026-07-09 18:34:01.594 6317 kserve.trace INFO [gw_api.py:create_or_update_gateway():57] ✓ Successfully updated Gateway router-gateway-1 [e2e-llm-inference-service] 2026-07-09 18:34:01.594 6317 kserve.trace Checking HttpRoute router-route-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-09 18:34:01.594 6317 kserve.trace INFO [gw_api.py:create_or_update_route():121] Checking HttpRoute router-route-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-09 18:34:01.598 6317 kserve.trace Resource not found, creating HttpRoute router-route-1 [e2e-llm-inference-service] 2026-07-09 18:34:01.598 6317 kserve.trace INFO [gw_api.py:create_or_update_route():149] Resource not found, creating HttpRoute router-route-1 [e2e-llm-inference-service] 2026-07-09 18:34:01.610 6317 kserve.trace ✓ Successfully created HttpRoute router-route-1 [e2e-llm-inference-service] 2026-07-09 18:34:01.610 6317 kserve.trace INFO [gw_api.py:create_or_update_route():157] ✓ Successfully created HttpRoute router-route-1 [e2e-llm-inference-service] 2026-07-09 18:34:01.611 6317 kserve.trace Checking HttpRoute router-route-2 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-09 18:34:01.611 6317 kserve.trace INFO [gw_api.py:create_or_update_route():121] Checking HttpRoute router-route-2 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-09 18:34:01.614 6317 kserve.trace Resource not found, creating HttpRoute router-route-2 [e2e-llm-inference-service] 2026-07-09 18:34:01.614 6317 kserve.trace INFO [gw_api.py:create_or_update_route():149] Resource not found, creating HttpRoute router-route-2 [e2e-llm-inference-service] 2026-07-09 18:34:01.623 6317 kserve.trace ✓ Successfully created HttpRoute router-route-2 [e2e-llm-inference-service] 2026-07-09 18:34:01.623 6317 kserve.trace INFO [gw_api.py:create_or_update_route():157] ✓ Successfully created HttpRoute router-route-2 [e2e-llm-inference-service] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-pd-cpu-model-pvc] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_multi_node-router-managed-workload-simulated-dp-ep-cpu-model-pvc] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-refs-scheduler-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-custom-route-timeout-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_multi_node-router-managed-workload-simulated-dp-ep-cpu-model-pvc] [e2e-llm-inference-service] llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_v1alpha1_to_v1alpha2_conversion [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_v1alpha1_to_v1alpha2_conversion [e2e-llm-inference-service] llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_v1alpha2_to_v1alpha1_conversion [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_v1alpha2_to_v1alpha1_conversion [e2e-llm-inference-service] llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_criticality_preservation_via_annotations [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_criticality_preservation_via_annotations [e2e-llm-inference-service] llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_lora_criticality_preservation [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_lora_criticality_preservation [e2e-llm-inference-service] llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_round_trip_conversion_preserves_fields [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_round_trip_conversion_preserves_fields [e2e-llm-inference-service] llmisvc/test_llm_inference_service_stop.py::test_llm_stop_feature[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-custom-route-timeout-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-refs-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] 2026-07-09 18:44:36.969 6317 kserve.trace Checking Gateway router-gateway-2 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-09 18:44:36.969 6317 kserve.trace INFO [gw_api.py:create_or_update_gateway():34] Checking Gateway router-gateway-2 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-09 18:44:37.010 6317 kserve.trace Resource not found, creating Gateway router-gateway-2 [e2e-llm-inference-service] 2026-07-09 18:44:37.010 6317 kserve.trace INFO [gw_api.py:create_or_update_gateway():62] Resource not found, creating Gateway router-gateway-2 [e2e-llm-inference-service] 2026-07-09 18:44:37.016 6317 kserve.trace ✓ Successfully created Gateway router-gateway-2 [e2e-llm-inference-service] 2026-07-09 18:44:37.016 6317 kserve.trace INFO [gw_api.py:create_or_update_gateway():70] ✓ Successfully created Gateway router-gateway-2 [e2e-llm-inference-service] 2026-07-09 18:44:37.017 6317 kserve.trace Checking HttpRoute router-route-3 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-09 18:44:37.017 6317 kserve.trace INFO [gw_api.py:create_or_update_route():121] Checking HttpRoute router-route-3 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-09 18:44:37.020 6317 kserve.trace Resource not found, creating HttpRoute router-route-3 [e2e-llm-inference-service] 2026-07-09 18:44:37.020 6317 kserve.trace INFO [gw_api.py:create_or_update_route():149] Resource not found, creating HttpRoute router-route-3 [e2e-llm-inference-service] 2026-07-09 18:44:37.031 6317 kserve.trace ✓ Successfully created HttpRoute router-route-3 [e2e-llm-inference-service] 2026-07-09 18:44:37.031 6317 kserve.trace INFO [gw_api.py:create_or_update_route():157] ✓ Successfully created HttpRoute router-route-3 [e2e-llm-inference-service] 2026-07-09 18:44:37.032 6317 kserve.trace Checking HttpRoute router-route-4 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-09 18:44:37.032 6317 kserve.trace INFO [gw_api.py:create_or_update_route():121] Checking HttpRoute router-route-4 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-09 18:44:37.035 6317 kserve.trace Resource not found, creating HttpRoute router-route-4 [e2e-llm-inference-service] 2026-07-09 18:44:37.035 6317 kserve.trace INFO [gw_api.py:create_or_update_route():149] Resource not found, creating HttpRoute router-route-4 [e2e-llm-inference-service] 2026-07-09 18:44:37.045 6317 kserve.trace ✓ Successfully created HttpRoute router-route-4 [e2e-llm-inference-service] 2026-07-09 18:44:37.045 6317 kserve.trace INFO [gw_api.py:create_or_update_route():157] ✓ Successfully created HttpRoute router-route-4 [e2e-llm-inference-service] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service_stop.py::test_llm_stop_feature[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_lora_adapters.py::test_llm_with_lora_adapters[cluster_cpu-single-lora-adapter-hf] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-refs-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-no-scheduler-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_lora_adapters.py::test_llm_with_lora_adapters[cluster_cpu-single-lora-adapter-hf] [e2e-llm-inference-service] llmisvc/test_llm_lora_adapters.py::test_llm_with_lora_adapters[cluster_cpu-multiple-lora-adapters] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-no-scheduler-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_multi_node-router-managed-workload-simulated-dp-ep-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_lora_adapters.py::test_llm_with_lora_adapters[cluster_cpu-multiple-lora-adapters] [e2e-llm-inference-service] llmisvc/test_llm_tls.py::test_llm_tls_resources[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_tls.py::test_llm_tls_resources[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_prestop_hook.py::test_prestop_hook[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_multi_node-router-managed-workload-simulated-dp-ep-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-inline-config-workload-llmd-simulator] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-inline-config-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator-model-qwen2.5-0.5b] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator-model-qwen2.5-0.5b] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-configmap-ref-workload-llmd-simulator] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_prestop_hook.py::test_prestop_hook[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_rolling_upgrade.py::test_rolling_upgrade_coordination[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator-model-fb-opt-125m] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-configmap-ref-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-replicas-workload-llmd-simulator] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-replicas-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-custom-template-workload-llmd-simulator] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_rolling_upgrade.py::test_rolling_upgrade_coordination[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_storage_version_migration.py::TestStorageVersionMigration::test_storage_version_migration_after_simulated_upgrade [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_storage_version_migration.py::TestStorageVersionMigration::test_storage_version_migration_after_simulated_upgrade [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-v06-nonzero-threshold-migration-workload-llmd-simulator-pd] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-custom-template-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-v06-pd-config-migration-workload-llmd-simulator-pd] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-v06-nonzero-threshold-migration-workload-llmd-simulator-pd] [e2e-llm-inference-service] [gw0] FAILED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-v06-pd-config-migration-workload-llmd-simulator-pd] [e2e-llm-inference-service] [e2e-llm-inference-service] =================================== FAILURES =================================== [e2e-llm-inference-service] _ test_llm_inference_service[router-managed-scheduler-v06-pd-config-migration-workload-llmd-simulator-pd] _ [e2e-llm-inference-service] [gw0] linux -- Python 3.11.13 /workspace/source/python/kserve/.venv/bin/python [e2e-llm-inference-service] [e2e-llm-inference-service] test_case = TestCase(base_refs=['router-managed', 'scheduler-v06-pd-config-migration', 'workload-llmd-simulator-pd'], prompt='KSer... {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}, model_name='facebook/opt-125m') [e2e-llm-inference-service] [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] @pytest.mark.asyncio(loop_scope="session") [e2e-llm-inference-service] @pytest.mark.parametrize( [e2e-llm-inference-service] "test_case", [e2e-llm-inference-service] [ [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-with-gateway-ref", [e2e-llm-inference-service] "router-with-managed-route", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] endpoint="/v1/completions", [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] payload_formatter=completions_payload, [e2e-llm-inference-service] response_assertion=create_response_assertion(with_field="choices"), [e2e-llm-inference-service] expected_gateway=ROUTER_GATEWAYS[0], [e2e-llm-inference-service] before_test=[ [e2e-llm-inference-service] lambda: create_router_resources( [e2e-llm-inference-service] gateways=[ROUTER_GATEWAYS[0]], [e2e-llm-inference-service] ) [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] pytest.mark.custom_gateway, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] payload_formatter=completions_payload, [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-custom-route-timeout", [e2e-llm-inference-service] "scheduler-managed", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="custom-route-timeout-test", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-with-refs", [e2e-llm-inference-service] "scheduler-managed", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="router-with-refs-test", [e2e-llm-inference-service] expected_gateway=ROUTER_GATEWAYS[0], [e2e-llm-inference-service] before_test=[ [e2e-llm-inference-service] lambda: create_router_resources( [e2e-llm-inference-service] gateways=[ROUTER_GATEWAYS[0]], [e2e-llm-inference-service] routes=[ROUTER_ROUTES[0], ROUTER_ROUTES[1]], [e2e-llm-inference-service] ) [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.custom_gateway, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=["router-managed", "workload-pd-cpu", "model-fb-opt-125m"], [e2e-llm-inference-service] prompt="You are an expert in Kubernetes-native machine learning serving platforms, with deep knowledge of the KServe project. " [e2e-llm-inference-service] "Explain the challenges of serving large-scale models, GPU scheduling, and how KServe integrates with capabilities like multi-model serving. " [e2e-llm-inference-service] "Provide a detailed comparison with open source alternatives, focusing on operational trade-offs.", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-custom-route-timeout-pd", [e2e-llm-inference-service] "scheduler-managed", [e2e-llm-inference-service] "workload-pd-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="You are an expert in Kubernetes-native machine learning serving platforms, with deep knowledge of the KServe project. " [e2e-llm-inference-service] "Explain the challenges of serving large-scale models, GPU scheduling, and how KServe integrates with capabilities like multi-model serving. " [e2e-llm-inference-service] "Provide a detailed comparison with open source alternatives, focusing on operational trade-offs.", [e2e-llm-inference-service] service_name="custom-route-timeout-pd-test", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-with-refs-pd", [e2e-llm-inference-service] "scheduler-managed", [e2e-llm-inference-service] "workload-pd-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="You are an expert in Kubernetes-native machine learning serving platforms, with deep knowledge of the KServe project. " [e2e-llm-inference-service] "Explain the challenges of serving large-scale models, GPU scheduling, and how KServe integrates with capabilities like multi-model serving. " [e2e-llm-inference-service] "Provide a detailed comparison with open source alternatives, focusing on operational trade-offs.", [e2e-llm-inference-service] service_name="router-with-refs-pd-test", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] expected_gateway=ROUTER_GATEWAYS[1], [e2e-llm-inference-service] before_test=[ [e2e-llm-inference-service] lambda: create_router_resources( [e2e-llm-inference-service] gateways=[ROUTER_GATEWAYS[1]], [e2e-llm-inference-service] routes=[ROUTER_ROUTES[2], ROUTER_ROUTES[3]], [e2e-llm-inference-service] ) [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.custom_gateway, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-dp-ep-gpu", [e2e-llm-inference-service] "workload-dp-ep-prefill-gpu", [e2e-llm-inference-service] "model-deepseek-v2-lite", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="Delve into the multifaceted implications of a fully disaggregated cloud architecture, specifically " [e2e-llm-inference-service] "where the compute plane (P) and the data plane (D) are independently deployed and managed for a " [e2e-llm-inference-service] "geographically distributed, high-throughput, low-latency microservices ecosystem. Beyond the " [e2e-llm-inference-service] "fundamental challenges of network latency and data consistency, elaborate on the advanced " [e2e-llm-inference-service] "considerations and trade-offs inherent in such a setup: 1. Network Architecture and Protocols: " [e2e-llm-inference-service] "How would the network fabric and underlying protocols (e.g., RDMA, custom transport layers) need to " [e2e-llm-inference-service] "evolve to support optimal performance and minimize inter-plane communication overhead, especially for " [e2e-llm-inference-service] "synchronous operations? Discuss the role of network programmability (e.g., SDN, P4) in dynamically " [e2e-llm-inference-service] "optimizing routing and traffic flow between P and D. 2. Advanced Data Consistency and Durability: " [e2e-llm-inference-service] "Explore sophisticated data consistency models (e.g., causal consistency, strong eventual consistency) " [e2e-llm-inference-service] "and their applicability in balancing performance and data integrity across a globally distributed data plane. " [e2e-llm-inference-service] "Detail strategies for ensuring data durability and fault tolerance, including multi-region replication, " [e2e-llm-inference-service] "intelligent partitioning, and recovery mechanisms in the event of partial or full plane failures. " [e2e-llm-inference-service] "3. Dynamic Resource Orchestration and Cost Optimization: Analyze how an orchestration layer would intelligently " [e2e-llm-inference-service] "manage the independent scaling of compute (P) and data (D) resources, considering fluctuating workloads, " [e2e-llm-inference-service] "cost efficiency, and performance targets (e.g., using predictive analytics for resource provisioning). " [e2e-llm-inference-service] "Discuss mechanisms for dynamically reallocating compute nodes to different data partitions based on " [e2e-llm-inference-service] "workload patterns and data locality, potentially involving live migration strategies. " [e2e-llm-inference-service] "4. Security and Compliance in a Distributed Landscape: Address the enhanced security perimeter " [e2e-llm-inference-service] "challenges, including securing communication channels between P and D (encryption in transit, mutual TLS), " [e2e-llm-inference-service] "fine-grained access control to data at rest and in motion, and identity management across disaggregated " [e2e-llm-inference-service] "components. Discuss how such an architecture impacts compliance with regulatory frameworks (e.g., GDPR, HIPAA) " [e2e-llm-inference-service] "concerning data sovereignty, privacy, and auditability. 5. Operational Complexity and Observability: " [e2e-llm-inference-service] "Examine the increased complexity in monitoring, logging, and tracing across highly decoupled compute and " [e2e-llm-inference-service] "data planes. What specialized tooling and practices (e.g., distributed tracing with OpenTelemetry, advanced AIOps) " [e2e-llm-inference-service] "would be essential? How would incident response and troubleshooting differ in this disaggregated environment " [e2e-llm-inference-service] "compared to traditional integrated systems? Consider the challenges of pinpointing root causes across " [e2e-llm-inference-service] "independent failures. 6. Real-world Applicability and Future Trends: Identify specific industries " [e2e-llm-inference-service] "or use cases (e.g., high-frequency trading, IoT edge processing, large language model inference) " [e2e-llm-inference-service] "where the benefits of P/D disaggregation would strongly outweigh its complexities. " [e2e-llm-inference-service] "Conclude by speculating on emerging technologies or paradigms (e.g., serverless compute functions " [e2e-llm-inference-service] "directly interacting with object storage, in-memory disaggregation) that could further drive or " [e2e-llm-inference-service] "transform P/D disaggregation in cloud computing.", [e2e-llm-inference-service] max_tokens=2000, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_gpu, [e2e-llm-inference-service] pytest.mark.cluster_nvidia, [e2e-llm-inference-service] pytest.mark.cluster_nvidia_roce, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-no-scheduler", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="What is KServe?", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.no_scheduler, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-simulated-dp-ep-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="This test simulates DP+EP that can run on CPU, the idea is to test the LWS-based deployment, " [e2e-llm-inference-service] "but without the resources requirements for DP+EP (GPUs and ROCe/IB).", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_multi_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Scheduler config tests [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-with-inline-config", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="scheduler-inline-config-test", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Chat completions endpoint coverage [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] "model-qwen2.5-0.5b", [e2e-llm-inference-service] ], [e2e-llm-inference-service] model_name="Qwen/Qwen2.5-0.5B-Instruct", [e2e-llm-inference-service] endpoint="/v1/chat/completions", [e2e-llm-inference-service] prompt="What is KServe?", [e2e-llm-inference-service] payload_formatter=chat_completions_payload, [e2e-llm-inference-service] response_assertion=create_response_assertion(with_field="choices"), [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-with-configmap-ref", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="scheduler-configmap-ref-test", [e2e-llm-inference-service] before_test=[create_scheduler_configmap], [e2e-llm-inference-service] after_test=[delete_scheduler_configmap], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-with-replicas", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="scheduler-ha-replicas-test", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-with-custom-template", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="scheduler-custom-template-test", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Scheduler v0.6 → v0.7 migration tests. [e2e-llm-inference-service] # Deploy v0.6-style configs and verify the controller migrates them [e2e-llm-inference-service] # so the v0.7 scheduler boots successfully. [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-v06-pd-config-migration", [e2e-llm-inference-service] "workload-llmd-simulator-pd", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="scheduler-v06-pd-migration-test", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-v06-nonzero-threshold-migration", [e2e-llm-inference-service] "workload-llmd-simulator-pd", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="scheduler-v06-threshold-migration-test", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Precise prefix KV cache routing test [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-with-precise-prefix-cache-inline-config", [e2e-llm-inference-service] "workload-llmd-simulator-kvcache", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="precise-prefix-cache-test", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Models endpoint coverage [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] endpoint="/v1/models", [e2e-llm-inference-service] response_assertion=create_response_assertion(with_field="data"), [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Model-based routing via X-Gateway-Model-Name header — /v1/completions [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] endpoint="/v1/completions", [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] payload_formatter=completions_payload, [e2e-llm-inference-service] response_assertion=assert_model_field_matches("facebook/opt-125m"), [e2e-llm-inference-service] url_getter=get_model_routing_url, [e2e-llm-inference-service] extra_headers={ [e2e-llm-inference-service] MODEL_ROUTING_HEADER: f"publishers/{KSERVE_TEST_NAMESPACE}/models/facebook/opt-125m", [e2e-llm-inference-service] }, [e2e-llm-inference-service] peers=[ [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] "model-qwen2.5-0.5b", [e2e-llm-inference-service] ], [e2e-llm-inference-service] endpoint="/v1/completions", [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] payload_formatter=completions_payload, [e2e-llm-inference-service] response_assertion=assert_model_field_matches( [e2e-llm-inference-service] "Qwen/Qwen2.5-0.5B-Instruct" [e2e-llm-inference-service] ), [e2e-llm-inference-service] url_getter=get_model_routing_url, [e2e-llm-inference-service] extra_headers={ [e2e-llm-inference-service] MODEL_ROUTING_HEADER: f"publishers/{KSERVE_TEST_NAMESPACE}/models/Qwen/Qwen2.5-0.5B-Instruct", [e2e-llm-inference-service] }, [e2e-llm-inference-service] ), [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] pytest.mark.model_routing, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Model-based routing via X-Gateway-Model-Name header — /v1/chat/completions [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] endpoint="/v1/chat/completions", [e2e-llm-inference-service] prompt="What is KServe?", [e2e-llm-inference-service] payload_formatter=chat_completions_payload, [e2e-llm-inference-service] response_assertion=assert_model_field_matches("facebook/opt-125m"), [e2e-llm-inference-service] url_getter=get_model_routing_url, [e2e-llm-inference-service] extra_headers={ [e2e-llm-inference-service] MODEL_ROUTING_HEADER: f"publishers/{KSERVE_TEST_NAMESPACE}/models/facebook/opt-125m", [e2e-llm-inference-service] }, [e2e-llm-inference-service] peers=[ [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] "model-qwen2.5-0.5b", [e2e-llm-inference-service] ], [e2e-llm-inference-service] endpoint="/v1/chat/completions", [e2e-llm-inference-service] prompt="What is KServe?", [e2e-llm-inference-service] payload_formatter=chat_completions_payload, [e2e-llm-inference-service] response_assertion=assert_model_field_matches( [e2e-llm-inference-service] "Qwen/Qwen2.5-0.5B-Instruct" [e2e-llm-inference-service] ), [e2e-llm-inference-service] url_getter=get_model_routing_url, [e2e-llm-inference-service] extra_headers={ [e2e-llm-inference-service] MODEL_ROUTING_HEADER: f"publishers/{KSERVE_TEST_NAMESPACE}/models/Qwen/Qwen2.5-0.5B-Instruct", [e2e-llm-inference-service] }, [e2e-llm-inference-service] ), [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] pytest.mark.model_routing, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Model-based routing via X-Gateway-Model-Name header — LoRA adapter [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m-with-lora-hf", [e2e-llm-inference-service] ], [e2e-llm-inference-service] endpoint="/v1/completions", [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] model_name=f"publishers/{KSERVE_TEST_NAMESPACE}/models/lora-adapter-1", [e2e-llm-inference-service] payload_formatter=completions_payload, [e2e-llm-inference-service] response_assertion=assert_model_field_matches( [e2e-llm-inference-service] f"publishers/{KSERVE_TEST_NAMESPACE}/models/lora-adapter-1" [e2e-llm-inference-service] ), [e2e-llm-inference-service] url_getter=get_model_routing_url, [e2e-llm-inference-service] extra_headers={ [e2e-llm-inference-service] MODEL_ROUTING_HEADER: f"publishers/{KSERVE_TEST_NAMESPACE}/models/lora-adapter-1", [e2e-llm-inference-service] }, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.model_routing, [e2e-llm-inference-service] pytest.mark.lora, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Model-based routing via X-Gateway-Model-Name header — /v1/models (base + LoRA) [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m-with-lora-hf", [e2e-llm-inference-service] ], [e2e-llm-inference-service] endpoint="/v1/models", [e2e-llm-inference-service] response_assertion=assert_models_contains( [e2e-llm-inference-service] "facebook/opt-125m", [e2e-llm-inference-service] f"publishers/{KSERVE_TEST_NAMESPACE}/models/facebook/opt-125m", [e2e-llm-inference-service] "lora-adapter-1", [e2e-llm-inference-service] f"publishers/{KSERVE_TEST_NAMESPACE}/models/lora-adapter-1", [e2e-llm-inference-service] ), [e2e-llm-inference-service] url_getter=get_model_routing_url, [e2e-llm-inference-service] extra_headers={ [e2e-llm-inference-service] MODEL_ROUTING_HEADER: f"publishers/{KSERVE_TEST_NAMESPACE}/models/facebook/opt-125m", [e2e-llm-inference-service] }, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.model_routing, [e2e-llm-inference-service] pytest.mark.lora, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # PVC storage tests -- validate direct PVC volume mount with real vLLM serving [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-pvc", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] before_test=[ensure_pvc_with_model], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.pvc_storage, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-pd-cpu", [e2e-llm-inference-service] "model-pvc", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] before_test=[ensure_pvc_with_model], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.pvc_storage, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-simulated-dp-ep-cpu", [e2e-llm-inference-service] "model-pvc", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] before_test=[ensure_pvc_with_model], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_multi_node, [e2e-llm-inference-service] pytest.mark.pvc_storage, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] ], [e2e-llm-inference-service] indirect=["test_case"], [e2e-llm-inference-service] ids=generate_test_id, [e2e-llm-inference-service] ) [e2e-llm-inference-service] @log_execution [e2e-llm-inference-service] def test_llm_inference_service(test_case: TestCase): # noqa: F811 [e2e-llm-inference-service] inject_k8s_proxy() [e2e-llm-inference-service] [e2e-llm-inference-service] kserve_client = KServeClient( [e2e-llm-inference-service] config_file=os.environ.get("KUBECONFIG", "~/.kube/config"), [e2e-llm-inference-service] client_configuration=client.Configuration(), [e2e-llm-inference-service] ) [e2e-llm-inference-service] [e2e-llm-inference-service] service_name = test_case.llm_service.metadata.name [e2e-llm-inference-service] if not test_case.llm_service.metadata.annotations: [e2e-llm-inference-service] test_case.llm_service.metadata.annotations = {} [e2e-llm-inference-service] [e2e-llm-inference-service] test_case.llm_service.metadata.annotations[ [e2e-llm-inference-service] "security.opendatahub.io/enable-auth" [e2e-llm-inference-service] ] = "false" [e2e-llm-inference-service] prefix = test_case.log_prefix [e2e-llm-inference-service] [e2e-llm-inference-service] test_failed = False [e2e-llm-inference-service] try: [e2e-llm-inference-service] print(f"{prefix} Creating LLMInferenceService {service_name}") [e2e-llm-inference-service] create_llmisvc(kserve_client, test_case.llm_service) [e2e-llm-inference-service] print(f"{prefix} Waiting for LLMInferenceService {service_name} to be ready") [e2e-llm-inference-service] wait_for_llm_isvc_ready( [e2e-llm-inference-service] kserve_client, test_case.llm_service, test_case.wait_timeout [e2e-llm-inference-service] ) [e2e-llm-inference-service] print(f"{prefix} Waiting for model response from {service_name}") [e2e-llm-inference-service] > wait_for_model_response( [e2e-llm-inference-service] kserve_client, [e2e-llm-inference-service] test_case, [e2e-llm-inference-service] test_case.wait_timeout, [e2e-llm-inference-service] extra_headers=test_case.extra_headers, [e2e-llm-inference-service] ) [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:816: [e2e-llm-inference-service] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [e2e-llm-inference-service] [e2e-llm-inference-service] args = (, TestCase(base_refs=['router-managed', 'scheduler-v0... {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}, model_name='facebook/opt-125m'), 900) [e2e-llm-inference-service] kwargs = {'extra_headers': None}, func_name = 'wait_for_model_response' [e2e-llm-inference-service] timestamp_start = '2026-07-09T19:03:46.429233', start_time = 1783623826.430062 [e2e-llm-inference-service] duration = 1103.1077423095703, timestamp_end = '2026-07-09T19:22:09.537807' [e2e-llm-inference-service] [e2e-llm-inference-service] @functools.wraps(func) [e2e-llm-inference-service] def wrapper(*args, **kwargs): [e2e-llm-inference-service] func_name = func.__name__ [e2e-llm-inference-service] [e2e-llm-inference-service] timestamp_start = datetime.now().isoformat() [e2e-llm-inference-service] logger.info( [e2e-llm-inference-service] f"[{func_name}] [{timestamp_start}] start - args={args}, kwargs={kwargs}" [e2e-llm-inference-service] ) [e2e-llm-inference-service] start_time = time.time() [e2e-llm-inference-service] [e2e-llm-inference-service] try: [e2e-llm-inference-service] > result = func(*args, **kwargs) [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/logging.py:40: [e2e-llm-inference-service] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [e2e-llm-inference-service] [e2e-llm-inference-service] kserve_client = [e2e-llm-inference-service] test_case = TestCase(base_refs=['router-managed', 'scheduler-v06-pd-config-migration', 'workload-llmd-simulator-pd'], prompt='KSer... {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}, model_name='facebook/opt-125m') [e2e-llm-inference-service] timeout_seconds = 900, extra_headers = None [e2e-llm-inference-service] [e2e-llm-inference-service] @log_execution [e2e-llm-inference-service] def wait_for_model_response( [e2e-llm-inference-service] kserve_client: KServeClient, [e2e-llm-inference-service] test_case: TestCase, # noqa: F811 [e2e-llm-inference-service] timeout_seconds: int = 900, [e2e-llm-inference-service] extra_headers: Optional[Dict[str, str]] = None, [e2e-llm-inference-service] ) -> str: [e2e-llm-inference-service] def get_successful_response(): [e2e-llm-inference-service] try: [e2e-llm-inference-service] if test_case.url_getter: [e2e-llm-inference-service] service_url = test_case.url_getter(kserve_client, test_case.llm_service) [e2e-llm-inference-service] else: [e2e-llm-inference-service] service_url = get_llm_service_url(kserve_client, test_case.llm_service) [e2e-llm-inference-service] except Exception as e: [e2e-llm-inference-service] raise AssertionError(f"❌ Failed to get service URL: {e}") from e [e2e-llm-inference-service] [e2e-llm-inference-service] model_url = service_url + test_case.endpoint [e2e-llm-inference-service] [e2e-llm-inference-service] headers = {"Content-Type": "application/json"} [e2e-llm-inference-service] if extra_headers: [e2e-llm-inference-service] headers.update(extra_headers) [e2e-llm-inference-service] [e2e-llm-inference-service] if test_case.payload_formatter is not None: [e2e-llm-inference-service] test_payload = test_case.payload_formatter(test_case) [e2e-llm-inference-service] elif test_case.prompt is not None: [e2e-llm-inference-service] test_payload = { [e2e-llm-inference-service] "model": test_case.model_name [e2e-llm-inference-service] if not extra_headers or MODEL_ROUTING_HEADER not in extra_headers [e2e-llm-inference-service] else extra_headers[MODEL_ROUTING_HEADER], [e2e-llm-inference-service] "prompt": test_case.prompt, [e2e-llm-inference-service] "max_tokens": test_case.max_tokens, [e2e-llm-inference-service] } [e2e-llm-inference-service] else: [e2e-llm-inference-service] test_payload = None [e2e-llm-inference-service] [e2e-llm-inference-service] logger.info(f"Calling LLM service at {model_url} with payload {test_payload}") [e2e-llm-inference-service] try: [e2e-llm-inference-service] if test_payload is not None: [e2e-llm-inference-service] response = post_with_retry( [e2e-llm-inference-service] model_url, [e2e-llm-inference-service] headers=headers, [e2e-llm-inference-service] json_data=test_payload, [e2e-llm-inference-service] timeout=test_case.response_timeout, [e2e-llm-inference-service] ) [e2e-llm-inference-service] else: [e2e-llm-inference-service] response = get_with_retry( [e2e-llm-inference-service] model_url, [e2e-llm-inference-service] headers=headers, [e2e-llm-inference-service] timeout=test_case.response_timeout, [e2e-llm-inference-service] ) [e2e-llm-inference-service] except Exception as e: [e2e-llm-inference-service] logger.error(f"❌ Failed to call model: {e}") [e2e-llm-inference-service] raise AssertionError(f"❌ Failed to call model: {e}") from e [e2e-llm-inference-service] [e2e-llm-inference-service] logger.info(f"Model response is {response.status_code}: {response.text[:500]}") [e2e-llm-inference-service] [e2e-llm-inference-service] if 200 <= response.status_code < 300: [e2e-llm-inference-service] return response [e2e-llm-inference-service] raise AssertionError( [e2e-llm-inference-service] f"Service returned {response.status_code}: {response.text}" [e2e-llm-inference-service] ) [e2e-llm-inference-service] [e2e-llm-inference-service] > response = wait_for(get_successful_response, timeout=timeout_seconds, interval=5.0) [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:1119: [e2e-llm-inference-service] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [e2e-llm-inference-service] [e2e-llm-inference-service] assertion_fn = .get_successful_response at 0x7fba4fc02660> [e2e-llm-inference-service] timeout = 900, interval = 5.0 [e2e-llm-inference-service] [e2e-llm-inference-service] def wait_for( [e2e-llm-inference-service] assertion_fn: Callable[[], Any], timeout: float = 5.0, interval: float = 0.1 [e2e-llm-inference-service] ) -> Any: [e2e-llm-inference-service] """Wait for the assertion to succeed within timeout.""" [e2e-llm-inference-service] deadline = time.time() + timeout [e2e-llm-inference-service] last_msg = None [e2e-llm-inference-service] while True: [e2e-llm-inference-service] try: [e2e-llm-inference-service] > return assertion_fn() [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:1215: [e2e-llm-inference-service] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [e2e-llm-inference-service] [e2e-llm-inference-service] def get_successful_response(): [e2e-llm-inference-service] try: [e2e-llm-inference-service] if test_case.url_getter: [e2e-llm-inference-service] service_url = test_case.url_getter(kserve_client, test_case.llm_service) [e2e-llm-inference-service] else: [e2e-llm-inference-service] service_url = get_llm_service_url(kserve_client, test_case.llm_service) [e2e-llm-inference-service] except Exception as e: [e2e-llm-inference-service] raise AssertionError(f"❌ Failed to get service URL: {e}") from e [e2e-llm-inference-service] [e2e-llm-inference-service] model_url = service_url + test_case.endpoint [e2e-llm-inference-service] [e2e-llm-inference-service] headers = {"Content-Type": "application/json"} [e2e-llm-inference-service] if extra_headers: [e2e-llm-inference-service] headers.update(extra_headers) [e2e-llm-inference-service] [e2e-llm-inference-service] if test_case.payload_formatter is not None: [e2e-llm-inference-service] test_payload = test_case.payload_formatter(test_case) [e2e-llm-inference-service] elif test_case.prompt is not None: [e2e-llm-inference-service] test_payload = { [e2e-llm-inference-service] "model": test_case.model_name [e2e-llm-inference-service] if not extra_headers or MODEL_ROUTING_HEADER not in extra_headers [e2e-llm-inference-service] else extra_headers[MODEL_ROUTING_HEADER], [e2e-llm-inference-service] "prompt": test_case.prompt, [e2e-llm-inference-service] "max_tokens": test_case.max_tokens, [e2e-llm-inference-service] } [e2e-llm-inference-service] else: [e2e-llm-inference-service] test_payload = None [e2e-llm-inference-service] [e2e-llm-inference-service] logger.info(f"Calling LLM service at {model_url} with payload {test_payload}") [e2e-llm-inference-service] try: [e2e-llm-inference-service] if test_payload is not None: [e2e-llm-inference-service] response = post_with_retry( [e2e-llm-inference-service] model_url, [e2e-llm-inference-service] headers=headers, [e2e-llm-inference-service] json_data=test_payload, [e2e-llm-inference-service] timeout=test_case.response_timeout, [e2e-llm-inference-service] ) [e2e-llm-inference-service] else: [e2e-llm-inference-service] response = get_with_retry( [e2e-llm-inference-service] model_url, [e2e-llm-inference-service] headers=headers, [e2e-llm-inference-service] timeout=test_case.response_timeout, [e2e-llm-inference-service] ) [e2e-llm-inference-service] except Exception as e: [e2e-llm-inference-service] logger.error(f"❌ Failed to call model: {e}") [e2e-llm-inference-service] raise AssertionError(f"❌ Failed to call model: {e}") from e [e2e-llm-inference-service] [e2e-llm-inference-service] logger.info(f"Model response is {response.status_code}: {response.text[:500]}") [e2e-llm-inference-service] [e2e-llm-inference-service] if 200 <= response.status_code < 300: [e2e-llm-inference-service] return response [e2e-llm-inference-service] > raise AssertionError( [e2e-llm-inference-service] f"Service returned {response.status_code}: {response.text}" [e2e-llm-inference-service] ) [e2e-llm-inference-service] E AssertionError: Service returned 502: [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:1115: AssertionError [e2e-llm-inference-service] ------------------------------ Captured log setup ------------------------------ [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1637 No HTTP proxy configured for k8s client [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1586 Checking LLMInferenceServiceConfig router-managed-scheduler-v06-pd-5a5debb2 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1612 Resource not found, creating LLMInferenceServiceConfig router-managed-scheduler-v06-pd-5a5debb2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1622 ✓ Successfully created LLMInferenceServiceConfig router-managed-scheduler-v06-pd-5a5debb2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1586 Checking LLMInferenceServiceConfig scheduler-v06-pd-config-migrati-bb3264a2 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1612 Resource not found, creating LLMInferenceServiceConfig scheduler-v06-pd-config-migrati-bb3264a2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1622 ✓ Successfully created LLMInferenceServiceConfig scheduler-v06-pd-config-migrati-bb3264a2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1586 Checking LLMInferenceServiceConfig workload-llmd-simulator-pd-sche-64d0fc8b in namespace kserve-ci-e2e-test [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1612 Resource not found, creating LLMInferenceServiceConfig workload-llmd-simulator-pd-sche-64d0fc8b [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1622 ✓ Successfully created LLMInferenceServiceConfig workload-llmd-simulator-pd-sche-64d0fc8b [e2e-llm-inference-service] ------------------------------ Captured log call ------------------------------- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [test_llm_inference_service] [2026-07-09T19:02:49.030876] start - args=(), kwargs={'test_case': TestCase(base_refs=['router-managed', 'scheduler-v06-pd-config-migration', 'workload-llmd-simulator-pd'], prompt='KServe is a', service_name='scheduler-v06-pd-migration-test', endpoint='/v1/completions', max_tokens=20, payload_formatter=None, response_assertion=, wait_timeout=900, response_timeout=60, extra_headers=None, url_getter=None, expected_gateway=None, before_test=[], after_test=[], peers=[], llm_service={'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': None, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'scheduler-v06-pd-migration-test', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-managed-scheduler-v06-pd-5a5debb2'}, [e2e-llm-inference-service] {'name': 'scheduler-v06-pd-config-migrati-bb3264a2'}, [e2e-llm-inference-service] {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}, model_name='facebook/opt-125m')} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1637 No HTTP proxy configured for k8s client [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [create_llmisvc] [2026-07-09T19:02:49.043223] start - args=(, {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security.opendatahub.io/enable-auth': 'false'}, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'scheduler-v06-pd-migration-test', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-managed-scheduler-v06-pd-5a5debb2'}, [e2e-llm-inference-service] {'name': 'scheduler-v06-pd-config-migrati-bb3264a2'}, [e2e-llm-inference-service] {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [create_llmisvc] [2026-07-09T19:02:49.228785] end - ✅ in 0.185s [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [wait_for_llm_isvc_ready] [2026-07-09T19:02:49.229000] start - args=(, {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security.opendatahub.io/enable-auth': 'false'}, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'scheduler-v06-pd-migration-test', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-managed-scheduler-v06-pd-5a5debb2'}, [e2e-llm-inference-service] {'name': 'scheduler-v06-pd-config-migrati-bb3264a2'}, [e2e-llm-inference-service] {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}, 900), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1222 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1222 Waiting: Missing true conditions: {'Ready', 'RouterReady', 'WorkloadsReady'}, expected {'Ready', 'RouterReady', 'WorkloadsReady'}, got [{'lastTransitionTime': '2026-07-09T19:03:15Z', 'message': 'The following HTTPRoutes are not ready: [kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route: "False" (reason "InvalidKind", message "referencing unsupported backendRef: group \\"inference.networking.x-k8s.io\\" kind \\"InferencePool\\"")]', 'reason': 'HTTPRoutesNotReady', 'severity': 'Info', 'status': 'False', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-07-09T19:03:15Z', 'message': 'Inference Pool kserve-ci-e2e-test/scheduler-v06-pd-migration-test-inference-pool exists but no Gateway controller has accepted it yet', 'reason': 'WaitingForGateway', 'severity': 'Info', 'status': 'False', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-07-09T19:03:15Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-07-09T19:03:15Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-07-09T19:03:15Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-07-09T19:03:15Z', 'message': 'The following HTTPRoutes are not ready: [kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route: "False" (reason "InvalidKind", message "referencing unsupported backendRef: group \\"inference.networking.x-k8s.io\\" kind \\"InferencePool\\"")]', 'reason': 'HTTPRoutesNotReady', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-07-09T19:03:15Z', 'message': 'The following HTTPRoutes are not ready: [kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route: "False" (reason "InvalidKind", message "referencing unsupported backendRef: group \\"inference.networking.x-k8s.io\\" kind \\"InferencePool\\"")]', 'reason': 'HTTPRoutesNotReady', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-07-09T19:03:15Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-07-09T19:03:15Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1222 Waiting: Missing true conditions: {'Ready', 'RouterReady'}, expected {'Ready', 'RouterReady', 'WorkloadsReady'}, got [{'lastTransitionTime': '2026-07-09T19:03:31Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-07-09T19:03:31Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-07-09T19:03:31Z', 'severity': 'Info', 'status': 'True', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-07-09T19:03:31Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-07-09T19:03:15Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-07-09T19:03:31Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-07-09T19:03:31Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-07-09T19:03:31Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-07-09T19:03:31Z', 'status': 'True', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [wait_for_llm_isvc_ready] [2026-07-09T19:03:46.428993] end - ✅ in 57.200s [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [wait_for_model_response] [2026-07-09T19:03:46.429233] start - args=(, TestCase(base_refs=['router-managed', 'scheduler-v06-pd-config-migration', 'workload-llmd-simulator-pd'], prompt='KServe is a', service_name='scheduler-v06-pd-migration-test', endpoint='/v1/completions', max_tokens=20, payload_formatter=None, response_assertion=, wait_timeout=900, response_timeout=60, extra_headers=None, url_getter=None, expected_gateway=None, before_test=[], after_test=[], peers=[], llm_service={'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security.opendatahub.io/enable-auth': 'false'}, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'scheduler-v06-pd-migration-test', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-managed-scheduler-v06-pd-5a5debb2'}, [e2e-llm-inference-service] {'name': 'scheduler-v06-pd-config-migrati-bb3264a2'}, [e2e-llm-inference-service] {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}, model_name='facebook/opt-125m'), 900), kwargs={'extra_headers': None} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llm_service_url] [2026-07-09T19:03:46.430069] start - args=(, {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security.opendatahub.io/enable-auth': 'false'}, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'scheduler-v06-pd-migration-test', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-managed-scheduler-v06-pd-5a5debb2'}, [e2e-llm-inference-service] {'name': 'scheduler-v06-pd-config-migrati-bb3264a2'}, [e2e-llm-inference-service] {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llm_service_url] [2026-07-09T19:03:46.439398] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1092 Calling LLM service at http://a0bc2b705a5c84321afabcfcc514c460-542179505.us-east-1.elb.amazonaws.com/kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/completions with payload {'model': 'facebook/opt-125m', 'prompt': 'KServe is a', 'max_tokens': 20} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1111 Model response is 502: [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1222 Waiting: Service returned 502: [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llm_service_url] [2026-07-09T19:09:55.785169] start - args=(, {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security.opendatahub.io/enable-auth': 'false'}, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'scheduler-v06-pd-migration-test', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-managed-scheduler-v06-pd-5a5debb2'}, [e2e-llm-inference-service] {'name': 'scheduler-v06-pd-config-migrati-bb3264a2'}, [e2e-llm-inference-service] {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llm_service_url] [2026-07-09T19:09:55.829611] end - ✅ in 0.044s [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1092 Calling LLM service at http://a0bc2b705a5c84321afabcfcc514c460-542179505.us-east-1.elb.amazonaws.com/kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/completions with payload {'model': 'facebook/opt-125m', 'prompt': 'KServe is a', 'max_tokens': 20} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1111 Model response is 502: [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llm_service_url] [2026-07-09T19:16:05.145502] start - args=(, {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security.opendatahub.io/enable-auth': 'false'}, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'scheduler-v06-pd-migration-test', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-managed-scheduler-v06-pd-5a5debb2'}, [e2e-llm-inference-service] {'name': 'scheduler-v06-pd-config-migrati-bb3264a2'}, [e2e-llm-inference-service] {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llm_service_url] [2026-07-09T19:16:05.224353] end - ✅ in 0.078s [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1092 Calling LLM service at http://a0bc2b705a5c84321afabcfcc514c460-542179505.us-east-1.elb.amazonaws.com/kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/completions with payload {'model': 'facebook/opt-125m', 'prompt': 'KServe is a', 'max_tokens': 20} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1111 Model response is 502: [e2e-llm-inference-service] ERROR e2e.llmisvc.logging:test_llm_inference_service.py:1219 Timed out waiting: Service returned 502: [e2e-llm-inference-service] ERROR e2e.llmisvc.logging:logging.py:48 [wait_for_model_response] [2026-07-09T19:22:09.537807] end - ❌ 1103.108s: Service returned 502: [e2e-llm-inference-service] ERROR e2e.llmisvc.logging:test_llm_inference_service.py:831 [router-managed-scheduler-v06-pd-config-migration-workload-llmd-simulator-pd] ❌ ERROR: Failed to call llm inference service scheduler-v06-pd-migration-test: Service returned 502: [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1240 🔍 # Diagnostics for 'scheduler-v06-pd-migration-test' in 'kserve-ci-e2e-test' [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1241 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1242 # LLMInferenceService scheduler-v06-pd-migration-test [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1245 apiVersion: serving.kserve.io/v1alpha1 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] security.opendatahub.io/enable-auth: 'false' [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:02:49Z' [e2e-llm-inference-service] finalizers: [e2e-llm-inference-service] - serving.kserve.io/llmisvc-finalizer [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:security.opendatahub.io/enable-auth: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:baseRefs: {} [e2e-llm-inference-service] manager: OpenAPI-Generator [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-09T19:02:49Z' [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:finalizers: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] v:"serving.kserve.io/llmisvc-finalizer": {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-09T19:02:56Z' [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:addresses: {} [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:serving.kserve.io/config-llm-decode-template: {} [e2e-llm-inference-service] f:serving.kserve.io/config-llm-decode-worker-data-parallel: {} [e2e-llm-inference-service] f:serving.kserve.io/config-llm-prefill-template: {} [e2e-llm-inference-service] f:serving.kserve.io/config-llm-prefill-worker-data-parallel: {} [e2e-llm-inference-service] f:serving.kserve.io/config-llm-router-route: {} [e2e-llm-inference-service] f:serving.kserve.io/config-llm-scheduler: {} [e2e-llm-inference-service] f:serving.kserve.io/config-llm-template: {} [e2e-llm-inference-service] f:serving.kserve.io/config-llm-tracing: {} [e2e-llm-inference-service] f:serving.kserve.io/config-llm-worker-data-parallel: {} [e2e-llm-inference-service] f:appliedConfigs: {} [e2e-llm-inference-service] f:conditions: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:router: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:gateways: {} [e2e-llm-inference-service] f:scheduler: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:inferencePool: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:group: {} [e2e-llm-inference-service] f:kind: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:service: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:group: {} [e2e-llm-inference-service] f:kind: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:url: {} [e2e-llm-inference-service] f:workloads: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:prefill: {} [e2e-llm-inference-service] f:primary: {} [e2e-llm-inference-service] f:scheduler: {} [e2e-llm-inference-service] f:service: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] time: '2026-07-09T19:03:45Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] resourceVersion: '64789' [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] spec: [e2e-llm-inference-service] baseRefs: [e2e-llm-inference-service] - name: router-managed-scheduler-v06-pd-5a5debb2 [e2e-llm-inference-service] - name: scheduler-v06-pd-config-migrati-bb3264a2 [e2e-llm-inference-service] - name: workload-llmd-simulator-pd-sche-64d0fc8b [e2e-llm-inference-service] model: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uri: '' [e2e-llm-inference-service] status: [e2e-llm-inference-service] addresses: [e2e-llm-inference-service] - name: gateway-external-model-routing [e2e-llm-inference-service] url: http://a0bc2b705a5c84321afabcfcc514c460-542179505.us-east-1.elb.amazonaws.com/ [e2e-llm-inference-service] - name: gateway-external [e2e-llm-inference-service] url: http://a0bc2b705a5c84321afabcfcc514c460-542179505.us-east-1.elb.amazonaws.com/kserve-ci-e2e-test/scheduler-v06-pd-migration-test [e2e-llm-inference-service] - name: gateway-internal-model-routing [e2e-llm-inference-service] url: http://openshift-ai-inference-openshift-default.openshift-ingress.svc.cluster.local/ [e2e-llm-inference-service] - name: gateway-internal [e2e-llm-inference-service] url: http://openshift-ai-inference-openshift-default.openshift-ingress.svc.cluster.local/kserve-ci-e2e-test/scheduler-v06-pd-migration-test [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] serving.kserve.io/config-llm-decode-template: kserve-config-llm-decode-template [e2e-llm-inference-service] serving.kserve.io/config-llm-decode-worker-data-parallel: kserve-config-llm-decode-worker-data-parallel [e2e-llm-inference-service] serving.kserve.io/config-llm-prefill-template: kserve-config-llm-prefill-template [e2e-llm-inference-service] serving.kserve.io/config-llm-prefill-worker-data-parallel: kserve-config-llm-prefill-worker-data-parallel [e2e-llm-inference-service] serving.kserve.io/config-llm-router-route: kserve-config-llm-router-route [e2e-llm-inference-service] serving.kserve.io/config-llm-scheduler: kserve-config-llm-scheduler [e2e-llm-inference-service] serving.kserve.io/config-llm-template: kserve-config-llm-template [e2e-llm-inference-service] serving.kserve.io/config-llm-tracing: kserve-config-llm-tracing [e2e-llm-inference-service] serving.kserve.io/config-llm-worker-data-parallel: kserve-config-llm-worker-data-parallel [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] - lastTransitionTime: '2026-07-09T19:03:31Z' [e2e-llm-inference-service] severity: Info [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: HTTPRoutesReady [e2e-llm-inference-service] - lastTransitionTime: '2026-07-09T19:03:31Z' [e2e-llm-inference-service] severity: Info [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: InferencePoolReady [e2e-llm-inference-service] - lastTransitionTime: '2026-07-09T19:03:31Z' [e2e-llm-inference-service] severity: Info [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: MainWorkloadReady [e2e-llm-inference-service] - lastTransitionTime: '2026-07-09T19:03:31Z' [e2e-llm-inference-service] severity: Info [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: PrefillWorkloadReady [e2e-llm-inference-service] - lastTransitionTime: '2026-07-09T19:03:15Z' [e2e-llm-inference-service] severity: Info [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: PresetsCombined [e2e-llm-inference-service] - lastTransitionTime: '2026-07-09T19:03:45Z' [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: Ready [e2e-llm-inference-service] - lastTransitionTime: '2026-07-09T19:03:45Z' [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: RouterReady [e2e-llm-inference-service] - lastTransitionTime: '2026-07-09T19:03:45Z' [e2e-llm-inference-service] severity: Info [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: SchedulerWorkloadReady [e2e-llm-inference-service] - lastTransitionTime: '2026-07-09T19:03:31Z' [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: WorkloadsReady [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] url: http://a0bc2b705a5c84321afabcfcc514c460-542179505.us-east-1.elb.amazonaws.com/kserve-ci-e2e-test/scheduler-v06-pd-migration-test [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:44 TIME NAMESPACE SOURCE TYPE REASON MESSAGE [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:45 -------------------------------------------------------------------------------------------------- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/auth-disabled-test-kserve-5dc95f64cf-qnt8q to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:18 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.31/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:18 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:18 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:18 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:22 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:22 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:22 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:08 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.31:8000/health": dial tcp 10.133.0.31:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:23 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:17 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: auth-disabled-test-kserve-5dc95f64cf-qnt8q [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/auth-disabled-test-kserve-router-scheduler-75554c9b74-kzxdg to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:18 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.36/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:18 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:18 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:18 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:19 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:19 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:19 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:23 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:23 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:18 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: auth-disabled-test-kserve-router-scheduler-75554c9b74-kzxdg [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:18 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set auth-disabled-test-kserve-router-scheduler-75554c9b74 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:17 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set auth-disabled-test-kserve-5dc95f64cf from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:09 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy auth-disabled-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/auth-disabled-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "auth-disabled-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:17 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/auth-disabled-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:17 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/auth-disabled-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:17 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/auth-disabled-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:17 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/auth-disabled-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:17 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-disabled-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:18 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/auth-disabled-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:18 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/auth-disabled-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:18 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/auth-disabled-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:18 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/auth-disabled-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-disabled-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/auth-disabled-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/auth-disabled-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:18 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [auth-disabled-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-disabled-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/auth-enabled-test-kserve-865fb4fc77-6mq9w to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:15 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.26/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:15 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:15 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:15 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:19 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulling Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:50 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" in 30.985s (30.985s including waiting). Image size: 3531177328 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:50 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:50 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:35 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.26:8000/health": dial tcp 10.133.0.26:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:59 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:15 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.26:8000/health": dial tcp 10.133.0.26:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:14 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: auth-enabled-test-kserve-865fb4fc77-6mq9w [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-57d5bcd549-64cgv to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:15 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.32/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:15 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulling Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:19 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" in 3.665s (3.665s including waiting). Image size: 302212566 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:19 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:19 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:20 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulling Pulling image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:22 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Successfully pulled image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" in 1.396s (1.396s including waiting). Image size: 75073927 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:22 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:22 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:59 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:59 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:15 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: auth-enabled-test-kserve-router-scheduler-57d5bcd549-64cgv [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:15 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set auth-enabled-test-kserve-router-scheduler-57d5bcd549 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:14 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set auth-enabled-test-kserve-865fb4fc77 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:14 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/auth-enabled-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:14 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/auth-enabled-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:14 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/auth-enabled-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:14 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/auth-enabled-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:14 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-enabled-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:14 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/auth-enabled-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/auth-enabled-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/auth-enabled-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:21 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-enabled-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:21 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/auth-enabled-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:21 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/auth-enabled-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:55 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [auth-enabled-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:59 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-enabled-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/auth-invalid-token-test-kserve-6ff9db59f7-w79qc to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:36 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.29/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:36 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:36 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:36 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:40 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:40 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:40 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:25 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.29:8000/health": dial tcp 10.133.0.29:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:37 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:52 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.29:8000/health": dial tcp 10.133.0.29:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:35 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: auth-invalid-token-test-kserve-6ff9db59f7-w79qc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/auth-invalid-token-test-kserve-router-scheduler-844f5899-v995s to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:36 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.34/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:36 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:36 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:36 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:37 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:37 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:37 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:37 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:37 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:35 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: auth-invalid-token-test-kserve-router-scheduler-844f5899-v995s [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:35 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set auth-invalid-token-test-kserve-router-scheduler-844f5899 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:35 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set auth-invalid-token-test-kserve-6ff9db59f7 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/auth-invalid-token-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/auth-invalid-token-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/auth-invalid-token-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/auth-invalid-token-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-invalid-token-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/auth-invalid-token-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/auth-invalid-token-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/auth-invalid-token-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/auth-invalid-token-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:22:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-invalid-token-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:22:22 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/auth-invalid-token-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:22:22 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/auth-invalid-token-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:36 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [auth-invalid-token-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:37 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-invalid-token-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:09 kserve-ci-e2e-test LLMInferenceServiceController Warning UpdateFailed Failed to update status for LLMInferenceService "conv-test-criticality": Operation cannot be fulfilled on llminferenceservices.serving.kserve.io "conv-test-criticality": the object has been modified; please apply your changes to the latest version and try again [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:09 kserve-ci-e2e-test LLMInferenceServiceController Warning UpdateFailed Failed to update status for LLMInferenceService "conv-test-round-trip": llminferenceservices.serving.kserve.io "conv-test-round-trip" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-6ffc9757db-ks8b4 to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.44/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:54 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:54 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:54 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:43:50 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.44:8001/health": dial tcp 10.133.0.44:8001: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:16 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:16 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: custom-route-timeout-pd-test-kserve-6ffc9757db-ks8b4 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-7859b78c59-24gxp to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.45/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:54 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:54 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:54 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:43:50 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.45:8000/health": dial tcp 10.133.0.45:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:16 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: custom-route-timeout-pd-test-kserve-prefill-7859b78c59-24gxp [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set custom-route-timeout-pd-test-kserve-prefill-7859b78c59 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: custom-route-timeout-pd-test-kserve-router-scheduler-756d5mblz4 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-756d5mblz4 to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.64/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:52 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:52 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:52 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:16 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:16 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set custom-route-timeout-pd-test-kserve-router-scheduler-756d547947 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set custom-route-timeout-pd-test-kserve-6ffc9757db from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:49 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-pd-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-pd-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:49 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:49 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:49 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:49 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:49 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:50 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:54 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:54 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:54 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:01 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [custom-route-timeout-pd-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:16 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-85b89c4fdc-dggc8 to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:36 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.36/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:36 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:36 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:36 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:39 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:39 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:40 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:25 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.36:8000/health": dial tcp 10.133.0.36:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:41 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:57 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.36:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:35 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: custom-route-timeout-test-kserve-85b89c4fdc-dggc8 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:35 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: custom-route-timeout-test-kserve-router-scheduler-c5b5f7f6rwqgv [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-c5b5f7f6rwqgv to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:36 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.39/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:36 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:36 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:36 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:37 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:37 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:37 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:41 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:41 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:35 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set custom-route-timeout-test-kserve-router-scheduler-c5b5f7f66 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:35 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set custom-route-timeout-test-kserve-85b89c4fdc from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:34 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/custom-route-timeout-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:52 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:52 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:36 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [custom-route-timeout-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/e2e-pvc-model-download-24fsq to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:29:59 kserve-ci-e2e-test attachdetach-controller Normal SuccessfulAttachVolume AttachVolume.Attach succeeded for volume "pvc-1030d2a9-7a19-4fc9-acdf-cc609db07d6f" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:02 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.59/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:02 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:02 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:02 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:29:53 kserve-ci-e2e-test job-controller Normal SuccessfulCreate Created pod: e2e-pvc-model-download-24fsq [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:10 kserve-ci-e2e-test job-controller Normal Completed Job completed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:29:53 kserve-ci-e2e-test persistentvolume-controller Normal WaitForFirstConsumer waiting for first consumer to be created before binding [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:29:53 kserve-ci-e2e-test ebs.csi.aws.com_aws-ebs-csi-driver-controller-7d87cd57f8-fd7qq_b78de1bd-0ae9-4c28-8ee3-e7817d3e3391 Normal Provisioning External provisioner is provisioning volume for claim "kserve-ci-e2e-test/e2e-pvc-model-storage" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:29:53 kserve-ci-e2e-test persistentvolume-controller Normal ExternalProvisioning Waiting for a volume to be created either by the external provisioner 'ebs.csi.aws.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:29:56 kserve-ci-e2e-test ebs.csi.aws.com_aws-ebs-csi-driver-controller-7d87cd57f8-fd7qq_b78de1bd-0ae9-4c28-8ee3-e7817d3e3391 Normal ProvisioningSucceeded Successfully provisioned volume pvc-1030d2a9-7a19-4fc9-acdf-cc609db07d6f [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:00 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc54flvq [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc54flvq to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:01 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.23/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:01 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulling Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:02 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.08s (1.08s including waiting). Image size: 98346788 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:02 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:02 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:31 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:46 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.23:8000/health": dial tcp 10.133.0.23:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:00 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:00 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:00 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:00 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:00 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:02 kserve-ci-e2e-test LLMInferenceServiceController Warning UpdateFailed Failed to update status for LLMInferenceService "gw-section-name-router-with-gat-2f0a622e": Operation cannot be fulfilled on llminferenceservices.serving.kserve.io "gw-section-name-router-with-gat-2f0a622e": the object has been modified; please apply your changes to the latest version and try again [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:41 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b87nbn [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b87nbn to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:42 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.31/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:42 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulling Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:43 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.072s (1.072s including waiting). Image size: 98346788 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:43 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:43 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:59 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:41 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:49:00 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-fb-opt-125m-route-3c960099-kserve-76569c86d4h4llc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-76569c86d4h4llc to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:49:01 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.51/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:49:01 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:49:01 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:49:01 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:49:05 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:49:05 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:49:05 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:01 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.51:8000/health": dial tcp 10.133.0.51:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:28 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:49:00 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-fb-opt-125m-route-3c960099-kserve-76569c86d4 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:49:00 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-3c960099-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-3c960099-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:49:00 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisvd10b93c8eba12f87c3a350a5cae2ee0c-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:49:00 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:49:00 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:49:00 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:49:00 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:49:22 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisvd10b93c8eba12f87c3a350a5cae2ee0c-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:24 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-fb-opt-125m-route-3c960099] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:30 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-fb-opt-125m-route-50bc673d-kserve-678f7bf94fr9bqz [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-678f7bf94fr9bqz to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:31 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.42/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:31 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:31 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:31 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:31 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:31 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:31 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:36 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:36 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:36 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:11 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.42:8001/health": dial tcp 10.133.0.42:8001: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:27 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:27 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5f2hxng to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:31 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.43/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:31 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:31 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:31 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:36 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:36 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:36 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:11 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.43:8000/health": dial tcp 10.133.0.43:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:27 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:30 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5f2hxng [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:30 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5f469878b from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:30 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-fb-opt-125m-route-50bc673d-kserve-678f7bf94f from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:29 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:31 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test00d7278d8a22c4e39146a6b0eb840f45-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:40 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:40 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:21 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-fb-opt-125m-route-50bc673d] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test00d7278d8a22c4e39146a6b0eb840f45-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:40 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-fb-opt-125m-route-87882a8e-kserve-774f4944fcx6x4w [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-774f4944fcx6x4w to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:41 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.34/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:41 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:41 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:41 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:45 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:45 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:45 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:31 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.34:8000/health": dial tcp 10.133.0.34:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:08 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:24 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.34:8000/health": dial tcp 10.133.0.34:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:40 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-fb-opt-125m-route-87882a8e-kserve-774f4944fc from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:36 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:40 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:40 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:40 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:40 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test21fe6730fe484f3a92b1a16afe1bac8f-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:57 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:53 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-fb-opt-125m-route-87882a8e] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:08 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test21fe6730fe484f3a92b1a16afe1bac8f-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:54 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.44/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:54 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:54 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:54 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:57 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulling Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:52:42 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" in 45.119s (45.119s including waiting). Image size: 3531177328 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:52:42 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:52:42 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:16 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:53 kserve-ci-e2e-test statefulset-controller Normal SuccessfulCreate create Pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 in StatefulSet llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 successful [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:53 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.53/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:53 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:54 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:54 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:58 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:58 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:58 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:43 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.53:8000/health": dial tcp 10.133.0.53:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:00 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:15 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.53:8000/health": dial tcp 10.133.0.53:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:53 kserve-ci-e2e-test leaderworkerset Normal CreatingRevision Creating revision with key 699b6f5cfb for a newly created LeaderWorkerSet [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:53 kserve-ci-e2e-test leaderworkerset Normal GroupsProgressing Created leader statefulset llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:53 kserve-ci-e2e-test leaderworkerset Normal GroupsProgressing Replicas are progressing, with 0 groups ready of total 1 groups [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:53 kserve-ci-e2e-test statefulset-controller Normal SuccessfulCreate create Pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 in StatefulSet llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn successful [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:53 kserve-ci-e2e-test leaderworkerset Normal GroupsProgressing Created worker statefulset for leader pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:53 kserve-ci-e2e-test leaderworkerset Normal AllGroupsReady All replicas are ready, with 1 groups ready of total 1 groups [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:51 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-scc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test386bd5808c5c450f11fd8632e1f821fb-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:52:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:59 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:52:00 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:55:55 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-fb-opt-125m-route-dc21cb14] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:00 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test386bd5808c5c450f11fd8632e1f821fb-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:58 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d46jww5 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d46jww5 to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:59 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.37/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:59 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:59 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:59 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:11 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:26 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.134.0.37:8000/health": dial tcp 10.134.0.37:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:58 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:54 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:58 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:58 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:58 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:58 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:58 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:27:10 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:27:10 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-fb-opt-125m-route-e95b1dc1] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-5794fffdfb-vx8vj to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:24 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.32/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:24 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:24 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:24 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:29 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:29 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:29 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:44 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.32:8000/health": dial tcp 10.133.0.32:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:27:26 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:27:42 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.32:8000/health": dial tcp 10.133.0.32:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:23 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-fb-opt-125m-with-7ca60146-kserve-5794fffdfb-vx8vj [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:24 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schelcs4b [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:24 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler-585b88cd85 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schelcs4b to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:24 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.56/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:24 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:24 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:24 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:26 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:26 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:26 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:27:26 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:27:27 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:23 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-fb-opt-125m-with-7ca60146-kserve-5794fffdfb from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:22 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test5216bfd716f919dc046bc693ceb22e41-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:25:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:08 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:08 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:27:00 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-fb-opt-125m-with-7ca60146] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:27:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test5216bfd716f919dc046bc693ceb22e41-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-9765576c5-lnr29 to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.33/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:06 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:06 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:07 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:29:22 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.33:8000/health": dial tcp 10.133.0.33:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:29:34 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-9765576c5-lnr29 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche6hjms to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.58/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:04 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:04 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:04 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:29:33 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:29:33 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche6hjms [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler-88c98ccf6 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-9765576c5 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:27:57 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test05addb65ba05195619f26ef266e8fc04-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:10 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:09 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:10 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:29:32 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-fb-opt-125m-with-ba4d693a] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:29:33 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test05addb65ba05195619f26ef266e8fc04-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:30 kserve-ci-e2e-test attachdetach-controller Normal SuccessfulAttachVolume AttachVolume.Attach succeeded for volume "pvc-1030d2a9-7a19-4fc9-acdf-cc609db07d6f" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:38 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.41/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:38 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:38 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:38 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:49 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:28 kserve-ci-e2e-test statefulset-controller Normal SuccessfulCreate create Pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 in StatefulSet llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 successful [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:30 kserve-ci-e2e-test attachdetach-controller Normal SuccessfulAttachVolume AttachVolume.Attach succeeded for volume "pvc-1030d2a9-7a19-4fc9-acdf-cc609db07d6f" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:38 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.40/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:38 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:38 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:38 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:38:57 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.40:8000/health": dial tcp 10.133.0.40:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:33 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:48 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.40:8000/health": dial tcp 10.133.0.40:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:28 kserve-ci-e2e-test leaderworkerset Normal CreatingRevision Creating revision with key 686d468674 for a newly created LeaderWorkerSet [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:28 kserve-ci-e2e-test leaderworkerset Normal GroupsProgressing Created leader statefulset llmisvc-model-pvc-router-manage-2577e794-kserve-mn [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:28 kserve-ci-e2e-test leaderworkerset Normal GroupsProgressing Replicas are progressing, with 0 groups ready of total 1 groups [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:28 kserve-ci-e2e-test statefulset-controller Normal SuccessfulCreate create Pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 in StatefulSet llmisvc-model-pvc-router-manage-2577e794-kserve-mn successful [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:28 kserve-ci-e2e-test leaderworkerset Normal GroupsProgressing Created worker statefulset for leader pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:39:08 kserve-ci-e2e-test leaderworkerset Normal AllGroupsReady All replicas are ready, with 1 groups ready of total 1 groups [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:25 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-2577e794-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-2577e794-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-scc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test37591b20e96e9663d45a730d03070f1e-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:55 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:54 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:28 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-pvc-router-manage-2577e794] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:32 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test37591b20e96e9663d45a730d03070f1e-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:25 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dn94c5 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dn94c5 to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:27 kserve-ci-e2e-test attachdetach-controller Normal SuccessfulAttachVolume AttachVolume.Attach succeeded for volume "pvc-1030d2a9-7a19-4fc9-acdf-cc609db07d6f" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:30 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.35/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:30 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:30 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:30 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:32:20 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.35:8000/health": dial tcp 10.133.0.35:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:32:35 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:32:50 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.35:8000/health": dial tcp 10.133.0.35:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:25 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:24 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-59b9d263-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-59b9d263-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv8bf079eb6eda4debfb4ef5bb7817824c-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-testc9569cf4801efc0ed27b2f25ffaee875-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:52 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:08 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv8bf079eb6eda4debfb4ef5bb7817824c-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:51 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:32:30 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-pvc-router-manage-59b9d263] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:32:34 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testc9569cf4801efc0ed27b2f25ffaee875-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-wzmhm to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:04 kserve-ci-e2e-test attachdetach-controller Normal SuccessfulAttachVolume AttachVolume.Attach succeeded for volume "pvc-1030d2a9-7a19-4fc9-acdf-cc609db07d6f" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:04 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.37/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:04 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulling Pulling image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:06 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Successfully pulled image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" in 1.512s (1.512s including waiting). Image size: 44914394 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:06 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:06 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:07 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:07 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:07 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:35:34 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.37:8001/health": dial tcp 10.133.0.37:8001: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:35:59 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:35:59 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:32:59 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-wzmhm [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:32:59 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79qd8r2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79qd8r2 to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:04 kserve-ci-e2e-test attachdetach-controller Normal SuccessfulAttachVolume AttachVolume.Attach succeeded for volume "pvc-1030d2a9-7a19-4fc9-acdf-cc609db07d6f" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:04 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.38/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:04 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:04 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:05 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:35:34 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.38:8000/health": dial tcp 10.133.0.38:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:35:59 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:14 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.38:8000/health": dial tcp 10.133.0.38:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:32:59 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79497db4cc from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:32:59 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:32:58 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-e8706282-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-e8706282-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:32:59 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisvb19f98874e050eec8ca94d49676113f0-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:32:59 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:32:59 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:32:59 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:32:59 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:32:59 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-prefill [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:00 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:00 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:00 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-testf5d060a5eb39a04e074b78907a1556a6-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:20 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisvb19f98874e050eec8ca94d49676113f0-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:35:45 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-pvc-router-manage-e8706282] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:35:59 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testf5d060a5eb39a04e074b78907a1556a6-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:01 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4nwsqc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4nwsqc to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:02 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.46/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:02 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:02 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:02 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:45 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:01 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:00 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test80f99418f0f3eb4c80f02e6144a6d4f2-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:16 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:16 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:36 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-4c1ba212] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:45 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test80f99418f0f3eb4c80f02e6144a6d4f2-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:56 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f4zgjh [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f4zgjh to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:57 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.35/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:57 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:57 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:57 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:32 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:56 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:55 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test76d7f532acb694e4a7bcef75d32cd8a1-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:57 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:57 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:08 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:30 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-4f8c0978] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:31 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test76d7f532acb694e4a7bcef75d32cd8a1-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:23 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddhsjkr [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddhsjkr to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:24 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.33/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:24 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:24 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:24 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:22:24 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:22:39 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.134.0.33:8000/health": dial tcp 10.134.0.33:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:23 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:19 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-testb7025ca4d8a6f8f5b2fd08b5581d2678-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:22:14 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:22:13 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:22:14 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:22:15 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-a50492e9] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:22:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testb7025ca4d8a6f8f5b2fd08b5581d2678-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-rdv96 to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:22 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.30/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:22 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:22 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:22 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:52 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:21 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-rdv96 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Warning ClusterIPNotAllocated Cluster IP [IPv4]: 172.31.211.17 is not allocated; repairing [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:21 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:13 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-4b931143-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-4b931143-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:21 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:21 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:21 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:21 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:22 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test8ac8e3d2264ccb939eb021b0b835847c-llmisvc-rout [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:22 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:22 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:22 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:22 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:32 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:31 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:31 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:54 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-router-managed-test-llm-4b931143] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:52 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test8ac8e3d2264ccb939eb021b0b835847c-llmisvc-rout [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:34 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4kqnnx [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4kqnnx to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:35 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.28/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:35 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:35 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:35 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:22:42 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:34 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:32 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-5b1e8f15-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-5b1e8f15-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:34 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:34 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:34 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test7f54e84970003a6e7372bdbcb574f7ed-llmisvc-rout [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:52 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:52 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:08 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-router-managed-test-llm-5b1e8f15] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:22:42 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test7f54e84970003a6e7372bdbcb574f7ed-llmisvc-rout [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879b5k2n [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879b5k2n to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.27/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:51 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:06 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.27:8000/health": dial tcp 10.133.0.27:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:13 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-e45d1f79-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-e45d1f79-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-testef4d2875be14b30dc1561ed84d0d4bde-llmisvc-rout [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:31 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:31 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:50 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-router-managed-test-llm-e45d1f79] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:51 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testef4d2875be14b30dc1561ed84d0d4bde-llmisvc-rout [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:57 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnfv2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:57 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler-6fcb489785 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnfv2 to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:57 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.55/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:57 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:57 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:57 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:32 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:32 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:28 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schewqhcq [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:28 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler-7dbcb75dbc from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schewqhcq to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:28 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.63/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:28 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:28 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:28 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:30 kserve-ci-e2e-test attachdetach-controller Warning FailedAttachVolume Multi-Attach error for volume "pvc-1030d2a9-7a19-4fc9-acdf-cc609db07d6f" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1, llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:33 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:33 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:53 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheq5ghb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:53 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler-74d4bdc4c9 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheq5ghb to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:54 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.68/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:54 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:54 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:54 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:55 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:55 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:55 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:00 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:00 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche892mg to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:02 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.72/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:02 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:02 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:02 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:45 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:45 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:02 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche892mg [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:02 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler-79866dc455 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:31 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schegl226 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:31 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler-db4b86bf7 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schegl226 to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:31 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.41/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:31 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:31 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:31 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:32 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:32 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:32 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:27 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:40:27 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh7tf5 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler-5dd88bfbb7 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh7tf5 to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.51/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:18 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:51 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:19:51 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:25 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schekn728 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:25 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler-5f555d4d85 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schekn728 to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:25 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.60/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:25 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:25 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:25 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:30:27 kserve-ci-e2e-test attachdetach-controller Warning FailedAttachVolume Multi-Attach error for volume "pvc-1030d2a9-7a19-4fc9-acdf-cc609db07d6f" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dn94c5 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:32:35 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:32:35 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:41 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schelj9wz [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:41 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler-5bfc4d7c47 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schelj9wz to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:41 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.38/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:41 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:41 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:41 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:42 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:42 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:28:42 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:08 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:31:08 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche2ltdk to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:24 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.53/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:24 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:24 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:24 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:22:24 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:22:24 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:24 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche2ltdk [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:21:24 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler-6d86bd4d9d from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche967xd to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:00 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.61/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:00 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:00 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:00 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:04 kserve-ci-e2e-test attachdetach-controller Warning FailedAttachVolume Multi-Attach error for volume "pvc-1030d2a9-7a19-4fc9-acdf-cc609db07d6f" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-wzmhm, llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79qd8r2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:35:59 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:35:59 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:00 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche967xd [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:33:00 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler-67b4bb9646 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:22 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schepcljk [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:22 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler-68cc9685d6 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schepcljk to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:22 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.54/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:22 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:22 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:23:22 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:52 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:24:52 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche4x8qm to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:35 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.52/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:35 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:35 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:35 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:22:42 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:22:42 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:35 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche4x8qm [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:20:35 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler-749449dbc8 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-6854f6cbbc-zjrkk to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:50:59 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.52/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:50:59 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:50:59 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:50:59 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:03 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:03 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:03 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:52:18 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.52:8000/health": dial tcp 10.133.0.52:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:19 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:36 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.52:8000/health": context deadline exceeded [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:50:58 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: lora-multiple-adapters-test-kserve-6854f6cbbc-zjrkk [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:50:58 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set lora-multiple-adapters-test-kserve-6854f6cbbc from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:50:54 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy lora-multiple-adapters-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "lora-multiple-adapters-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:50:58 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:50:58 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/lora-multiple-adapters-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:50:58 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:50:58 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.HTTPRoute kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:50:58 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.DestinationRule kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:51:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:52:29 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [lora-multiple-adapters-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/lora-single-adapter-test-kserve-78f49d77c4-4brdb to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:15 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.50/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:15 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:15 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:15 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:19 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:20 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:20 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:49:35 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.50:8000/health": dial tcp 10.133.0.50:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:50:23 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:50:40 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.50:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:14 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: lora-single-adapter-test-kserve-78f49d77c4-4brdb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:14 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set lora-single-adapter-test-kserve-78f49d77c4 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:11 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy lora-single-adapter-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/lora-single-adapter-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "lora-single-adapter-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:14 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/lora-single-adapter-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:14 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/lora-single-adapter-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:14 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/lora-single-adapter-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:14 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.HTTPRoute kserve-ci-e2e-test/lora-single-adapter-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:14 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.DestinationRule kserve-ci-e2e-test/lora-single-adapter-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/lora-single-adapter-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:49:45 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [lora-single-adapter-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5bc9974d7f-fvh94 to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.49/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulling Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:34 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" in 4.555s (4.555s including waiting). Image size: 302212566 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:34 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:34 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:38 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulling Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:40 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.881s (1.881s including waiting). Image size: 98346788 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:40 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:40 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:42 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5bc9974d7f-qng2q to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.24/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:34 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:34 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:34 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:42 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:58 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.24:8000/health": dial tcp 10.133.0.24:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: precise-prefix-cache-test-kserve-5bc9974d7f-fvh94 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: precise-prefix-cache-test-kserve-5bc9974d7f-qng2q [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7744d6c72dt6s to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:30 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.50/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:30 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulling Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:34 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" in 4.064s (4.064s including waiting). Image size: 302212566 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:34 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:34 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:35 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulling Pulling image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:37 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Successfully pulled image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" in 1.393s (1.393s including waiting). Image size: 75073927 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:10 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:10 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:37 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulling Pulling image "ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:09 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Successfully pulled image "ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1" in 32.612s (32.612s including waiting). Image size: 2989890188 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:09 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: tokenizer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:09 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container tokenizer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:09 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:30 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning Unhealthy Liveness probe failed: timeout: failed to connect service "10.132.0.50:9003" within 1s: context deadline exceeded [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:42 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container tokenizer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:42 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:42 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: precise-prefix-cache-test-kserve-router-scheduler-7744d6c72dt6s [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set precise-prefix-cache-test-kserve-router-scheduler-7744d6c7d7 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set precise-prefix-cache-test-kserve-5bc9974d7f from 0 to 2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:25 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy precise-prefix-cache-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "precise-prefix-cache-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/precise-prefix-cache-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/precise-prefix-cache-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/precise-prefix-cache-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:57 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/precise-prefix-cache-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:57 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:40 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [precise-prefix-cache-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:42 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-596c6676c9-4cbkx to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:30 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.56/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:30 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:30 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:30 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:34 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:34 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:35 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:40 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.56:8000/health": dial tcp 10.133.0.56:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:48 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-596c6676c9-5gwxg to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:27 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.55/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:27 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:27 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:27 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:31 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:31 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:31 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:17 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.55:8000/health": dial tcp 10.133.0.55:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:30 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:26 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: prestop-hook-test-kserve-596c6676c9-5gwxg [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:30 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: prestop-hook-test-kserve-596c6676c9-4cbkx [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-56d5bcc4bd-xr42v to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:28 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedMount MountVolume.SetUp failed for volume "tls-certs" : failed to sync secret cache: timed out waiting for the condition [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:29 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.70/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:29 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:29 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:29 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:30 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:30 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:30 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:48 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:48 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:27 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: prestop-hook-test-kserve-router-scheduler-56d5bcc4bd-xr42v [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:27 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set prestop-hook-test-kserve-router-scheduler-56d5bcc4bd from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:26 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set prestop-hook-test-kserve-596c6676c9 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/prestop-hook-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/prestop-hook-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/prestop-hook-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/prestop-hook-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-prestop-hook-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/prestop-hook-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/prestop-hook-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/prestop-hook-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:54 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/prestop-hook-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:45 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/prestop-hook-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/prestop-hook-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:27 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [prestop-hook-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:35 kserve-ci-e2e-test LLMInferenceServiceController Warning LLMInferenceServiceNotReady LLMInferenceService [prestop-hook-test] is no longer Ready because of: MainWorkloadReady, WorkloadsReady [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:58:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-prestop-hook-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-5p2cd to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:08 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.48/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:08 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:08 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:08 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:12 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:07 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: rolling-upgrade-test-kserve-54bc76f55b-5p2cd [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-cclrx to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:11 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.58/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:11 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:11 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:11 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:28 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning FailedMount MountVolume.SetUp failed for volume "tls-certs" : secret "rolling-upgrade-test-kserve-self-signed-certs" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:14 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:11 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: rolling-upgrade-test-kserve-859df57bcb-cclrx [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-m92n4 to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:08 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.74/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:08 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:08 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:08 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:12 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:12 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:07 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-m92n4 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:07 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:07 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set rolling-upgrade-test-kserve-54bc76f55b from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:11 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set rolling-upgrade-test-kserve-859df57bcb from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:05 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy rolling-upgrade-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/rolling-upgrade-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "rolling-upgrade-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/rolling-upgrade-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/rolling-upgrade-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-rolling-upgrade-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/rolling-upgrade-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/rolling-upgrade-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/rolling-upgrade-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:46 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/rolling-upgrade-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:46 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:46 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/rolling-upgrade-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:48 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [rolling-upgrade-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:11 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-rolling-upgrade-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-5f8bbcf7c7-29zcg to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:16:50 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.47/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:16:50 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:16:50 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:16:50 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:05 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:07 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning Unhealthy Readiness probe failed: HTTP probe failed with statuscode: 503 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-5f8bbcf7c7-755f5 to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:45 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.25/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:45 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulling Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:47 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 2.678s (2.678s including waiting). Image size: 181251556 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:27:08 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:27:08 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:27:08 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:27:14 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "http://10.133.0.25:15021/healthz/ready": dial tcp 10.133.0.25:15021: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:16:50 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-gateway-1-openshift-default-5f8bbcf7c7-29zcg [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:05 kserve-ci-e2e-test replicaset-controller Normal SuccessfulDelete Deleted pod: router-gateway-1-openshift-default-5f8bbcf7c7-29zcg [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:44 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-gateway-1-openshift-default-5f8bbcf7c7-755f5 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-6679d9568-b62dj to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:02 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.62/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:02 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:02 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:02 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:05 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-6679d9568-blxjb to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:16:50 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.46/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:16:50 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:16:50 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:16:50 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:16:54 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-6679d9568-fn4fv to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:03 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.48/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:16 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:16 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:16 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:22 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning Unhealthy Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:49 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:53 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning Unhealthy Readiness probe failed: HTTP probe failed with statuscode: 503 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:18:08 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning Unhealthy Readiness probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-6679d9568-wpxqk to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:44 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.57/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:44 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:44 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:44 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:46 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:16:50 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-gateway-1-openshift-default-6679d9568-blxjb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:16:52 kserve-ci-e2e-test replicaset-controller Normal SuccessfulDelete Deleted pod: router-gateway-1-openshift-default-6679d9568-blxjb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:03 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-gateway-1-openshift-default-6679d9568-fn4fv [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:49 kserve-ci-e2e-test replicaset-controller Normal SuccessfulDelete Deleted pod: router-gateway-1-openshift-default-6679d9568-fn4fv [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:43 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-gateway-1-openshift-default-6679d9568-wpxqk [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:26:44 kserve-ci-e2e-test replicaset-controller Normal SuccessfulDelete Deleted pod: router-gateway-1-openshift-default-6679d9568-wpxqk [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:01 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-gateway-1-openshift-default-6679d9568-b62dj [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:03 kserve-ci-e2e-test replicaset-controller Normal SuccessfulDelete Deleted pod: router-gateway-1-openshift-default-6679d9568-b62dj [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:01 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set router-gateway-1-openshift-default-6679d9568 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:16:50 kserve-ci-e2e-test service-controller Normal EnsuringLoadBalancer Ensuring load balancer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:44 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set router-gateway-1-openshift-default-5f8bbcf7c7 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:03 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled down replica set router-gateway-1-openshift-default-6679d9568 from 1 to 0 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:16:54 kserve-ci-e2e-test service-controller Normal EnsuredLoadBalancer Ensured load balancer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:05 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled down replica set router-gateway-1-openshift-default-5f8bbcf7c7 from 1 to 0 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:01 kserve-ci-e2e-test gateway_labeler_controller Normal AddedLabel Added label istio.io/rev=openshift-gateway to gateway router-gateway-1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:17:44 kserve-ci-e2e-test GatewayAuthBootstrap Warning ReconcileError Failed to delete gateway PodMonitor: failed to delete PodMonitor: podmonitors.monitoring.coreos.com "router-gateway-1-metrics" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-5b6bc58868-98n7v to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:37 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.65/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:37 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:37 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:37 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:42 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:37 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-gateway-2-openshift-default-5b6bc58868-98n7v [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:42 kserve-ci-e2e-test replicaset-controller Normal SuccessfulDelete Deleted pod: router-gateway-2-openshift-default-5b6bc58868-98n7v [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-65d6b86cbf-m4ddf to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:40 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.66/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:52 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:52 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:52 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:57 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning Unhealthy Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:40 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-gateway-2-openshift-default-65d6b86cbf-m4ddf [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:37 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set router-gateway-2-openshift-default-5b6bc58868 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:37 kserve-ci-e2e-test service-controller Normal EnsuringLoadBalancer Ensuring load balancer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:40 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set router-gateway-2-openshift-default-65d6b86cbf from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:40 kserve-ci-e2e-test service-controller Normal EnsuredLoadBalancer Ensured load balancer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:42 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled down replica set router-gateway-2-openshift-default-5b6bc58868 from 1 to 0 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:37 kserve-ci-e2e-test gateway_labeler_controller Normal AddedLabel Added label istio.io/rev=openshift-gateway to gateway router-gateway-2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:36 kserve-ci-e2e-test GatewayAuthBootstrap Warning ReconcileError Failed to delete gateway PodMonitor: failed to delete PodMonitor: podmonitors.monitoring.coreos.com "router-gateway-2-metrics" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-5d4dd88bc4-5jk4k to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:27 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.48/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:27 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:27 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:27 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:28 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:28 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:28 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:32 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:32 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:32 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:17 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.48:8001/health": dial tcp 10.133.0.48:8001: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:36 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:36 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:26 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-with-refs-pd-test-kserve-5d4dd88bc4-5jk4k [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-6d9fbb969f-x899s to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:27 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.49/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:27 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:27 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:27 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:31 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:31 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:31 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:17 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.49:8000/health": dial tcp 10.133.0.49:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:36 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:26 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-with-refs-pd-test-kserve-prefill-6d9fbb969f-x899s [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:26 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set router-with-refs-pd-test-kserve-prefill-6d9fbb969f from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:27 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-with-refs-pd-test-kserve-router-scheduler-5fdb8f69cpvwr6 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5fdb8f69cpvwr6 to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:27 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.43/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:27 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:27 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:27 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:28 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:28 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:28 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:36 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:36 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:27 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set router-with-refs-pd-test-kserve-router-scheduler-5fdb8f69c5 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:26 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set router-with-refs-pd-test-kserve-5d4dd88bc4 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/router-with-refs-pd-test-kserve-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-pd-test-kserve-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/router-with-refs-pd-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-pd-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:42 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:27 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [router-with-refs-pd-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:36 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-7f59bb8c47-fvljx to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:29 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.39/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:30 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:30 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:30 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:34 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:34 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:34 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:29 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.39:8000/health": dial tcp 10.133.0.39:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:08 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:23 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.39:8000/health": dial tcp 10.133.0.39:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:29 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-with-refs-test-kserve-7f59bb8c47-fvljx [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-79fb5fd958-rvg9j to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:30 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.40/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:30 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:30 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:30 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:31 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:31 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:31 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:08 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:08 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:30 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-with-refs-test-kserve-router-scheduler-79fb5fd958-rvg9j [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:30 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set router-with-refs-test-kserve-router-scheduler-79fb5fd958 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:29 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set router-with-refs-test-kserve-7f59bb8c47 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/router-with-refs-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/router-with-refs-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/router-with-refs-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:31 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:34:36 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:36:56 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [router-with-refs-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:37:08 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-wn96c to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:07 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.47/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:07 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:07 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:07 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:40 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:55 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.134.0.47:8000/health": dial tcp 10.134.0.47:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:07 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-configmap-ref-test-kserve-744bf59fbd-wn96c [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:07 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-configmap-ref-test-kserve-router-scheduler-68f87wk8bj [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87wk8bj to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:07 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.73/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:08 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:08 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:08 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:40 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:40 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:07 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-configmap-ref-test-kserve-router-scheduler-68f876cc5d from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:07 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-configmap-ref-test-kserve-744bf59fbd from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:05 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-configmap-ref-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-configmap-ref-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:14 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:14 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:14 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:39 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [scheduler-configmap-ref-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:59:40 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-tj285 to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:41 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.50/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:41 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:41 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:41 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:29 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:41 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-custom-template-test-kserve-5bc7bd6864-tj285 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:41 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-custom-template-test-kserve-router-scheduler-56797bz4 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-56797bz4 to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:41 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.59/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:41 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulling Pulling image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:43 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Successfully pulled image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" in 1.091s (1.091s including waiting). Image size: 75073927 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:43 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:43 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:29 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:29 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:41 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-custom-template-test-kserve-router-scheduler-567469f665 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:41 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-custom-template-test-kserve-5bc7bd6864 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:37 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-custom-template-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-custom-template-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-custom-template-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/scheduler-custom-template-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-custom-template-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/scheduler-custom-template-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-custom-template-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-custom-template-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/scheduler-custom-template-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/scheduler-custom-template-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/scheduler-custom-template-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-custom-template-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/scheduler-custom-template-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-custom-template-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:27 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [scheduler-custom-template-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-custom-template-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-cfdk6 to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:19 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.57/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:19 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:19 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:19 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:12 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:28 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.57:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:19 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-ha-replicas-test-kserve-5c5cfcf776-cfdk6 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:19 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddc2mj [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:19 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dvvddt [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddc2mj to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:20 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.75/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:20 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:20 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:20 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:12 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:12 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dvvddt to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:20 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.49/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:20 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:20 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:20 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:12 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Warning Unhealthy Readiness probe failed: service unhealthy (responded with "NOT_SERVING") [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:12 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:12 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:19 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dbc4 from 0 to 2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:19 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-ha-replicas-test-kserve-5c5cfcf776 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:11 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-ha-replicas-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-ha-replicas-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:00:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:10 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:09 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:09 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:11 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [scheduler-ha-replicas-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:01:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-9nvf8 to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:56 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.45/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:56 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:56 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:56 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:57:30 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:56 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-inline-config-test-kserve-7c6c58cc96-9nvf8 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:56 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-inline-config-test-kserve-router-scheduler-d9ddfhlhw7 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddfhlhw7 to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:57 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.71/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:57 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:57 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:57 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:57:30 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:57:30 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:56 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-inline-config-test-kserve-router-scheduler-d9ddf6c4d from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:56 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-inline-config-test-kserve-7c6c58cc96 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:54 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-inline-config-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-inline-config-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-inline-config-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/scheduler-inline-config-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/scheduler-inline-config-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:57:04 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-inline-config-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:57:03 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:57:04 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:57:29 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [scheduler-inline-config-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:57:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4 to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.61/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:13 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:13 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:13 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.78/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-597gpth to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:13 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.52/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:13 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:13 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:13 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-v06-pd-migration-test-kserve-router-scheduler-597gpth [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-v06-pd-migration-test-kserve-router-scheduler-59dc679cd from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-v06-pd-migration-test-kserve-5c87756974 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:59 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-v06-pd-migration-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-v06-pd-migration-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-v06-pd-migration-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:45 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [scheduler-v06-pd-migration-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-8rx5k to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.51/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulling Pulling image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:47 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Successfully pulled image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" in 816ms (816ms including waiting). Image size: 44914394 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:47 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:47 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:47 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:47 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:47 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:34 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:34 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-v06-threshold-migration-test-kserve-5994569d5b-8rx5k [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-v06-threshold-migration-test-kserve-prefill-5fc5dp5cw [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5dp5cw to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.60/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:34 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-v06-threshold-migration-test-kserve-prefill-5fc599dc49 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedf228w to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.77/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:34 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:34 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-v06-threshold-migration-test-kserve-router-schedf228w [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-v06-threshold-migration-test-kserve-router-scheduler-dbc65f645 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-v06-threshold-migration-test-kserve-5994569d5b from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:43 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-v06-threshold-migration-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-v06-threshold-migration-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:45 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:45 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:45 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:46 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test0a07e82be2036793543b2d3db2ea0785-scheduler-v0 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:54 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:02:54 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:32 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [scheduler-v06-threshold-migration-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 19:03:33 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test0a07e82be2036793543b2d3db2ea0785-scheduler-v0 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-c58bf4d55-bsj5v to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:04 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.47/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:04 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:04 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:04 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:08 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:09 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:09 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:47:34 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.47:8000/health": dial tcp 10.133.0.47:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:47:45 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:48:01 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.47:8000/health": dial tcp 10.133.0.47:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-c58bf4d55-wfjpj to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:13 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.46/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:13 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:13 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:13 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:16 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:16 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:16 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:13 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.46:8000/health": dial tcp 10.133.0.46:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:24 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:40 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.46:8000/health": dial tcp 10.133.0.46:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:12 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: stop-feature-test-kserve-c58bf4d55-wfjpj [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:04 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: stop-feature-test-kserve-c58bf4d55-bsj5v [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-55ff964456-f7kl8 to ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:13 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.42/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:13 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:13 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:13 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:14 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:14 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:14 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:24 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:24 kserve-ci-e2e-test kubelet/ip-10-0-143-79.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-55ff964456-n74kh to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:04 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.67/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:04 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:04 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:04 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:05 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:05 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:05 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:47:45 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:47:45 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:12 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: stop-feature-test-kserve-router-scheduler-55ff964456-f7kl8 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:04 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: stop-feature-test-kserve-router-scheduler-55ff964456-n74kh [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:12 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set stop-feature-test-kserve-router-scheduler-55ff964456 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:04 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set stop-feature-test-kserve-router-scheduler-55ff964456 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:12 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set stop-feature-test-kserve-c58bf4d55 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:45:04 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set stop-feature-test-kserve-c58bf4d55 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:57 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy stop-feature-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "stop-feature-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-stop-feature-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/stop-feature-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/stop-feature-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/stop-feature-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:41:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:47:45 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [stop-feature-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.InferencePool kserve-ci-e2e-test/stop-feature-test-inference-pool [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:44:24 kserve-ci-e2e-test LLMInferenceServiceController Warning LLMInferenceServiceNotReady LLMInferenceService [stop-feature-test] is no longer Ready because of: GatewaysReady, HTTPRoutesReady, InferencePoolReady, MainWorkloadReady, PrefillWorkerWorkloadReady, PrefillWorkloadReady, RouterReady, SchedulerWorkloadReady, WorkerWorkloadReady, WorkloadsReady [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/tls-verification-test-kserve-66cd955d55-n7crl to ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:48 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.54/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:48 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:49 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:49 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:52 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:52 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:52 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:55:38 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.54:8000/health": dial tcp 10.133.0.54:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:55:54 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:56:09 kserve-ci-e2e-test kubelet/ip-10-0-140-224.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.54:8000/health": dial tcp 10.133.0.54:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:48 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: tls-verification-test-kserve-66cd955d55-n7crl [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-88bdffc4d-m27nj to ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:49 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.69/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:49 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:b9839fbb5a35566fd43a789a1664e735d3bfb6e56a5994a6c17ae0bb35a38e85" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:49 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:49 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:50 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:50 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:50 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:55:54 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:55:54 kserve-ci-e2e-test kubelet/ip-10-0-141-82.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:48 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: tls-verification-test-kserve-router-scheduler-88bdffc4d-m27nj [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:48 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set tls-verification-test-kserve-router-scheduler-88bdffc4d from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:48 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set tls-verification-test-kserve-66cd955d55 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:45 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy tls-verification-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/tls-verification-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "tls-verification-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/tls-verification-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/tls-verification-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/tls-verification-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/tls-verification-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-tls-verification-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/tls-verification-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/tls-verification-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:53:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/tls-verification-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:54:04 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/tls-verification-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:54:03 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/tls-verification-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:54:03 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/tls-verification-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:55:49 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [tls-verification-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-09 18:55:54 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-tls-verification-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:148 ### Pod scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4 (phase=Running) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:188 #### init-container 'llm-d-routing-sidecar' (restarts=0) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:201 # -- logs (current) -- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:202 Flag --decoder-use-tls has been deprecated, use --enable-tls=decoder instead [e2e-llm-inference-service] Flag --prefiller-use-tls has been deprecated, use --enable-tls=prefiller instead [e2e-llm-inference-service] {"level":"info","ts":1783623792.8620732,"msg":"Proxy starting","Built on":"v0.9.0-rc.2","From Git SHA":"181aa8358916e19b8844ccc752b2d6153d4b2ad6"} [e2e-llm-inference-service] {"level":"info","ts":1783623792.8621,"msg":"Proxy configuration","config":"{\"Port\":\"8000\",\"KVConnector\":\"nixlv2\",\"ECConnector\":\"\",\"DataParallelSize\":1,\"MaxIdleConnsPerHost\":1024,\"EnablePrefillerSampling\":false,\"PrefillMaxRetries\":0,\"PrefillRetryBackoff\":200000000,\"UseTLSForPrefiller\":true,\"UseTLSForDecoder\":true,\"UseTLSForEncoder\":false,\"InsecureSkipVerifyForPrefiller\":false,\"InsecureSkipVerifyForEncoder\":false,\"InsecureSkipVerifyForDecoder\":false,\"SecureServing\":true,\"CertPath\":\"/var/run/kserve/tls\",\"MooncakeBootstrapPort\":8998,\"EnableSSRFProtection\":true,\"InferencePoolNamespace\":\"kserve-ci-e2e-test\",\"InferencePoolName\":\"scheduler-v06-pd-migration-test-inference-pool\",\"PoolGroup\":\"inference.networking.x-k8s.io\",\"DecodeChunkSize\":0,\"Tracing\":false,\"MoRIIOWriteMode\":false,\"MoRIIODecodeNotifyPort\":61005,\"MoRIIODecodeHandshakePort\":6301,\"MoRIIODecodePodIP\":\"\",\"MoRIIOParallelDispatch\":false,\"MoRIIOPrefillHandshakePort\":6301,\"MoRIIOPrefillNotifyPort\":61005,\"MoRIIOTPSize\":1,\"MoRIIODPSize\":1,\"MoRIIORemoteHosts\":null,\"MoRIIODPSizeLocal\":0,\"MoRIIODecodeHosts\":null,\"DecoderURL\":\"https://localhost:8001\"}"} [e2e-llm-inference-service] {"level":"info","ts":1783623792.8632894,"logger":"allowlist-validator","msg":"starting SSRF protection allowlist validator","namespace":"kserve-ci-e2e-test","poolName":"scheduler-v06-pd-migration-test-inference-pool","gvr":"inference.networking.x-k8s.io/v1alpha2, Resource=inferencepools"} [e2e-llm-inference-service] {"level":"info","ts":1783623792.8759534,"logger":"allowlist-validator","msg":"InferencePool added","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783623792.882816,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":0,"targets":{}} [e2e-llm-inference-service] {"level":"info","ts":1783623792.8828707,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":0,"targets":{}} [e2e-llm-inference-service] {"level":"info","ts":1783623792.9640584,"logger":"allowlist-validator","msg":"allowlist validator started successfully"} [e2e-llm-inference-service] {"level":"info","ts":1783623792.965079,"logger":"proxy server on port 8000","msg":"server TLS configured"} [e2e-llm-inference-service] {"level":"info","ts":1783623792.9650939,"logger":"proxy server on port 8000","msg":"starting","addr":"[::]:8000"} [e2e-llm-inference-service] {"level":"info","ts":1783623793.1326442,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":2,"targets":{"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783623793.6437895,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783623794.1386828,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783623802.6725287,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783623802.6914673,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783623802.6946783,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783623802.7087142,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783623803.1893818,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783623822.8768163,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783623822.8860285,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783623822.886086,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] 2026/07/09 19:03:46 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783623826.5163,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"e96bf756-7bc8-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/09 19:03:46 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783623826.5359344,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"e96f3237-7bc8-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/09 19:03:50 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783623830.5555305,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"ebd48a0a-7bc8-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/09 19:03:58 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783623838.5757537,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"f09c5147-7bc8-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783623852.8770688,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783623852.886299,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783623852.8863752,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] 2026/07/09 19:04:14 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783623854.5988948,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"fa2912bc-7bc8-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783623882.877815,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783623882.8858778,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783623882.8859262,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] 2026/07/09 19:04:46 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783623886.623872,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"0d3fad7a-7bc9-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783623912.8784924,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783623912.8875952,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783623912.8876493,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783623942.8788793,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783623942.886958,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783623942.8870175,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] 2026/07/09 19:05:50 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783623950.674113,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"336cf9d6-7bc9-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783623972.8791835,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783623972.8887048,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783623972.8887577,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624002.880016,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624002.888693,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624002.8887491,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624032.8810022,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624032.8897138,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624032.8897772,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624062.8811724,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624062.889903,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624062.8899775,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] 2026/07/09 19:07:50 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624070.7289226,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"7afbfa92-7bc9-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783624092.8816955,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624092.89142,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624092.8914778,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624122.8821924,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624122.890723,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624122.8907897,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624152.882581,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624152.8919966,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624152.8920622,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624182.883165,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624182.8921764,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624182.8922431,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] 2026/07/09 19:09:50 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624190.7815394,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"c28a7d92-7bc9-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/09 19:09:55 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624195.8757622,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"c5940024-7bc9-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/09 19:09:55 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624195.8952415,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"c596f9c6-7bc9-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/09 19:09:59 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624199.9150417,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"c7fc4bb4-7bc9-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/09 19:10:07 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624207.9349885,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"ccc40b36-7bc9-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783624212.8842494,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624212.8923194,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624212.8924198,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] 2026/07/09 19:10:23 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624223.9592912,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"d650f323-7bc9-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783624242.8847718,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624242.8945854,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624242.8946383,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] 2026/07/09 19:10:55 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624255.9837906,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"e9676ca1-7bc9-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783624272.8853998,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624272.8933952,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624272.8934524,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624302.886181,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624302.8958368,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624302.8958936,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] 2026/07/09 19:12:00 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624320.0334978,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"0f94ae07-7bca-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783624332.8864846,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624332.8939922,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624332.8940423,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624362.8866978,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624362.8974223,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624362.8974807,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624392.8869646,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624392.8944545,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624392.8945036,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624422.887853,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624422.896576,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624422.8966463,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] 2026/07/09 19:14:00 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624440.0880737,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"57239ccf-7bca-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783624452.8888307,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624452.8964787,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624452.896534,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624482.8895054,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624482.898232,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624482.8982875,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624512.8900347,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624512.8976314,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624512.8976805,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624542.8905761,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624542.8996778,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624542.899732,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] 2026/07/09 19:16:00 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624560.142141,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"9eb27319-7bca-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/09 19:16:05 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624565.2663016,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"a1c07a53-7bca-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/09 19:16:05 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624565.2869668,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"a1c36dc5-7bca-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/09 19:16:09 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624569.307359,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"a42918f7-7bca-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783624572.8912623,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624572.898815,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624572.8988738,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] 2026/07/09 19:16:17 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624577.3281164,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"a8f0f86e-7bca-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/09 19:16:33 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624593.3517647,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"b27dbaad-7bca-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783624602.8919914,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624602.900427,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624602.9004836,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] 2026/07/09 19:17:05 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624625.3759127,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"c59446ae-7bca-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783624632.8930204,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624632.9021792,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624632.902231,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624662.89336,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624662.9016302,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624662.9016838,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] 2026/07/09 19:18:09 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624689.426765,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"ebc1b737-7bca-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783624692.8943074,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624692.9033139,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624692.903396,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624722.8944714,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624722.9030435,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624722.9030943,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624752.895159,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624752.9046483,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624752.9047074,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624782.8953428,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624782.9036636,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624782.9037206,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] 2026/07/09 19:20:09 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624809.4767845,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"334fdb54-7bcb-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783624812.896162,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624812.905041,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624812.9050934,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624842.8965225,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624842.904991,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624842.9050488,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624872.8966665,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624872.9067214,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624872.906789,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624902.8975894,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783624902.905896,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783624902.9059575,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.78":{},"10.133.0.61":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj":{}}} [e2e-llm-inference-service] 2026/07/09 19:22:09 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.132.0.78 [e2e-llm-inference-service] {"level":"error","ts":1783624929.5344582,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"7adf417f-7bcb-11f1-accf-0a580a85003d","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:188 #### container 'main' (restarts=0) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:201 # -- logs (current) -- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:202 I0709 19:03:13.180003 1 config.go:602] "Configuration:" =< [e2e-llm-inference-service] { [e2e-llm-inference-service] "IP": "", [e2e-llm-inference-service] "PodName": "", [e2e-llm-inference-service] "PodNameSpace": "", [e2e-llm-inference-service] "VllmDevMode": false, [e2e-llm-inference-service] "block-size": 16, [e2e-llm-inference-service] "data-parallel-rank": -1, [e2e-llm-inference-service] "data-parallel-size": 1, [e2e-llm-inference-service] "dataset-in-memory": false, [e2e-llm-inference-service] "dataset-path": "", [e2e-llm-inference-service] "dataset-table-name": "llmd", [e2e-llm-inference-service] "dataset-url": "", [e2e-llm-inference-service] "default-embedding-dimensions": 384, [e2e-llm-inference-service] "ec-transfer-config": "", [e2e-llm-inference-service] "enable-kvcache": false, [e2e-llm-inference-service] "enable-prefix-caching": false, [e2e-llm-inference-service] "enable-request-id-headers": false, [e2e-llm-inference-service] "enable-sleep-mode": false, [e2e-llm-inference-service] "enforce-eager": false, [e2e-llm-inference-service] "event-batch-size": 16, [e2e-llm-inference-service] "failure-injection-rate": 0, [e2e-llm-inference-service] "failure-types": null, [e2e-llm-inference-service] "fake-metrics": null, [e2e-llm-inference-service] "fake-metrics-refresh-interval": 100000000, [e2e-llm-inference-service] "global-cache-hit-threshold": 0, [e2e-llm-inference-service] "hash-seed": "", [e2e-llm-inference-service] "inter-token-latency": 0, [e2e-llm-inference-service] "inter-token-latency-std-dev": 0, [e2e-llm-inference-service] "kv-cache-size": 1024, [e2e-llm-inference-service] "kv-cache-transfer-latency": 0, [e2e-llm-inference-service] "kv-cache-transfer-latency-std-dev": 0, [e2e-llm-inference-service] "kv-cache-transfer-time-per-token": 0, [e2e-llm-inference-service] "kv-cache-transfer-time-std-dev": 0, [e2e-llm-inference-service] "latency-calculator": "", [e2e-llm-inference-service] "lora-modules": null, [e2e-llm-inference-service] "max-cpu-loras": 1, [e2e-llm-inference-service] "max-loras": 1, [e2e-llm-inference-service] "max-model-len": 1024, [e2e-llm-inference-service] "max-num-seqs": 5, [e2e-llm-inference-service] "max-tool-call-array-param-length": 5, [e2e-llm-inference-service] "max-tool-call-integer-param": 100, [e2e-llm-inference-service] "max-tool-call-number-param": 100, [e2e-llm-inference-service] "max-waiting-queue-length": 1000, [e2e-llm-inference-service] "min-tool-call-array-param-length": 1, [e2e-llm-inference-service] "min-tool-call-integer-param": 0, [e2e-llm-inference-service] "min-tool-call-number-param": 0, [e2e-llm-inference-service] "mm-encoder-only": false, [e2e-llm-inference-service] "mm-processor-kwargs": "", [e2e-llm-inference-service] "mode": "random", [e2e-llm-inference-service] "model": "facebook/opt-125m", [e2e-llm-inference-service] "object-tool-call-not-required-field-probability": 50, [e2e-llm-inference-service] "port": 8001, [e2e-llm-inference-service] "prefill-overhead": 0, [e2e-llm-inference-service] "prefill-time-per-token": 0, [e2e-llm-inference-service] "prefill-time-std-dev": 0, [e2e-llm-inference-service] "seed": 1783623793179467300, [e2e-llm-inference-service] "self-signed-certs": false, [e2e-llm-inference-service] "served-model-name": [ [e2e-llm-inference-service] "facebook/opt-125m" [e2e-llm-inference-service] ], [e2e-llm-inference-service] "ssl-certfile": "/var/run/kserve/tls/tls.crt", [e2e-llm-inference-service] "ssl-keyfile": "/var/run/kserve/tls/tls.key", [e2e-llm-inference-service] "time-factor-under-load": 1, [e2e-llm-inference-service] "time-to-first-token": 0, [e2e-llm-inference-service] "time-to-first-token-std-dev": 0, [e2e-llm-inference-service] "tool-call-not-required-param-probability": 50, [e2e-llm-inference-service] "uds-socket-path": "/tmp/tokenizer/tokenizer-uds.socket", [e2e-llm-inference-service] "zmq-endpoint": "tcp://127.0.0.1:5557" [e2e-llm-inference-service] } [e2e-llm-inference-service] > [e2e-llm-inference-service] I0709 19:03:13.212072 1 tokenizer.go:104] "Model is not a real HF model, using simulated tokenizer" model="facebook/opt-125m" [e2e-llm-inference-service] I0709 19:03:13.217215 1 context.go:138] "No dataset path or URL provided, using random text for responses" [e2e-llm-inference-service] I0709 19:03:13.217292 1 communication.go:49] "Starting communication layer" [e2e-llm-inference-service] I0709 19:03:13.217313 1 simulator.go:188] "Start processing routine" [e2e-llm-inference-service] I0709 19:03:13.217580 1 http_server_tls.go:44] "HTTPS server starting with certificate files" cert="/var/run/kserve/tls/tls.crt" key="/var/run/kserve/tls/tls.key" [e2e-llm-inference-service] I0709 19:03:13.217617 1 grpc.go:126] "Server starting" protocol="gRPC" port=8001 [e2e-llm-inference-service] I0709 19:03:13.218229 1 http.go:96] "Server starting" protocol="HTTPS" port=8001 [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:148 ### Pod scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj (phase=Running) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:188 #### container 'main' (restarts=0) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:201 # -- logs (current) -- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:202 I0709 19:03:12.891068 1 config.go:602] "Configuration:" =< [e2e-llm-inference-service] { [e2e-llm-inference-service] "IP": "", [e2e-llm-inference-service] "PodName": "", [e2e-llm-inference-service] "PodNameSpace": "", [e2e-llm-inference-service] "VllmDevMode": false, [e2e-llm-inference-service] "block-size": 16, [e2e-llm-inference-service] "data-parallel-rank": -1, [e2e-llm-inference-service] "data-parallel-size": 1, [e2e-llm-inference-service] "dataset-in-memory": false, [e2e-llm-inference-service] "dataset-path": "", [e2e-llm-inference-service] "dataset-table-name": "llmd", [e2e-llm-inference-service] "dataset-url": "", [e2e-llm-inference-service] "default-embedding-dimensions": 384, [e2e-llm-inference-service] "ec-transfer-config": "", [e2e-llm-inference-service] "enable-kvcache": false, [e2e-llm-inference-service] "enable-prefix-caching": false, [e2e-llm-inference-service] "enable-request-id-headers": false, [e2e-llm-inference-service] "enable-sleep-mode": false, [e2e-llm-inference-service] "enforce-eager": false, [e2e-llm-inference-service] "event-batch-size": 16, [e2e-llm-inference-service] "failure-injection-rate": 0, [e2e-llm-inference-service] "failure-types": null, [e2e-llm-inference-service] "fake-metrics": null, [e2e-llm-inference-service] "fake-metrics-refresh-interval": 100000000, [e2e-llm-inference-service] "global-cache-hit-threshold": 0, [e2e-llm-inference-service] "hash-seed": "", [e2e-llm-inference-service] "inter-token-latency": 0, [e2e-llm-inference-service] "inter-token-latency-std-dev": 0, [e2e-llm-inference-service] "kv-cache-size": 1024, [e2e-llm-inference-service] "kv-cache-transfer-latency": 0, [e2e-llm-inference-service] "kv-cache-transfer-latency-std-dev": 0, [e2e-llm-inference-service] "kv-cache-transfer-time-per-token": 0, [e2e-llm-inference-service] "kv-cache-transfer-time-std-dev": 0, [e2e-llm-inference-service] "latency-calculator": "", [e2e-llm-inference-service] "lora-modules": null, [e2e-llm-inference-service] "max-cpu-loras": 1, [e2e-llm-inference-service] "max-loras": 1, [e2e-llm-inference-service] "max-model-len": 1024, [e2e-llm-inference-service] "max-num-seqs": 5, [e2e-llm-inference-service] "max-tool-call-array-param-length": 5, [e2e-llm-inference-service] "max-tool-call-integer-param": 100, [e2e-llm-inference-service] "max-tool-call-number-param": 100, [e2e-llm-inference-service] "max-waiting-queue-length": 1000, [e2e-llm-inference-service] "min-tool-call-array-param-length": 1, [e2e-llm-inference-service] "min-tool-call-integer-param": 0, [e2e-llm-inference-service] "min-tool-call-number-param": 0, [e2e-llm-inference-service] "mm-encoder-only": false, [e2e-llm-inference-service] "mm-processor-kwargs": "", [e2e-llm-inference-service] "mode": "random", [e2e-llm-inference-service] "model": "facebook/opt-125m", [e2e-llm-inference-service] "object-tool-call-not-required-field-probability": 50, [e2e-llm-inference-service] "port": 8000, [e2e-llm-inference-service] "prefill-overhead": 0, [e2e-llm-inference-service] "prefill-time-per-token": 0, [e2e-llm-inference-service] "prefill-time-std-dev": 0, [e2e-llm-inference-service] "seed": 1783623792890626000, [e2e-llm-inference-service] "self-signed-certs": false, [e2e-llm-inference-service] "served-model-name": [ [e2e-llm-inference-service] "facebook/opt-125m" [e2e-llm-inference-service] ], [e2e-llm-inference-service] "ssl-certfile": "/var/run/kserve/tls/tls.crt", [e2e-llm-inference-service] "ssl-keyfile": "/var/run/kserve/tls/tls.key", [e2e-llm-inference-service] "time-factor-under-load": 1, [e2e-llm-inference-service] "time-to-first-token": 0, [e2e-llm-inference-service] "time-to-first-token-std-dev": 0, [e2e-llm-inference-service] "tool-call-not-required-param-probability": 50, [e2e-llm-inference-service] "uds-socket-path": "/tmp/tokenizer/tokenizer-uds.socket", [e2e-llm-inference-service] "zmq-endpoint": "tcp://127.0.0.1:5557" [e2e-llm-inference-service] } [e2e-llm-inference-service] > [e2e-llm-inference-service] I0709 19:03:12.925920 1 tokenizer.go:104] "Model is not a real HF model, using simulated tokenizer" model="facebook/opt-125m" [e2e-llm-inference-service] I0709 19:03:12.930513 1 context.go:138] "No dataset path or URL provided, using random text for responses" [e2e-llm-inference-service] I0709 19:03:12.930568 1 communication.go:49] "Starting communication layer" [e2e-llm-inference-service] I0709 19:03:12.930622 1 simulator.go:188] "Start processing routine" [e2e-llm-inference-service] I0709 19:03:12.930812 1 http_server_tls.go:44] "HTTPS server starting with certificate files" cert="/var/run/kserve/tls/tls.crt" key="/var/run/kserve/tls/tls.key" [e2e-llm-inference-service] I0709 19:03:12.930851 1 grpc.go:126] "Server starting" protocol="gRPC" port=8000 [e2e-llm-inference-service] I0709 19:03:12.931469 1 http.go:96] "Server starting" protocol="HTTPS" port=8000 [e2e-llm-inference-service] I0709 19:03:46.516297 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:53158\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:03:46.535978 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:53160\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:03:50.555599 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:53176\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:03:58.575818 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:48984\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:04:14.598969 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:37156\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:04:46.623951 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:38352\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:05:50.674164 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:33066\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:07:50.729026 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:56846\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:09:50.781670 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:60160\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:09:55.875872 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:50356\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:09:55.895361 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:50372\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:09:59.915150 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:50378\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:10:07.935136 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:40066\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:10:23.959417 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:56192\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:10:55.983944 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:33102\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:12:00.033644 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:59300\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:14:00.088089 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:46704\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:16:00.142202 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:39970\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:16:05.266367 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:33976\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:16:05.287045 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:33978\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:16:09.307458 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:33994\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:16:17.328201 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:34550\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:16:33.351857 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:48054\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:17:05.375928 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:52406\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:18:09.426926 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:43420\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:20:09.476852 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:32836\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0709 19:22:09.534502 1 communication.go:105] "Server error" msg="error when serving connection \"10.132.0.78:8000\"<->\"10.133.0.61:53312\": remote error: tls: bad certificate" [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:148 ### Pod scheduler-v06-pd-migration-test-kserve-router-scheduler-597gpth (phase=Running) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:188 #### container 'main' (restarts=0) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:201 # -- logs (current) -- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:202 } [e2e-llm-inference-service] ], [e2e-llm-inference-service] "InstrumentationScope": { [e2e-llm-inference-service] "Name": "llm-d-router/pkg/epp/framework/plugins/scheduling", [e2e-llm-inference-service] "Version": "v0.9.0-rc.2", [e2e-llm-inference-service] "SchemaURL": "", [e2e-llm-inference-service] "Attributes": [ [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "commit-sha", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "181aa8358916e19b8844ccc752b2d6153d4b2ad6" [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] ] [e2e-llm-inference-service] }, [e2e-llm-inference-service] "InstrumentationLibrary": { [e2e-llm-inference-service] "Name": "llm-d-router/pkg/epp/framework/plugins/scheduling", [e2e-llm-inference-service] "Version": "v0.9.0-rc.2", [e2e-llm-inference-service] "SchemaURL": "", [e2e-llm-inference-service] "Attributes": [ [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "commit-sha", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "181aa8358916e19b8844ccc752b2d6153d4b2ad6" [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] ] [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] { [e2e-llm-inference-service] "Name": "gateway.request_orchestration", [e2e-llm-inference-service] "SpanContext": { [e2e-llm-inference-service] "TraceID": "6e90c273b376f6d903c498cd9cf9884d", [e2e-llm-inference-service] "SpanID": "575bb5e858f227ae", [e2e-llm-inference-service] "TraceFlags": "01", [e2e-llm-inference-service] "TraceState": "", [e2e-llm-inference-service] "Remote": false [e2e-llm-inference-service] }, [e2e-llm-inference-service] "Parent": { [e2e-llm-inference-service] "TraceID": "6e90c273b376f6d903c498cd9cf9884d", [e2e-llm-inference-service] "SpanID": "58b8e8890b19e6c0", [e2e-llm-inference-service] "TraceFlags": "01", [e2e-llm-inference-service] "TraceState": "", [e2e-llm-inference-service] "Remote": false [e2e-llm-inference-service] }, [e2e-llm-inference-service] "SpanKind": 2, [e2e-llm-inference-service] "StartTime": "2026-07-09T19:18:09.410351093Z", [e2e-llm-inference-service] "EndTime": "2026-07-09T19:18:09.410509913Z", [e2e-llm-inference-service] "Attributes": [ [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "target_model", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "facebook/opt-125m" [e2e-llm-inference-service] } [e2e-llm-inference-service] }, [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "request_prio", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "INT64", [e2e-llm-inference-service] "Value": 0 [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] ], [e2e-llm-inference-service] "Events": null, [e2e-llm-inference-service] "Links": null, [e2e-llm-inference-service] "Status": { [e2e-llm-inference-service] "Code": "Unset", [e2e-llm-inference-service] "Description": "" [e2e-llm-inference-service] }, [e2e-llm-inference-service] "DroppedAttributes": 0, [e2e-llm-inference-service] "DroppedEvents": 0, [e2e-llm-inference-service] "DroppedLinks": 0, [e2e-llm-inference-service] "ChildSpanCount": 5, [e2e-llm-inference-service] "Resource": [ [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "service.name", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "llm-d-epp" [e2e-llm-inference-service] } [e2e-llm-inference-service] }, [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "service.version", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "v0.9.0-rc.2" [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] ], [e2e-llm-inference-service] "InstrumentationScope": { [e2e-llm-inference-service] "Name": "llm-d-router/pkg/epp/requestcontrol", [e2e-llm-inference-service] "Version": "v0.9.0-rc.2", [e2e-llm-inference-service] "SchemaURL": "", [e2e-llm-inference-service] "Attributes": [ [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "commit-sha", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "181aa8358916e19b8844ccc752b2d6153d4b2ad6" [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] ] [e2e-llm-inference-service] }, [e2e-llm-inference-service] "InstrumentationLibrary": { [e2e-llm-inference-service] "Name": "llm-d-router/pkg/epp/requestcontrol", [e2e-llm-inference-service] "Version": "v0.9.0-rc.2", [e2e-llm-inference-service] "SchemaURL": "", [e2e-llm-inference-service] "Attributes": [ [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "commit-sha", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "181aa8358916e19b8844ccc752b2d6153d4b2ad6" [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] ] [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] { [e2e-llm-inference-service] "Name": "gateway.request", [e2e-llm-inference-service] "SpanContext": { [e2e-llm-inference-service] "TraceID": "6e90c273b376f6d903c498cd9cf9884d", [e2e-llm-inference-service] "SpanID": "58b8e8890b19e6c0", [e2e-llm-inference-service] "TraceFlags": "01", [e2e-llm-inference-service] "TraceState": "", [e2e-llm-inference-service] "Remote": false [e2e-llm-inference-service] }, [e2e-llm-inference-service] "Parent": { [e2e-llm-inference-service] "TraceID": "00000000000000000000000000000000", [e2e-llm-inference-service] "SpanID": "0000000000000000", [e2e-llm-inference-service] "TraceFlags": "00", [e2e-llm-inference-service] "TraceState": "", [e2e-llm-inference-service] "Remote": false [e2e-llm-inference-service] }, [e2e-llm-inference-service] "SpanKind": 2, [e2e-llm-inference-service] "StartTime": "2026-07-09T19:18:09.410302507Z", [e2e-llm-inference-service] "EndTime": "2026-07-09T19:18:09.428133069Z", [e2e-llm-inference-service] "Attributes": null, [e2e-llm-inference-service] "Events": null, [e2e-llm-inference-service] "Links": null, [e2e-llm-inference-service] "Status": { [e2e-llm-inference-service] "Code": "Unset", [e2e-llm-inference-service] "Description": "" [e2e-llm-inference-service] }, [e2e-llm-inference-service] "DroppedAttributes": 0, [e2e-llm-inference-service] "DroppedEvents": 0, [e2e-llm-inference-service] "DroppedLinks": 0, [e2e-llm-inference-service] "ChildSpanCount": 1, [e2e-llm-inference-service] "Resource": [ [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "service.name", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "llm-d-epp" [e2e-llm-inference-service] } [e2e-llm-inference-service] }, [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "service.version", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "v0.9.0-rc.2" [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] ], [e2e-llm-inference-service] "InstrumentationScope": { [e2e-llm-inference-service] "Name": "llm-d-router/pkg/epp/handlers", [e2e-llm-inference-service] "Version": "v0.9.0-rc.2", [e2e-llm-inference-service] "SchemaURL": "", [e2e-llm-inference-service] "Attributes": [ [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "commit-sha", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "181aa8358916e19b8844ccc752b2d6153d4b2ad6" [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] ] [e2e-llm-inference-service] }, [e2e-llm-inference-service] "InstrumentationLibrary": { [e2e-llm-inference-service] "Name": "llm-d-router/pkg/epp/handlers", [e2e-llm-inference-service] "Version": "v0.9.0-rc.2", [e2e-llm-inference-service] "SchemaURL": "", [e2e-llm-inference-service] "Attributes": [ [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "commit-sha", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "181aa8358916e19b8844ccc752b2d6153d4b2ad6" [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] ] [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] {"level":"info","ts":1783624809.4601264,"caller":"handlers/server.go:395","msg":"EPP received request","x-request-id":"a45fd374-1ebb-4164-adc3-5577cfa2c9e5"} [e2e-llm-inference-service] {"level":"info","ts":1783624809.4604871,"caller":"handlers/server.go:656","msg":"EPP sent request body response(s) to proxy","x-request-id":"a45fd374-1ebb-4164-adc3-5577cfa2c9e5","modelName":"facebook/opt-125m","targetModelName":"facebook/opt-125m"} [e2e-llm-inference-service] {"level":"info","ts":1783624929.5175064,"caller":"handlers/server.go:395","msg":"EPP received request","x-request-id":"1682272b-b947-405f-8acd-00c1f092ab02"} [e2e-llm-inference-service] {"level":"info","ts":1783624929.5178094,"caller":"handlers/server.go:656","msg":"EPP sent request body response(s) to proxy","x-request-id":"1682272b-b947-405f-8acd-00c1f092ab02","modelName":"facebook/opt-125m","targetModelName":"facebook/opt-125m"} [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-service [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 159e552e-7699-4d6b-ba36-ff08b9e407ff [e2e-llm-inference-service] resourceVersion: '64784' [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] endpoints.kubernetes.io/managed-by: endpoint-controller [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] endpoints.kubernetes.io/last-change-trigger-time: '2026-07-09T19:03:45Z' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:45Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:endpoints.kubernetes.io/last-change-trigger-time: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:endpoints.kubernetes.io/managed-by: {} [e2e-llm-inference-service] f:subsets: {} [e2e-llm-inference-service] subsets: [e2e-llm-inference-service] - addresses: [e2e-llm-inference-service] - ip: 10.134.0.52 [e2e-llm-inference-service] nodeName: ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] targetRef: [e2e-llm-inference-service] kind: Pod [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-router-scheduler-597gpth [e2e-llm-inference-service] uid: 5d3ca42d-5a94-4458-b798-1441859d857c [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - name: grpc-health [e2e-llm-inference-service] port: 9003 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: metrics [e2e-llm-inference-service] port: 9090 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: zmq [e2e-llm-inference-service] port: 5557 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: grpc [e2e-llm-inference-service] port: 9002 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] kind: Endpoints [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: e391ced5-ec00-4c97-a27a-35454218b167 [e2e-llm-inference-service] resourceVersion: '64430' [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] endpoints.kubernetes.io/managed-by: endpoint-controller [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] endpoints.kubernetes.io/last-change-trigger-time: '2026-07-09T19:03:23Z' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:23Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:endpoints.kubernetes.io/last-change-trigger-time: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:endpoints.kubernetes.io/managed-by: {} [e2e-llm-inference-service] f:subsets: {} [e2e-llm-inference-service] subsets: [e2e-llm-inference-service] - addresses: [e2e-llm-inference-service] - ip: 10.132.0.78 [e2e-llm-inference-service] nodeName: ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] targetRef: [e2e-llm-inference-service] kind: Pod [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj [e2e-llm-inference-service] uid: ac168a80-a025-47b8-bf9d-7e8862b3b452 [e2e-llm-inference-service] - ip: 10.133.0.61 [e2e-llm-inference-service] nodeName: ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] targetRef: [e2e-llm-inference-service] kind: Pod [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4 [e2e-llm-inference-service] uid: 8b2f8683-e079-4829-bfbc-75e359df8dac [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - name: https [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] appProtocol: https [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] kind: Endpoints [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4 [e2e-llm-inference-service] generateName: scheduler-v06-pd-migration-test-kserve-5c87756974- [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 8b2f8683-e079-4829-bfbc-75e359df8dac [e2e-llm-inference-service] resourceVersion: '64429' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: decode [e2e-llm-inference-service] pod-template-hash: 5c87756974 [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] k8s.ovn.org/pod-networks: '{"default":{"ip_addresses":["10.133.0.61/23"],"mac_address":"0a:58:0a:85:00:3d","gateway_ips":["10.133.0.1"],"routes":[{"dest":"10.132.0.0/14","nextHop":"10.133.0.1"},{"dest":"172.31.0.0/16","nextHop":"10.133.0.1"},{"dest":"169.254.0.5/32","nextHop":"10.133.0.1"},{"dest":"100.64.0.0/16","nextHop":"10.133.0.1"}],"ip_address":"10.133.0.61/23","gateway_ip":"10.133.0.1","role":"primary"}}' [e2e-llm-inference-service] k8s.v1.cni.cncf.io/network-status: "[{\n \"name\": \"ovn-kubernetes\",\n \ [e2e-llm-inference-service] \ \"interface\": \"eth0\",\n \"ips\": [\n \"10.133.0.61\"\n ],\n\ [e2e-llm-inference-service] \ \"mac\": \"0a:58:0a:85:00:3d\",\n \"default\": true,\n \"dns\": {}\n\ [e2e-llm-inference-service] }]" [e2e-llm-inference-service] openshift.io/scc: restricted-v2 [e2e-llm-inference-service] seccomp.security.alpha.kubernetes.io/pod: runtime/default [e2e-llm-inference-service] security.openshift.io/validated-scc-subject-type: user [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: apps/v1 [e2e-llm-inference-service] kind: ReplicaSet [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-5c87756974 [e2e-llm-inference-service] uid: 280474d7-4b67-44c8-a240-df1feb2f1026 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: ip-10-0-140-224 [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] f:k8s.ovn.org/pod-networks: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:generateName: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:pod-template-hash: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"280474d7-4b67-44c8-a240-df1feb2f1026"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:containers: [e2e-llm-inference-service] k:{"name":"main"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:args: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"HF_HUB_CACHE"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"HOME"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"VLLM_LOGGING_LEVEL"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:lifecycle: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:preStop: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":8001,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:limits: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:requests: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:seccompProfile: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:startupProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/dev/shm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/models"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/tmp"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:dnsPolicy: {} [e2e-llm-inference-service] f:enableServiceLinks: {} [e2e-llm-inference-service] f:initContainers: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"llm-d-routing-sidecar"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"INFERENCE_POOL_NAME"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"INFERENCE_POOL_NAMESPACE"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:valueFrom: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:fieldRef: {} [e2e-llm-inference-service] k:{"name":"SSL_CERT_DIR"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":8000,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:schedulerName: {} [e2e-llm-inference-service] f:securityContext: {} [e2e-llm-inference-service] f:serviceAccount: {} [e2e-llm-inference-service] f:serviceAccountName: {} [e2e-llm-inference-service] f:terminationGracePeriodSeconds: {} [e2e-llm-inference-service] f:volumes: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"dshm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:medium: {} [e2e-llm-inference-service] f:sizeLimit: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"model-cache"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tls-certs"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:secret: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:defaultMode: {} [e2e-llm-inference-service] f:secretName: {} [e2e-llm-inference-service] k:{"name":"tmp-dir"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] - manager: multus-daemon [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] f:k8s.v1.cni.cncf.io/network-status: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] - manager: kubelet [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:23Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:conditions: [e2e-llm-inference-service] k:{"type":"ContainersReady"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"Initialized"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"PodReadyToStartContainers"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"PodScheduled"}: [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] k:{"type":"Ready"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:containerStatuses: {} [e2e-llm-inference-service] f:hostIP: {} [e2e-llm-inference-service] f:hostIPs: {} [e2e-llm-inference-service] f:initContainerStatuses: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:phase: {} [e2e-llm-inference-service] f:podIP: {} [e2e-llm-inference-service] f:podIPs: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"ip":"10.133.0.61"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:ip: {} [e2e-llm-inference-service] f:startTime: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] spec: [e2e-llm-inference-service] volumes: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] emptyDir: [e2e-llm-inference-service] medium: Memory [e2e-llm-inference-service] sizeLimit: 1Gi [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] secret: [e2e-llm-inference-service] secretName: scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] - name: kube-api-access-w887b [e2e-llm-inference-service] projected: [e2e-llm-inference-service] sources: [e2e-llm-inference-service] - serviceAccountToken: [e2e-llm-inference-service] expirationSeconds: 3607 [e2e-llm-inference-service] path: token [e2e-llm-inference-service] - configMap: [e2e-llm-inference-service] name: kube-root-ca.crt [e2e-llm-inference-service] items: [e2e-llm-inference-service] - key: ca.crt [e2e-llm-inference-service] path: ca.crt [e2e-llm-inference-service] - downwardAPI: [e2e-llm-inference-service] items: [e2e-llm-inference-service] - path: namespace [e2e-llm-inference-service] fieldRef: [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] fieldPath: metadata.namespace [e2e-llm-inference-service] - configMap: [e2e-llm-inference-service] name: openshift-service-ca.crt [e2e-llm-inference-service] items: [e2e-llm-inference-service] - key: service-ca.crt [e2e-llm-inference-service] path: service-ca.crt [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] initContainers: [e2e-llm-inference-service] - name: llm-d-routing-sidecar [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/pd-sidecar [e2e-llm-inference-service] - --port=8000 [e2e-llm-inference-service] - --vllm-port=8001 [e2e-llm-inference-service] - --kv-connector=nixlv2 [e2e-llm-inference-service] - --enable-ssrf-protection=true [e2e-llm-inference-service] - --pool-group=inference.networking.x-k8s.io [e2e-llm-inference-service] - --inference-pool=kserve-ci-e2e-test/scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] - --secure-proxy=true [e2e-llm-inference-service] - --cert-path=/var/run/kserve/tls [e2e-llm-inference-service] - --decoder-use-tls=true [e2e-llm-inference-service] - --prefiller-use-tls=true [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - containerPort: 8000 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: INFERENCE_POOL_NAMESPACE [e2e-llm-inference-service] valueFrom: [e2e-llm-inference-service] fieldRef: [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] fieldPath: metadata.namespace [e2e-llm-inference-service] - name: SSL_CERT_DIR [e2e-llm-inference-service] value: /var/run/kserve/tls:/var/run/secrets/kubernetes.io/serviceaccount:/etc/pki/tls/certs [e2e-llm-inference-service] - name: INFERENCE_POOL_NAME [e2e-llm-inference-service] value: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] resources: {} [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] - name: kube-api-access-w887b [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/secrets/kubernetes.io/serviceaccount [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] initialDelaySeconds: 10 [e2e-llm-inference-service] timeoutSeconds: 10 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 3 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] initialDelaySeconds: 10 [e2e-llm-inference-service] timeoutSeconds: 5 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 10 [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: FallbackToLogsOnError [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsUser: 1000710000 [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-inference-sim:v0.8.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/llm-d-inference-sim [e2e-llm-inference-service] args: [e2e-llm-inference-service] - --port [e2e-llm-inference-service] - '8001' [e2e-llm-inference-service] - --model [e2e-llm-inference-service] - facebook/opt-125m [e2e-llm-inference-service] - --mode [e2e-llm-inference-service] - random [e2e-llm-inference-service] - --ssl-certfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.crt [e2e-llm-inference-service] - --ssl-keyfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.key [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - containerPort: 8001 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: HOME [e2e-llm-inference-service] value: /home [e2e-llm-inference-service] - name: VLLM_LOGGING_LEVEL [e2e-llm-inference-service] value: INFO [e2e-llm-inference-service] - name: HF_HUB_CACHE [e2e-llm-inference-service] value: /models [e2e-llm-inference-service] resources: [e2e-llm-inference-service] limits: [e2e-llm-inference-service] cpu: '1' [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] mountPath: /home [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] mountPath: /tmp [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] mountPath: /dev/shm [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] mountPath: /models [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] - name: kube-api-access-w887b [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/secrets/kubernetes.io/serviceaccount [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8001 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 10 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8001 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 1 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 2 [e2e-llm-inference-service] startupProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8001 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 60 [e2e-llm-inference-service] lifecycle: [e2e-llm-inference-service] preStop: [e2e-llm-inference-service] exec: [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /bin/sleep [e2e-llm-inference-service] - '15' [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: FallbackToLogsOnError [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsUser: 1000710000 [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] terminationGracePeriodSeconds: 60 [e2e-llm-inference-service] dnsPolicy: ClusterFirst [e2e-llm-inference-service] serviceAccountName: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] serviceAccount: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] nodeName: ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] seLinuxOptions: [e2e-llm-inference-service] level: s0:c27,c4 [e2e-llm-inference-service] fsGroup: 1000710000 [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] imagePullSecrets: [e2e-llm-inference-service] - name: default-dockercfg-w96lf [e2e-llm-inference-service] - name: scheduler-v06-pd-migration-test-kserve-dockercfg-zxqsg [e2e-llm-inference-service] schedulerName: default-scheduler [e2e-llm-inference-service] tolerations: [e2e-llm-inference-service] - key: node.kubernetes.io/not-ready [e2e-llm-inference-service] operator: Exists [e2e-llm-inference-service] effect: NoExecute [e2e-llm-inference-service] tolerationSeconds: 300 [e2e-llm-inference-service] - key: node.kubernetes.io/unreachable [e2e-llm-inference-service] operator: Exists [e2e-llm-inference-service] effect: NoExecute [e2e-llm-inference-service] tolerationSeconds: 300 [e2e-llm-inference-service] - key: node.kubernetes.io/memory-pressure [e2e-llm-inference-service] operator: Exists [e2e-llm-inference-service] effect: NoSchedule [e2e-llm-inference-service] priority: 0 [e2e-llm-inference-service] enableServiceLinks: true [e2e-llm-inference-service] preemptionPolicy: PreemptLowerPriority [e2e-llm-inference-service] status: [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] phase: Running [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] - type: PodReadyToStartContainers [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] - type: Initialized [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] - type: Ready [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:23Z' [e2e-llm-inference-service] - type: ContainersReady [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:23Z' [e2e-llm-inference-service] - type: PodScheduled [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] hostIP: 10.0.140.224 [e2e-llm-inference-service] hostIPs: [e2e-llm-inference-service] - ip: 10.0.140.224 [e2e-llm-inference-service] podIP: 10.133.0.61 [e2e-llm-inference-service] podIPs: [e2e-llm-inference-service] - ip: 10.133.0.61 [e2e-llm-inference-service] startTime: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] initContainerStatuses: [e2e-llm-inference-service] - name: llm-d-routing-sidecar [e2e-llm-inference-service] state: [e2e-llm-inference-service] running: [e2e-llm-inference-service] startedAt: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] lastState: {} [e2e-llm-inference-service] ready: true [e2e-llm-inference-service] restartCount: 0 [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2 [e2e-llm-inference-service] imageID: ghcr.io/llm-d/llm-d-router-disagg-sidecar@sha256:1ec2c035216ea0a4f8a6f7ccda55398fc3d9f71f487c135f49ba0dea08163f12 [e2e-llm-inference-service] containerID: cri-o://afe57b550ddc9874b235ee0fa4aaaf89d83b7785a8d4a2390dafb2f9aa0d9cbc [e2e-llm-inference-service] started: true [e2e-llm-inference-service] resources: {} [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] recursiveReadOnly: Disabled [e2e-llm-inference-service] - name: kube-api-access-w887b [e2e-llm-inference-service] mountPath: /var/run/secrets/kubernetes.io/serviceaccount [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] recursiveReadOnly: Disabled [e2e-llm-inference-service] user: [e2e-llm-inference-service] linux: [e2e-llm-inference-service] uid: 1000710000 [e2e-llm-inference-service] gid: 0 [e2e-llm-inference-service] supplementalGroups: [e2e-llm-inference-service] - 0 [e2e-llm-inference-service] - 1000710000 [e2e-llm-inference-service] containerStatuses: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] state: [e2e-llm-inference-service] running: [e2e-llm-inference-service] startedAt: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] lastState: {} [e2e-llm-inference-service] ready: true [e2e-llm-inference-service] restartCount: 0 [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-inference-sim:v0.8.2 [e2e-llm-inference-service] imageID: ghcr.io/llm-d/llm-d-inference-sim@sha256:bab162bd25e2ed8b15022387cdb223023aeb33be49476af9f0115c0398fb8ff5 [e2e-llm-inference-service] containerID: cri-o://f00d0fb149069edac103556c5c8d0fd9a37670dbf786cdb4f0e3ed770f5c5c73 [e2e-llm-inference-service] started: true [e2e-llm-inference-service] allocatedResources: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] resources: [e2e-llm-inference-service] limits: [e2e-llm-inference-service] cpu: '1' [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] mountPath: /home [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] mountPath: /tmp [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] mountPath: /dev/shm [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] mountPath: /models [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] recursiveReadOnly: Disabled [e2e-llm-inference-service] - name: kube-api-access-w887b [e2e-llm-inference-service] mountPath: /var/run/secrets/kubernetes.io/serviceaccount [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] recursiveReadOnly: Disabled [e2e-llm-inference-service] user: [e2e-llm-inference-service] linux: [e2e-llm-inference-service] uid: 1000710000 [e2e-llm-inference-service] gid: 0 [e2e-llm-inference-service] supplementalGroups: [e2e-llm-inference-service] - 0 [e2e-llm-inference-service] - 1000710000 [e2e-llm-inference-service] qosClass: Burstable [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] kind: Pod [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj [e2e-llm-inference-service] generateName: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847- [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: ac168a80-a025-47b8-bf9d-7e8862b3b452 [e2e-llm-inference-service] resourceVersion: '64420' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload-prefill [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: prefill [e2e-llm-inference-service] pod-template-hash: 78b7f4c847 [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] k8s.ovn.org/pod-networks: '{"default":{"ip_addresses":["10.132.0.78/23"],"mac_address":"0a:58:0a:84:00:4e","gateway_ips":["10.132.0.1"],"routes":[{"dest":"10.132.0.0/14","nextHop":"10.132.0.1"},{"dest":"172.31.0.0/16","nextHop":"10.132.0.1"},{"dest":"169.254.0.5/32","nextHop":"10.132.0.1"},{"dest":"100.64.0.0/16","nextHop":"10.132.0.1"}],"ip_address":"10.132.0.78/23","gateway_ip":"10.132.0.1","role":"primary"}}' [e2e-llm-inference-service] k8s.v1.cni.cncf.io/network-status: "[{\n \"name\": \"ovn-kubernetes\",\n \ [e2e-llm-inference-service] \ \"interface\": \"eth0\",\n \"ips\": [\n \"10.132.0.78\"\n ],\n\ [e2e-llm-inference-service] \ \"mac\": \"0a:58:0a:84:00:4e\",\n \"default\": true,\n \"dns\": {}\n\ [e2e-llm-inference-service] }]" [e2e-llm-inference-service] openshift.io/scc: restricted-v2 [e2e-llm-inference-service] seccomp.security.alpha.kubernetes.io/pod: runtime/default [e2e-llm-inference-service] security.openshift.io/validated-scc-subject-type: user [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: apps/v1 [e2e-llm-inference-service] kind: ReplicaSet [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847 [e2e-llm-inference-service] uid: 5286171f-5b13-48cb-bc68-e62f8a411bc4 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: ip-10-0-141-82 [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] f:k8s.ovn.org/pod-networks: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:generateName: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:pod-template-hash: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"5286171f-5b13-48cb-bc68-e62f8a411bc4"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:containers: [e2e-llm-inference-service] k:{"name":"main"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:args: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"HF_HUB_CACHE"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"HOME"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"VLLM_LOGGING_LEVEL"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:lifecycle: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:preStop: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":8000,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:limits: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:requests: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:seccompProfile: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:startupProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/dev/shm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/models"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/tmp"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:dnsPolicy: {} [e2e-llm-inference-service] f:enableServiceLinks: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:schedulerName: {} [e2e-llm-inference-service] f:securityContext: {} [e2e-llm-inference-service] f:terminationGracePeriodSeconds: {} [e2e-llm-inference-service] f:volumes: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"dshm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:medium: {} [e2e-llm-inference-service] f:sizeLimit: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"model-cache"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tls-certs"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:secret: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:defaultMode: {} [e2e-llm-inference-service] f:secretName: {} [e2e-llm-inference-service] k:{"name":"tmp-dir"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] - manager: multus-daemon [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] f:k8s.v1.cni.cncf.io/network-status: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] - manager: kubelet [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:22Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:conditions: [e2e-llm-inference-service] k:{"type":"ContainersReady"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"Initialized"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"PodReadyToStartContainers"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"PodScheduled"}: [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] k:{"type":"Ready"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:containerStatuses: {} [e2e-llm-inference-service] f:hostIP: {} [e2e-llm-inference-service] f:hostIPs: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:phase: {} [e2e-llm-inference-service] f:podIP: {} [e2e-llm-inference-service] f:podIPs: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"ip":"10.132.0.78"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:ip: {} [e2e-llm-inference-service] f:startTime: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] spec: [e2e-llm-inference-service] volumes: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] emptyDir: [e2e-llm-inference-service] medium: Memory [e2e-llm-inference-service] sizeLimit: 1Gi [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] secret: [e2e-llm-inference-service] secretName: scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] - name: kube-api-access-cnz2m [e2e-llm-inference-service] projected: [e2e-llm-inference-service] sources: [e2e-llm-inference-service] - serviceAccountToken: [e2e-llm-inference-service] expirationSeconds: 3607 [e2e-llm-inference-service] path: token [e2e-llm-inference-service] - configMap: [e2e-llm-inference-service] name: kube-root-ca.crt [e2e-llm-inference-service] items: [e2e-llm-inference-service] - key: ca.crt [e2e-llm-inference-service] path: ca.crt [e2e-llm-inference-service] - downwardAPI: [e2e-llm-inference-service] items: [e2e-llm-inference-service] - path: namespace [e2e-llm-inference-service] fieldRef: [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] fieldPath: metadata.namespace [e2e-llm-inference-service] - configMap: [e2e-llm-inference-service] name: openshift-service-ca.crt [e2e-llm-inference-service] items: [e2e-llm-inference-service] - key: service-ca.crt [e2e-llm-inference-service] path: service-ca.crt [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-inference-sim:v0.8.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/llm-d-inference-sim [e2e-llm-inference-service] args: [e2e-llm-inference-service] - --port [e2e-llm-inference-service] - '8000' [e2e-llm-inference-service] - --model [e2e-llm-inference-service] - facebook/opt-125m [e2e-llm-inference-service] - --mode [e2e-llm-inference-service] - random [e2e-llm-inference-service] - --ssl-certfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.crt [e2e-llm-inference-service] - --ssl-keyfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.key [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - containerPort: 8000 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: HOME [e2e-llm-inference-service] value: /home [e2e-llm-inference-service] - name: VLLM_LOGGING_LEVEL [e2e-llm-inference-service] value: INFO [e2e-llm-inference-service] - name: HF_HUB_CACHE [e2e-llm-inference-service] value: /models [e2e-llm-inference-service] resources: [e2e-llm-inference-service] limits: [e2e-llm-inference-service] cpu: '1' [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] mountPath: /home [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] mountPath: /tmp [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] mountPath: /dev/shm [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] mountPath: /models [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] - name: kube-api-access-cnz2m [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/secrets/kubernetes.io/serviceaccount [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 10 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 1 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 2 [e2e-llm-inference-service] startupProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 60 [e2e-llm-inference-service] lifecycle: [e2e-llm-inference-service] preStop: [e2e-llm-inference-service] exec: [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /bin/sleep [e2e-llm-inference-service] - '15' [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: File [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsUser: 1000710000 [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] terminationGracePeriodSeconds: 60 [e2e-llm-inference-service] dnsPolicy: ClusterFirst [e2e-llm-inference-service] serviceAccountName: default [e2e-llm-inference-service] serviceAccount: default [e2e-llm-inference-service] nodeName: ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] seLinuxOptions: [e2e-llm-inference-service] level: s0:c27,c4 [e2e-llm-inference-service] fsGroup: 1000710000 [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] imagePullSecrets: [e2e-llm-inference-service] - name: default-dockercfg-w96lf [e2e-llm-inference-service] schedulerName: default-scheduler [e2e-llm-inference-service] tolerations: [e2e-llm-inference-service] - key: node.kubernetes.io/not-ready [e2e-llm-inference-service] operator: Exists [e2e-llm-inference-service] effect: NoExecute [e2e-llm-inference-service] tolerationSeconds: 300 [e2e-llm-inference-service] - key: node.kubernetes.io/unreachable [e2e-llm-inference-service] operator: Exists [e2e-llm-inference-service] effect: NoExecute [e2e-llm-inference-service] tolerationSeconds: 300 [e2e-llm-inference-service] - key: node.kubernetes.io/memory-pressure [e2e-llm-inference-service] operator: Exists [e2e-llm-inference-service] effect: NoSchedule [e2e-llm-inference-service] priority: 0 [e2e-llm-inference-service] enableServiceLinks: true [e2e-llm-inference-service] preemptionPolicy: PreemptLowerPriority [e2e-llm-inference-service] status: [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] phase: Running [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] - type: PodReadyToStartContainers [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] - type: Initialized [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] - type: Ready [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:22Z' [e2e-llm-inference-service] - type: ContainersReady [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:22Z' [e2e-llm-inference-service] - type: PodScheduled [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] hostIP: 10.0.141.82 [e2e-llm-inference-service] hostIPs: [e2e-llm-inference-service] - ip: 10.0.141.82 [e2e-llm-inference-service] podIP: 10.132.0.78 [e2e-llm-inference-service] podIPs: [e2e-llm-inference-service] - ip: 10.132.0.78 [e2e-llm-inference-service] startTime: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] containerStatuses: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] state: [e2e-llm-inference-service] running: [e2e-llm-inference-service] startedAt: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] lastState: {} [e2e-llm-inference-service] ready: true [e2e-llm-inference-service] restartCount: 0 [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-inference-sim:v0.8.2 [e2e-llm-inference-service] imageID: ghcr.io/llm-d/llm-d-inference-sim@sha256:bab162bd25e2ed8b15022387cdb223023aeb33be49476af9f0115c0398fb8ff5 [e2e-llm-inference-service] containerID: cri-o://a2c30a1a2a6a94250bbf07c037d19cd228bec7cbeb1ce9a900ab6ae7484c6aa8 [e2e-llm-inference-service] started: true [e2e-llm-inference-service] allocatedResources: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] resources: [e2e-llm-inference-service] limits: [e2e-llm-inference-service] cpu: '1' [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] mountPath: /home [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] mountPath: /tmp [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] mountPath: /dev/shm [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] mountPath: /models [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] recursiveReadOnly: Disabled [e2e-llm-inference-service] - name: kube-api-access-cnz2m [e2e-llm-inference-service] mountPath: /var/run/secrets/kubernetes.io/serviceaccount [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] recursiveReadOnly: Disabled [e2e-llm-inference-service] user: [e2e-llm-inference-service] linux: [e2e-llm-inference-service] uid: 1000710000 [e2e-llm-inference-service] gid: 0 [e2e-llm-inference-service] supplementalGroups: [e2e-llm-inference-service] - 0 [e2e-llm-inference-service] - 1000710000 [e2e-llm-inference-service] qosClass: Burstable [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] kind: Pod [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-router-scheduler-597gpth [e2e-llm-inference-service] generateName: scheduler-v06-pd-migration-test-kserve-router-scheduler-59dc679cd- [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 5d3ca42d-5a94-4458-b798-1441859d857c [e2e-llm-inference-service] resourceVersion: '64782' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] pod-template-hash: 59dc679cd [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] app.kubernetes.io/version: 0.9.0 [e2e-llm-inference-service] certificates.kserve.io/expiration-v2: 'true' [e2e-llm-inference-service] k8s.ovn.org/pod-networks: '{"default":{"ip_addresses":["10.134.0.52/23"],"mac_address":"0a:58:0a:86:00:34","gateway_ips":["10.134.0.1"],"routes":[{"dest":"10.132.0.0/14","nextHop":"10.134.0.1"},{"dest":"172.31.0.0/16","nextHop":"10.134.0.1"},{"dest":"169.254.0.5/32","nextHop":"10.134.0.1"},{"dest":"100.64.0.0/16","nextHop":"10.134.0.1"}],"ip_address":"10.134.0.52/23","gateway_ip":"10.134.0.1","role":"primary"}}' [e2e-llm-inference-service] k8s.v1.cni.cncf.io/network-status: "[{\n \"name\": \"ovn-kubernetes\",\n \ [e2e-llm-inference-service] \ \"interface\": \"eth0\",\n \"ips\": [\n \"10.134.0.52\"\n ],\n\ [e2e-llm-inference-service] \ \"mac\": \"0a:58:0a:86:00:34\",\n \"default\": true,\n \"dns\": {}\n\ [e2e-llm-inference-service] }]" [e2e-llm-inference-service] openshift.io/scc: restricted-v2 [e2e-llm-inference-service] seccomp.security.alpha.kubernetes.io/pod: runtime/default [e2e-llm-inference-service] security.openshift.io/validated-scc-subject-type: user [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: apps/v1 [e2e-llm-inference-service] kind: ReplicaSet [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-router-scheduler-59dc679cd [e2e-llm-inference-service] uid: 7a1d5383-f2a5-49cb-a2d0-400ce9969f04 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: ip-10-0-143-79 [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] f:k8s.ovn.org/pod-networks: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/version: {} [e2e-llm-inference-service] f:certificates.kserve.io/expiration-v2: {} [e2e-llm-inference-service] f:generateName: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:pod-template-hash: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"7a1d5383-f2a5-49cb-a2d0-400ce9969f04"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:containers: [e2e-llm-inference-service] k:{"name":"main"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:args: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"SSL_CERT_DIR"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:lifecycle: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:preStop: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:grpc: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:service: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":5557,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] k:{"containerPort":9002,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] k:{"containerPort":9003,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] k:{"containerPort":9090,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:grpc: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:service: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:requests: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:seccompProfile: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/tmp/tokenizer"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:dnsPolicy: {} [e2e-llm-inference-service] f:enableServiceLinks: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:schedulerName: {} [e2e-llm-inference-service] f:securityContext: {} [e2e-llm-inference-service] f:serviceAccount: {} [e2e-llm-inference-service] f:serviceAccountName: {} [e2e-llm-inference-service] f:terminationGracePeriodSeconds: {} [e2e-llm-inference-service] f:volumes: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"tls-certs"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:secret: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:defaultMode: {} [e2e-llm-inference-service] f:secretName: {} [e2e-llm-inference-service] k:{"name":"tokenizer-cache"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tokenizer-tmp"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tokenizer-uds"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] - manager: multus-daemon [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] f:k8s.v1.cni.cncf.io/network-status: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] - manager: kubelet [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:45Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:conditions: [e2e-llm-inference-service] k:{"type":"ContainersReady"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"Initialized"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"PodReadyToStartContainers"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"PodScheduled"}: [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] k:{"type":"Ready"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:containerStatuses: {} [e2e-llm-inference-service] f:hostIP: {} [e2e-llm-inference-service] f:hostIPs: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:phase: {} [e2e-llm-inference-service] f:podIP: {} [e2e-llm-inference-service] f:podIPs: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"ip":"10.134.0.52"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:ip: {} [e2e-llm-inference-service] f:startTime: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] spec: [e2e-llm-inference-service] volumes: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] secret: [e2e-llm-inference-service] secretName: scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] - name: tokenizer-uds [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tokenizer-tmp [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tokenizer-cache [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: kube-api-access-7qmng [e2e-llm-inference-service] projected: [e2e-llm-inference-service] sources: [e2e-llm-inference-service] - serviceAccountToken: [e2e-llm-inference-service] expirationSeconds: 3607 [e2e-llm-inference-service] path: token [e2e-llm-inference-service] - configMap: [e2e-llm-inference-service] name: kube-root-ca.crt [e2e-llm-inference-service] items: [e2e-llm-inference-service] - key: ca.crt [e2e-llm-inference-service] path: ca.crt [e2e-llm-inference-service] - downwardAPI: [e2e-llm-inference-service] items: [e2e-llm-inference-service] - path: namespace [e2e-llm-inference-service] fieldRef: [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] fieldPath: metadata.namespace [e2e-llm-inference-service] - configMap: [e2e-llm-inference-service] name: openshift-service-ca.crt [e2e-llm-inference-service] items: [e2e-llm-inference-service] - key: service-ca.crt [e2e-llm-inference-service] path: service-ca.crt [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/epp [e2e-llm-inference-service] - --pool-name [e2e-llm-inference-service] - scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] - --pool-namespace [e2e-llm-inference-service] - kserve-ci-e2e-test [e2e-llm-inference-service] - --zap-encoder [e2e-llm-inference-service] - json [e2e-llm-inference-service] - --grpc-port [e2e-llm-inference-service] - '9002' [e2e-llm-inference-service] - --grpc-health-port [e2e-llm-inference-service] - '9003' [e2e-llm-inference-service] - --enable-cert-reload=true [e2e-llm-inference-service] - --secure-serving=true [e2e-llm-inference-service] - --model-server-metrics-scheme=https [e2e-llm-inference-service] - --cert-path=/var/run/kserve/tls [e2e-llm-inference-service] args: [e2e-llm-inference-service] - --config-text [e2e-llm-inference-service] - "apiVersion: inference.networking.x-k8s.io/v1alpha1\nkind: EndpointPickerConfig\n\ [e2e-llm-inference-service] plugins:\n- type: disagg-headers-handler\n- type: prefill-filter\n- type: decode-filter\n\ [e2e-llm-inference-service] - type: always-disagg-pd-decider\n- parameters:\n deciders:\n prefill:\ [e2e-llm-inference-service] \ always-disagg-pd-decider\n type: disagg-profile-handler\n- type: prefix-cache-scorer\n\ [e2e-llm-inference-service] - type: queue-scorer\n- type: max-score-picker\nschedulingProfiles:\n- name:\ [e2e-llm-inference-service] \ prefill\n plugins:\n - pluginRef: prefill-filter\n - pluginRef: queue-scorer\n\ [e2e-llm-inference-service] \ weight: 2\n - pluginRef: prefix-cache-scorer\n weight: 3\n - pluginRef:\ [e2e-llm-inference-service] \ max-score-picker\n- name: decode\n plugins:\n - pluginRef: decode-filter\n\ [e2e-llm-inference-service] \ - pluginRef: queue-scorer\n weight: 2\n - pluginRef: prefix-cache-scorer\n\ [e2e-llm-inference-service] \ weight: 3\n - pluginRef: max-score-picker\n" [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - name: grpc [e2e-llm-inference-service] containerPort: 9002 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: grpc-health [e2e-llm-inference-service] containerPort: 9003 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: metrics [e2e-llm-inference-service] containerPort: 9090 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: zmq [e2e-llm-inference-service] containerPort: 5557 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: SSL_CERT_DIR [e2e-llm-inference-service] value: /var/run/kserve/tls:/var/run/secrets/kubernetes.io/serviceaccount:/etc/pki/tls/certs [e2e-llm-inference-service] resources: [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 256m [e2e-llm-inference-service] memory: 500Mi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] - name: tokenizer-uds [e2e-llm-inference-service] mountPath: /tmp/tokenizer [e2e-llm-inference-service] - name: kube-api-access-7qmng [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/secrets/kubernetes.io/serviceaccount [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] grpc: [e2e-llm-inference-service] port: 9003 [e2e-llm-inference-service] service: liveness [e2e-llm-inference-service] initialDelaySeconds: 5 [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 3 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] grpc: [e2e-llm-inference-service] port: 9003 [e2e-llm-inference-service] service: readiness [e2e-llm-inference-service] initialDelaySeconds: 30 [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 3 [e2e-llm-inference-service] lifecycle: [e2e-llm-inference-service] preStop: [e2e-llm-inference-service] exec: [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /bin/sleep [e2e-llm-inference-service] - '15' [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: FallbackToLogsOnError [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsUser: 1000710000 [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] terminationGracePeriodSeconds: 60 [e2e-llm-inference-service] dnsPolicy: ClusterFirst [e2e-llm-inference-service] serviceAccountName: scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] serviceAccount: scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] nodeName: ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] seLinuxOptions: [e2e-llm-inference-service] level: s0:c27,c4 [e2e-llm-inference-service] fsGroup: 1000710000 [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] imagePullSecrets: [e2e-llm-inference-service] - name: default-dockercfg-w96lf [e2e-llm-inference-service] - name: scheduler-v06-pd-migration-test-epp-sa-dockercfg-z4jw9 [e2e-llm-inference-service] schedulerName: default-scheduler [e2e-llm-inference-service] tolerations: [e2e-llm-inference-service] - key: node.kubernetes.io/not-ready [e2e-llm-inference-service] operator: Exists [e2e-llm-inference-service] effect: NoExecute [e2e-llm-inference-service] tolerationSeconds: 300 [e2e-llm-inference-service] - key: node.kubernetes.io/unreachable [e2e-llm-inference-service] operator: Exists [e2e-llm-inference-service] effect: NoExecute [e2e-llm-inference-service] tolerationSeconds: 300 [e2e-llm-inference-service] - key: node.kubernetes.io/memory-pressure [e2e-llm-inference-service] operator: Exists [e2e-llm-inference-service] effect: NoSchedule [e2e-llm-inference-service] priority: 0 [e2e-llm-inference-service] enableServiceLinks: true [e2e-llm-inference-service] preemptionPolicy: PreemptLowerPriority [e2e-llm-inference-service] status: [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] phase: Running [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] - type: PodReadyToStartContainers [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:14Z' [e2e-llm-inference-service] - type: Initialized [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] - type: Ready [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:45Z' [e2e-llm-inference-service] - type: ContainersReady [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:45Z' [e2e-llm-inference-service] - type: PodScheduled [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] hostIP: 10.0.143.79 [e2e-llm-inference-service] hostIPs: [e2e-llm-inference-service] - ip: 10.0.143.79 [e2e-llm-inference-service] podIP: 10.134.0.52 [e2e-llm-inference-service] podIPs: [e2e-llm-inference-service] - ip: 10.134.0.52 [e2e-llm-inference-service] startTime: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] containerStatuses: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] state: [e2e-llm-inference-service] running: [e2e-llm-inference-service] startedAt: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] lastState: {} [e2e-llm-inference-service] ready: true [e2e-llm-inference-service] restartCount: 0 [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2 [e2e-llm-inference-service] imageID: ghcr.io/llm-d/llm-d-router-endpoint-picker@sha256:06b6c75d77afd0e07053402752a9736c2dfbc12a306d0d37d963aac4c1d4e6a6 [e2e-llm-inference-service] containerID: cri-o://a3cab9d2bd17a2391fcf2e3f13b72af3473bc39be00ea51e41c4f3f48eb0041e [e2e-llm-inference-service] started: true [e2e-llm-inference-service] allocatedResources: [e2e-llm-inference-service] cpu: 256m [e2e-llm-inference-service] memory: 500Mi [e2e-llm-inference-service] resources: [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 256m [e2e-llm-inference-service] memory: 500Mi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] recursiveReadOnly: Disabled [e2e-llm-inference-service] - name: tokenizer-uds [e2e-llm-inference-service] mountPath: /tmp/tokenizer [e2e-llm-inference-service] - name: kube-api-access-7qmng [e2e-llm-inference-service] mountPath: /var/run/secrets/kubernetes.io/serviceaccount [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] recursiveReadOnly: Disabled [e2e-llm-inference-service] user: [e2e-llm-inference-service] linux: [e2e-llm-inference-service] uid: 1000710000 [e2e-llm-inference-service] gid: 0 [e2e-llm-inference-service] supplementalGroups: [e2e-llm-inference-service] - 0 [e2e-llm-inference-service] - 1000710000 [e2e-llm-inference-service] qosClass: Burstable [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] kind: Pod [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 3d2f20cb-971a-4ed1-b531-76e1017f6e10 [e2e-llm-inference-service] resourceVersion: '64146' [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] openshift.io/internal-registry-pull-secret-ref: scheduler-v06-pd-migration-test-epp-sa-dockercfg-z4jw9 [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: openshift.io/image-registry-pull-secrets_service-account-controller [e2e-llm-inference-service] operation: Apply [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:imagePullSecrets: {} [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] f:openshift.io/internal-registry-pull-secret-ref: {} [e2e-llm-inference-service] f:secrets: [e2e-llm-inference-service] k:{"name":"scheduler-v06-pd-migration-test-epp-sa-dockercfg-z4jw9"}: {} [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:secrets: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"default-dockercfg-w96lf"}: {} [e2e-llm-inference-service] k:{"name":"seaweedfs-s3-creds"}: {} [e2e-llm-inference-service] secrets: [e2e-llm-inference-service] - name: default-dockercfg-w96lf [e2e-llm-inference-service] - name: seaweedfs-s3-creds [e2e-llm-inference-service] - name: scheduler-v06-pd-migration-test-epp-sa-dockercfg-z4jw9 [e2e-llm-inference-service] imagePullSecrets: [e2e-llm-inference-service] - name: default-dockercfg-w96lf [e2e-llm-inference-service] - name: scheduler-v06-pd-migration-test-epp-sa-dockercfg-z4jw9 [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] kind: ServiceAccount [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 0ef587ba-d745-41c4-adca-3f59148697d1 [e2e-llm-inference-service] resourceVersion: '64098' [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] openshift.io/internal-registry-pull-secret-ref: scheduler-v06-pd-migration-test-kserve-dockercfg-zxqsg [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: openshift.io/image-registry-pull-secrets_service-account-controller [e2e-llm-inference-service] operation: Apply [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:imagePullSecrets: {} [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] f:openshift.io/internal-registry-pull-secret-ref: {} [e2e-llm-inference-service] f:secrets: [e2e-llm-inference-service] k:{"name":"scheduler-v06-pd-migration-test-kserve-dockercfg-zxqsg"}: {} [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:secrets: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"default-dockercfg-w96lf"}: {} [e2e-llm-inference-service] k:{"name":"seaweedfs-s3-creds"}: {} [e2e-llm-inference-service] secrets: [e2e-llm-inference-service] - name: default-dockercfg-w96lf [e2e-llm-inference-service] - name: seaweedfs-s3-creds [e2e-llm-inference-service] - name: scheduler-v06-pd-migration-test-kserve-dockercfg-zxqsg [e2e-llm-inference-service] imagePullSecrets: [e2e-llm-inference-service] - name: default-dockercfg-w96lf [e2e-llm-inference-service] - name: scheduler-v06-pd-migration-test-kserve-dockercfg-zxqsg [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] kind: ServiceAccount [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-service [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: ec40e646-8622-418a-ba75-27df7e2e17c2 [e2e-llm-inference-service] resourceVersion: '64163' [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:internalTrafficPolicy: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"port":5557,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:targetPort: {} [e2e-llm-inference-service] k:{"port":9002,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:targetPort: {} [e2e-llm-inference-service] k:{"port":9003,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:targetPort: {} [e2e-llm-inference-service] k:{"port":9090,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:targetPort: {} [e2e-llm-inference-service] f:selector: {} [e2e-llm-inference-service] f:sessionAffinity: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] spec: [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - name: grpc [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] port: 9002 [e2e-llm-inference-service] targetPort: grpc [e2e-llm-inference-service] - name: grpc-health [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] port: 9003 [e2e-llm-inference-service] targetPort: grpc-health [e2e-llm-inference-service] - name: metrics [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] port: 9090 [e2e-llm-inference-service] targetPort: metrics [e2e-llm-inference-service] - name: zmq [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] port: 5557 [e2e-llm-inference-service] targetPort: zmq [e2e-llm-inference-service] selector: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] clusterIP: 172.31.57.37 [e2e-llm-inference-service] clusterIPs: [e2e-llm-inference-service] - 172.31.57.37 [e2e-llm-inference-service] type: ClusterIP [e2e-llm-inference-service] sessionAffinity: None [e2e-llm-inference-service] ipFamilies: [e2e-llm-inference-service] - IPv4 [e2e-llm-inference-service] ipFamilyPolicy: SingleStack [e2e-llm-inference-service] internalTrafficPolicy: Cluster [e2e-llm-inference-service] status: [e2e-llm-inference-service] loadBalancer: {} [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 19840dc0-504d-40f5-add4-f1b21f338e8a [e2e-llm-inference-service] resourceVersion: '64116' [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:internalTrafficPolicy: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"port":8000,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:appProtocol: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:targetPort: {} [e2e-llm-inference-service] f:selector: {} [e2e-llm-inference-service] f:sessionAffinity: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] spec: [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - name: https [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] appProtocol: https [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] targetPort: 8000 [e2e-llm-inference-service] selector: [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] clusterIP: 172.31.174.189 [e2e-llm-inference-service] clusterIPs: [e2e-llm-inference-service] - 172.31.174.189 [e2e-llm-inference-service] type: ClusterIP [e2e-llm-inference-service] sessionAffinity: None [e2e-llm-inference-service] ipFamilies: [e2e-llm-inference-service] - IPv4 [e2e-llm-inference-service] ipFamilyPolicy: SingleStack [e2e-llm-inference-service] internalTrafficPolicy: Cluster [e2e-llm-inference-service] status: [e2e-llm-inference-service] loadBalancer: {} [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 943492f8-6117-4c33-b95a-021a2869882e [e2e-llm-inference-service] resourceVersion: '64433' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: decode [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] deployment.kubernetes.io/revision: '1' [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:progressDeadlineSeconds: {} [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] f:revisionHistoryLimit: {} [e2e-llm-inference-service] f:selector: {} [e2e-llm-inference-service] f:strategy: [e2e-llm-inference-service] f:rollingUpdate: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:maxSurge: {} [e2e-llm-inference-service] f:maxUnavailable: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:template: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:containers: [e2e-llm-inference-service] k:{"name":"main"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:args: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"HF_HUB_CACHE"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"HOME"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"VLLM_LOGGING_LEVEL"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:lifecycle: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:preStop: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":8001,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:limits: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:requests: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:seccompProfile: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:startupProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/dev/shm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/models"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/tmp"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:dnsPolicy: {} [e2e-llm-inference-service] f:initContainers: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"llm-d-routing-sidecar"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"INFERENCE_POOL_NAME"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"INFERENCE_POOL_NAMESPACE"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:valueFrom: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:fieldRef: {} [e2e-llm-inference-service] k:{"name":"SSL_CERT_DIR"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":8000,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:schedulerName: {} [e2e-llm-inference-service] f:securityContext: {} [e2e-llm-inference-service] f:serviceAccount: {} [e2e-llm-inference-service] f:serviceAccountName: {} [e2e-llm-inference-service] f:terminationGracePeriodSeconds: {} [e2e-llm-inference-service] f:volumes: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"dshm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:medium: {} [e2e-llm-inference-service] f:sizeLimit: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"model-cache"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tls-certs"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:secret: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:defaultMode: {} [e2e-llm-inference-service] f:secretName: {} [e2e-llm-inference-service] k:{"name":"tmp-dir"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:23Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/revision: {} [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:availableReplicas: {} [e2e-llm-inference-service] f:conditions: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"type":"Available"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:lastUpdateTime: {} [e2e-llm-inference-service] f:message: {} [e2e-llm-inference-service] f:reason: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"Progressing"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:lastUpdateTime: {} [e2e-llm-inference-service] f:message: {} [e2e-llm-inference-service] f:reason: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:readyReplicas: {} [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] f:updatedReplicas: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] spec: [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] selector: [e2e-llm-inference-service] matchLabels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: decode [e2e-llm-inference-service] template: [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: decode [e2e-llm-inference-service] spec: [e2e-llm-inference-service] volumes: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] emptyDir: [e2e-llm-inference-service] medium: Memory [e2e-llm-inference-service] sizeLimit: 1Gi [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] secret: [e2e-llm-inference-service] secretName: scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] initContainers: [e2e-llm-inference-service] - name: llm-d-routing-sidecar [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/pd-sidecar [e2e-llm-inference-service] - --port=8000 [e2e-llm-inference-service] - --vllm-port=8001 [e2e-llm-inference-service] - --kv-connector=nixlv2 [e2e-llm-inference-service] - --enable-ssrf-protection=true [e2e-llm-inference-service] - --pool-group=inference.networking.x-k8s.io [e2e-llm-inference-service] - --inference-pool=kserve-ci-e2e-test/scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] - --secure-proxy=true [e2e-llm-inference-service] - --cert-path=/var/run/kserve/tls [e2e-llm-inference-service] - --decoder-use-tls=true [e2e-llm-inference-service] - --prefiller-use-tls=true [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - containerPort: 8000 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: INFERENCE_POOL_NAMESPACE [e2e-llm-inference-service] valueFrom: [e2e-llm-inference-service] fieldRef: [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] fieldPath: metadata.namespace [e2e-llm-inference-service] - name: SSL_CERT_DIR [e2e-llm-inference-service] value: /var/run/kserve/tls:/var/run/secrets/kubernetes.io/serviceaccount:/etc/pki/tls/certs [e2e-llm-inference-service] - name: INFERENCE_POOL_NAME [e2e-llm-inference-service] value: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] resources: {} [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] initialDelaySeconds: 10 [e2e-llm-inference-service] timeoutSeconds: 10 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 3 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] initialDelaySeconds: 10 [e2e-llm-inference-service] timeoutSeconds: 5 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 10 [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: FallbackToLogsOnError [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-inference-sim:v0.8.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/llm-d-inference-sim [e2e-llm-inference-service] args: [e2e-llm-inference-service] - --port [e2e-llm-inference-service] - '8001' [e2e-llm-inference-service] - --model [e2e-llm-inference-service] - facebook/opt-125m [e2e-llm-inference-service] - --mode [e2e-llm-inference-service] - random [e2e-llm-inference-service] - --ssl-certfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.crt [e2e-llm-inference-service] - --ssl-keyfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.key [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - containerPort: 8001 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: HOME [e2e-llm-inference-service] value: /home [e2e-llm-inference-service] - name: VLLM_LOGGING_LEVEL [e2e-llm-inference-service] value: INFO [e2e-llm-inference-service] - name: HF_HUB_CACHE [e2e-llm-inference-service] value: /models [e2e-llm-inference-service] resources: [e2e-llm-inference-service] limits: [e2e-llm-inference-service] cpu: '1' [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] mountPath: /home [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] mountPath: /tmp [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] mountPath: /dev/shm [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] mountPath: /models [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8001 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 10 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8001 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 1 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 2 [e2e-llm-inference-service] startupProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8001 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 60 [e2e-llm-inference-service] lifecycle: [e2e-llm-inference-service] preStop: [e2e-llm-inference-service] exec: [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /bin/sleep [e2e-llm-inference-service] - '15' [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: FallbackToLogsOnError [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] terminationGracePeriodSeconds: 60 [e2e-llm-inference-service] dnsPolicy: ClusterFirst [e2e-llm-inference-service] serviceAccountName: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] serviceAccount: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] securityContext: {} [e2e-llm-inference-service] schedulerName: default-scheduler [e2e-llm-inference-service] strategy: [e2e-llm-inference-service] type: RollingUpdate [e2e-llm-inference-service] rollingUpdate: [e2e-llm-inference-service] maxUnavailable: 25% [e2e-llm-inference-service] maxSurge: 25% [e2e-llm-inference-service] revisionHistoryLimit: 10 [e2e-llm-inference-service] progressDeadlineSeconds: 600 [e2e-llm-inference-service] status: [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] updatedReplicas: 1 [e2e-llm-inference-service] readyReplicas: 1 [e2e-llm-inference-service] availableReplicas: 1 [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] - type: Available [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastUpdateTime: '2026-07-09T19:03:23Z' [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:23Z' [e2e-llm-inference-service] reason: MinimumReplicasAvailable [e2e-llm-inference-service] message: Deployment has minimum availability. [e2e-llm-inference-service] - type: Progressing [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastUpdateTime: '2026-07-09T19:03:23Z' [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] reason: NewReplicaSetAvailable [e2e-llm-inference-service] message: ReplicaSet "scheduler-v06-pd-migration-test-kserve-5c87756974" has successfully [e2e-llm-inference-service] progressed. [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] kind: Deployment [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-prefill [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 5aa10065-f2c2-41e8-8a21-5e012f3d0491 [e2e-llm-inference-service] resourceVersion: '64424' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload-prefill [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: prefill [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] deployment.kubernetes.io/revision: '1' [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:progressDeadlineSeconds: {} [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] f:revisionHistoryLimit: {} [e2e-llm-inference-service] f:selector: {} [e2e-llm-inference-service] f:strategy: [e2e-llm-inference-service] f:rollingUpdate: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:maxSurge: {} [e2e-llm-inference-service] f:maxUnavailable: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:template: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:containers: [e2e-llm-inference-service] k:{"name":"main"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:args: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"HF_HUB_CACHE"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"HOME"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"VLLM_LOGGING_LEVEL"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:lifecycle: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:preStop: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":8000,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:limits: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:requests: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:seccompProfile: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:startupProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/dev/shm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/models"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/tmp"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:dnsPolicy: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:schedulerName: {} [e2e-llm-inference-service] f:securityContext: {} [e2e-llm-inference-service] f:terminationGracePeriodSeconds: {} [e2e-llm-inference-service] f:volumes: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"dshm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:medium: {} [e2e-llm-inference-service] f:sizeLimit: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"model-cache"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tls-certs"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:secret: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:defaultMode: {} [e2e-llm-inference-service] f:secretName: {} [e2e-llm-inference-service] k:{"name":"tmp-dir"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:22Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/revision: {} [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:availableReplicas: {} [e2e-llm-inference-service] f:conditions: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"type":"Available"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:lastUpdateTime: {} [e2e-llm-inference-service] f:message: {} [e2e-llm-inference-service] f:reason: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"Progressing"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:lastUpdateTime: {} [e2e-llm-inference-service] f:message: {} [e2e-llm-inference-service] f:reason: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:readyReplicas: {} [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] f:updatedReplicas: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] spec: [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] selector: [e2e-llm-inference-service] matchLabels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload-prefill [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: prefill [e2e-llm-inference-service] template: [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload-prefill [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: prefill [e2e-llm-inference-service] spec: [e2e-llm-inference-service] volumes: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] emptyDir: [e2e-llm-inference-service] medium: Memory [e2e-llm-inference-service] sizeLimit: 1Gi [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] secret: [e2e-llm-inference-service] secretName: scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-inference-sim:v0.8.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/llm-d-inference-sim [e2e-llm-inference-service] args: [e2e-llm-inference-service] - --port [e2e-llm-inference-service] - '8000' [e2e-llm-inference-service] - --model [e2e-llm-inference-service] - facebook/opt-125m [e2e-llm-inference-service] - --mode [e2e-llm-inference-service] - random [e2e-llm-inference-service] - --ssl-certfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.crt [e2e-llm-inference-service] - --ssl-keyfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.key [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - containerPort: 8000 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: HOME [e2e-llm-inference-service] value: /home [e2e-llm-inference-service] - name: VLLM_LOGGING_LEVEL [e2e-llm-inference-service] value: INFO [e2e-llm-inference-service] - name: HF_HUB_CACHE [e2e-llm-inference-service] value: /models [e2e-llm-inference-service] resources: [e2e-llm-inference-service] limits: [e2e-llm-inference-service] cpu: '1' [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] mountPath: /home [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] mountPath: /tmp [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] mountPath: /dev/shm [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] mountPath: /models [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 10 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 1 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 2 [e2e-llm-inference-service] startupProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 60 [e2e-llm-inference-service] lifecycle: [e2e-llm-inference-service] preStop: [e2e-llm-inference-service] exec: [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /bin/sleep [e2e-llm-inference-service] - '15' [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: File [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] terminationGracePeriodSeconds: 60 [e2e-llm-inference-service] dnsPolicy: ClusterFirst [e2e-llm-inference-service] securityContext: {} [e2e-llm-inference-service] schedulerName: default-scheduler [e2e-llm-inference-service] strategy: [e2e-llm-inference-service] type: RollingUpdate [e2e-llm-inference-service] rollingUpdate: [e2e-llm-inference-service] maxUnavailable: 25% [e2e-llm-inference-service] maxSurge: 25% [e2e-llm-inference-service] revisionHistoryLimit: 10 [e2e-llm-inference-service] progressDeadlineSeconds: 600 [e2e-llm-inference-service] status: [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] updatedReplicas: 1 [e2e-llm-inference-service] readyReplicas: 1 [e2e-llm-inference-service] availableReplicas: 1 [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] - type: Available [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastUpdateTime: '2026-07-09T19:03:22Z' [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:22Z' [e2e-llm-inference-service] reason: MinimumReplicasAvailable [e2e-llm-inference-service] message: Deployment has minimum availability. [e2e-llm-inference-service] - type: Progressing [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastUpdateTime: '2026-07-09T19:03:22Z' [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] reason: NewReplicaSetAvailable [e2e-llm-inference-service] message: ReplicaSet "scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847" [e2e-llm-inference-service] has successfully progressed. [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] kind: Deployment [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-router-scheduler [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 61555698-bdcc-4d5b-a0b4-ef096692ebd3 [e2e-llm-inference-service] resourceVersion: '64786' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] deployment.kubernetes.io/revision: '1' [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:progressDeadlineSeconds: {} [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] f:revisionHistoryLimit: {} [e2e-llm-inference-service] f:selector: {} [e2e-llm-inference-service] f:strategy: [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:template: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/version: {} [e2e-llm-inference-service] f:certificates.kserve.io/expiration-v2: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:containers: [e2e-llm-inference-service] k:{"name":"main"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:args: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"SSL_CERT_DIR"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:lifecycle: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:preStop: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:grpc: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:service: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":5557,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] k:{"containerPort":9002,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] k:{"containerPort":9003,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] k:{"containerPort":9090,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:grpc: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:service: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:requests: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:seccompProfile: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/tmp/tokenizer"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:dnsPolicy: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:schedulerName: {} [e2e-llm-inference-service] f:securityContext: {} [e2e-llm-inference-service] f:serviceAccount: {} [e2e-llm-inference-service] f:serviceAccountName: {} [e2e-llm-inference-service] f:terminationGracePeriodSeconds: {} [e2e-llm-inference-service] f:volumes: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"tls-certs"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:secret: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:defaultMode: {} [e2e-llm-inference-service] f:secretName: {} [e2e-llm-inference-service] k:{"name":"tokenizer-cache"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tokenizer-tmp"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tokenizer-uds"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:45Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/revision: {} [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:availableReplicas: {} [e2e-llm-inference-service] f:conditions: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"type":"Available"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:lastUpdateTime: {} [e2e-llm-inference-service] f:message: {} [e2e-llm-inference-service] f:reason: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"Progressing"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:lastUpdateTime: {} [e2e-llm-inference-service] f:message: {} [e2e-llm-inference-service] f:reason: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:readyReplicas: {} [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] f:updatedReplicas: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] spec: [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] selector: [e2e-llm-inference-service] matchLabels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] template: [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] app.kubernetes.io/version: 0.9.0 [e2e-llm-inference-service] certificates.kserve.io/expiration-v2: 'true' [e2e-llm-inference-service] spec: [e2e-llm-inference-service] volumes: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] secret: [e2e-llm-inference-service] secretName: scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] - name: tokenizer-uds [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tokenizer-tmp [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tokenizer-cache [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/epp [e2e-llm-inference-service] - --pool-name [e2e-llm-inference-service] - scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] - --pool-namespace [e2e-llm-inference-service] - kserve-ci-e2e-test [e2e-llm-inference-service] - --zap-encoder [e2e-llm-inference-service] - json [e2e-llm-inference-service] - --grpc-port [e2e-llm-inference-service] - '9002' [e2e-llm-inference-service] - --grpc-health-port [e2e-llm-inference-service] - '9003' [e2e-llm-inference-service] - --enable-cert-reload=true [e2e-llm-inference-service] - --secure-serving=true [e2e-llm-inference-service] - --model-server-metrics-scheme=https [e2e-llm-inference-service] - --cert-path=/var/run/kserve/tls [e2e-llm-inference-service] args: [e2e-llm-inference-service] - --config-text [e2e-llm-inference-service] - "apiVersion: inference.networking.x-k8s.io/v1alpha1\nkind: EndpointPickerConfig\n\ [e2e-llm-inference-service] plugins:\n- type: disagg-headers-handler\n- type: prefill-filter\n- type:\ [e2e-llm-inference-service] \ decode-filter\n- type: always-disagg-pd-decider\n- parameters:\n deciders:\n\ [e2e-llm-inference-service] \ prefill: always-disagg-pd-decider\n type: disagg-profile-handler\n\ [e2e-llm-inference-service] - type: prefix-cache-scorer\n- type: queue-scorer\n- type: max-score-picker\n\ [e2e-llm-inference-service] schedulingProfiles:\n- name: prefill\n plugins:\n - pluginRef: prefill-filter\n\ [e2e-llm-inference-service] \ - pluginRef: queue-scorer\n weight: 2\n - pluginRef: prefix-cache-scorer\n\ [e2e-llm-inference-service] \ weight: 3\n - pluginRef: max-score-picker\n- name: decode\n plugins:\n\ [e2e-llm-inference-service] \ - pluginRef: decode-filter\n - pluginRef: queue-scorer\n weight:\ [e2e-llm-inference-service] \ 2\n - pluginRef: prefix-cache-scorer\n weight: 3\n - pluginRef: max-score-picker\n" [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - name: grpc [e2e-llm-inference-service] containerPort: 9002 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: grpc-health [e2e-llm-inference-service] containerPort: 9003 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: metrics [e2e-llm-inference-service] containerPort: 9090 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: zmq [e2e-llm-inference-service] containerPort: 5557 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: SSL_CERT_DIR [e2e-llm-inference-service] value: /var/run/kserve/tls:/var/run/secrets/kubernetes.io/serviceaccount:/etc/pki/tls/certs [e2e-llm-inference-service] resources: [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 256m [e2e-llm-inference-service] memory: 500Mi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] - name: tokenizer-uds [e2e-llm-inference-service] mountPath: /tmp/tokenizer [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] grpc: [e2e-llm-inference-service] port: 9003 [e2e-llm-inference-service] service: liveness [e2e-llm-inference-service] initialDelaySeconds: 5 [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 3 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] grpc: [e2e-llm-inference-service] port: 9003 [e2e-llm-inference-service] service: readiness [e2e-llm-inference-service] initialDelaySeconds: 30 [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 3 [e2e-llm-inference-service] lifecycle: [e2e-llm-inference-service] preStop: [e2e-llm-inference-service] exec: [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /bin/sleep [e2e-llm-inference-service] - '15' [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: FallbackToLogsOnError [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] terminationGracePeriodSeconds: 60 [e2e-llm-inference-service] dnsPolicy: ClusterFirst [e2e-llm-inference-service] serviceAccountName: scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] serviceAccount: scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] securityContext: {} [e2e-llm-inference-service] schedulerName: default-scheduler [e2e-llm-inference-service] strategy: [e2e-llm-inference-service] type: Recreate [e2e-llm-inference-service] revisionHistoryLimit: 10 [e2e-llm-inference-service] progressDeadlineSeconds: 600 [e2e-llm-inference-service] status: [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] updatedReplicas: 1 [e2e-llm-inference-service] readyReplicas: 1 [e2e-llm-inference-service] availableReplicas: 1 [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] - type: Available [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastUpdateTime: '2026-07-09T19:03:45Z' [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:45Z' [e2e-llm-inference-service] reason: MinimumReplicasAvailable [e2e-llm-inference-service] message: Deployment has minimum availability. [e2e-llm-inference-service] - type: Progressing [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastUpdateTime: '2026-07-09T19:03:45Z' [e2e-llm-inference-service] lastTransitionTime: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] reason: NewReplicaSetAvailable [e2e-llm-inference-service] message: ReplicaSet "scheduler-v06-pd-migration-test-kserve-router-scheduler-59dc679cd" [e2e-llm-inference-service] has successfully progressed. [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] kind: Deployment [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-5c87756974 [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 280474d7-4b67-44c8-a240-df1feb2f1026 [e2e-llm-inference-service] resourceVersion: '64432' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: decode [e2e-llm-inference-service] pod-template-hash: 5c87756974 [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] deployment.kubernetes.io/desired-replicas: '1' [e2e-llm-inference-service] deployment.kubernetes.io/max-replicas: '2' [e2e-llm-inference-service] deployment.kubernetes.io/revision: '1' [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: apps/v1 [e2e-llm-inference-service] kind: Deployment [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] uid: 943492f8-6117-4c33-b95a-021a2869882e [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/desired-replicas: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/max-replicas: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/revision: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:pod-template-hash: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"943492f8-6117-4c33-b95a-021a2869882e"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] f:selector: {} [e2e-llm-inference-service] f:template: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:pod-template-hash: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:containers: [e2e-llm-inference-service] k:{"name":"main"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:args: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"HF_HUB_CACHE"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"HOME"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"VLLM_LOGGING_LEVEL"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:lifecycle: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:preStop: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":8001,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:limits: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:requests: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:seccompProfile: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:startupProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/dev/shm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/models"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/tmp"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:dnsPolicy: {} [e2e-llm-inference-service] f:initContainers: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"llm-d-routing-sidecar"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"INFERENCE_POOL_NAME"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"INFERENCE_POOL_NAMESPACE"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:valueFrom: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:fieldRef: {} [e2e-llm-inference-service] k:{"name":"SSL_CERT_DIR"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":8000,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:schedulerName: {} [e2e-llm-inference-service] f:securityContext: {} [e2e-llm-inference-service] f:serviceAccount: {} [e2e-llm-inference-service] f:serviceAccountName: {} [e2e-llm-inference-service] f:terminationGracePeriodSeconds: {} [e2e-llm-inference-service] f:volumes: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"dshm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:medium: {} [e2e-llm-inference-service] f:sizeLimit: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"model-cache"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tls-certs"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:secret: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:defaultMode: {} [e2e-llm-inference-service] f:secretName: {} [e2e-llm-inference-service] k:{"name":"tmp-dir"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:23Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:availableReplicas: {} [e2e-llm-inference-service] f:fullyLabeledReplicas: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:readyReplicas: {} [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] spec: [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] selector: [e2e-llm-inference-service] matchLabels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: decode [e2e-llm-inference-service] pod-template-hash: 5c87756974 [e2e-llm-inference-service] template: [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: decode [e2e-llm-inference-service] pod-template-hash: 5c87756974 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] volumes: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] emptyDir: [e2e-llm-inference-service] medium: Memory [e2e-llm-inference-service] sizeLimit: 1Gi [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] secret: [e2e-llm-inference-service] secretName: scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] initContainers: [e2e-llm-inference-service] - name: llm-d-routing-sidecar [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/pd-sidecar [e2e-llm-inference-service] - --port=8000 [e2e-llm-inference-service] - --vllm-port=8001 [e2e-llm-inference-service] - --kv-connector=nixlv2 [e2e-llm-inference-service] - --enable-ssrf-protection=true [e2e-llm-inference-service] - --pool-group=inference.networking.x-k8s.io [e2e-llm-inference-service] - --inference-pool=kserve-ci-e2e-test/scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] - --secure-proxy=true [e2e-llm-inference-service] - --cert-path=/var/run/kserve/tls [e2e-llm-inference-service] - --decoder-use-tls=true [e2e-llm-inference-service] - --prefiller-use-tls=true [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - containerPort: 8000 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: INFERENCE_POOL_NAMESPACE [e2e-llm-inference-service] valueFrom: [e2e-llm-inference-service] fieldRef: [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] fieldPath: metadata.namespace [e2e-llm-inference-service] - name: SSL_CERT_DIR [e2e-llm-inference-service] value: /var/run/kserve/tls:/var/run/secrets/kubernetes.io/serviceaccount:/etc/pki/tls/certs [e2e-llm-inference-service] - name: INFERENCE_POOL_NAME [e2e-llm-inference-service] value: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] resources: {} [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] initialDelaySeconds: 10 [e2e-llm-inference-service] timeoutSeconds: 10 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 3 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] initialDelaySeconds: 10 [e2e-llm-inference-service] timeoutSeconds: 5 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 10 [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: FallbackToLogsOnError [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-inference-sim:v0.8.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/llm-d-inference-sim [e2e-llm-inference-service] args: [e2e-llm-inference-service] - --port [e2e-llm-inference-service] - '8001' [e2e-llm-inference-service] - --model [e2e-llm-inference-service] - facebook/opt-125m [e2e-llm-inference-service] - --mode [e2e-llm-inference-service] - random [e2e-llm-inference-service] - --ssl-certfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.crt [e2e-llm-inference-service] - --ssl-keyfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.key [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - containerPort: 8001 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: HOME [e2e-llm-inference-service] value: /home [e2e-llm-inference-service] - name: VLLM_LOGGING_LEVEL [e2e-llm-inference-service] value: INFO [e2e-llm-inference-service] - name: HF_HUB_CACHE [e2e-llm-inference-service] value: /models [e2e-llm-inference-service] resources: [e2e-llm-inference-service] limits: [e2e-llm-inference-service] cpu: '1' [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] mountPath: /home [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] mountPath: /tmp [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] mountPath: /dev/shm [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] mountPath: /models [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8001 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 10 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8001 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 1 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 2 [e2e-llm-inference-service] startupProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8001 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 60 [e2e-llm-inference-service] lifecycle: [e2e-llm-inference-service] preStop: [e2e-llm-inference-service] exec: [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /bin/sleep [e2e-llm-inference-service] - '15' [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: FallbackToLogsOnError [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] terminationGracePeriodSeconds: 60 [e2e-llm-inference-service] dnsPolicy: ClusterFirst [e2e-llm-inference-service] serviceAccountName: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] serviceAccount: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] securityContext: {} [e2e-llm-inference-service] schedulerName: default-scheduler [e2e-llm-inference-service] status: [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] fullyLabeledReplicas: 1 [e2e-llm-inference-service] readyReplicas: 1 [e2e-llm-inference-service] availableReplicas: 1 [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] kind: ReplicaSet [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847 [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 5286171f-5b13-48cb-bc68-e62f8a411bc4 [e2e-llm-inference-service] resourceVersion: '64423' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload-prefill [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: prefill [e2e-llm-inference-service] pod-template-hash: 78b7f4c847 [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] deployment.kubernetes.io/desired-replicas: '1' [e2e-llm-inference-service] deployment.kubernetes.io/max-replicas: '2' [e2e-llm-inference-service] deployment.kubernetes.io/revision: '1' [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: apps/v1 [e2e-llm-inference-service] kind: Deployment [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-prefill [e2e-llm-inference-service] uid: 5aa10065-f2c2-41e8-8a21-5e012f3d0491 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/desired-replicas: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/max-replicas: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/revision: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:pod-template-hash: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"5aa10065-f2c2-41e8-8a21-5e012f3d0491"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] f:selector: {} [e2e-llm-inference-service] f:template: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:pod-template-hash: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:containers: [e2e-llm-inference-service] k:{"name":"main"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:args: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"HF_HUB_CACHE"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"HOME"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"VLLM_LOGGING_LEVEL"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:lifecycle: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:preStop: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":8000,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:limits: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:requests: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:seccompProfile: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:startupProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/dev/shm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/models"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/tmp"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:dnsPolicy: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:schedulerName: {} [e2e-llm-inference-service] f:securityContext: {} [e2e-llm-inference-service] f:terminationGracePeriodSeconds: {} [e2e-llm-inference-service] f:volumes: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"dshm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:medium: {} [e2e-llm-inference-service] f:sizeLimit: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"model-cache"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tls-certs"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:secret: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:defaultMode: {} [e2e-llm-inference-service] f:secretName: {} [e2e-llm-inference-service] k:{"name":"tmp-dir"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:22Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:availableReplicas: {} [e2e-llm-inference-service] f:fullyLabeledReplicas: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:readyReplicas: {} [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] spec: [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] selector: [e2e-llm-inference-service] matchLabels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload-prefill [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: prefill [e2e-llm-inference-service] pod-template-hash: 78b7f4c847 [e2e-llm-inference-service] template: [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload-prefill [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: prefill [e2e-llm-inference-service] pod-template-hash: 78b7f4c847 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] volumes: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] emptyDir: [e2e-llm-inference-service] medium: Memory [e2e-llm-inference-service] sizeLimit: 1Gi [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] secret: [e2e-llm-inference-service] secretName: scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-inference-sim:v0.8.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/llm-d-inference-sim [e2e-llm-inference-service] args: [e2e-llm-inference-service] - --port [e2e-llm-inference-service] - '8000' [e2e-llm-inference-service] - --model [e2e-llm-inference-service] - facebook/opt-125m [e2e-llm-inference-service] - --mode [e2e-llm-inference-service] - random [e2e-llm-inference-service] - --ssl-certfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.crt [e2e-llm-inference-service] - --ssl-keyfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.key [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - containerPort: 8000 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: HOME [e2e-llm-inference-service] value: /home [e2e-llm-inference-service] - name: VLLM_LOGGING_LEVEL [e2e-llm-inference-service] value: INFO [e2e-llm-inference-service] - name: HF_HUB_CACHE [e2e-llm-inference-service] value: /models [e2e-llm-inference-service] resources: [e2e-llm-inference-service] limits: [e2e-llm-inference-service] cpu: '1' [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] mountPath: /home [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] mountPath: /tmp [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] mountPath: /dev/shm [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] mountPath: /models [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 10 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 1 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 2 [e2e-llm-inference-service] startupProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 60 [e2e-llm-inference-service] lifecycle: [e2e-llm-inference-service] preStop: [e2e-llm-inference-service] exec: [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /bin/sleep [e2e-llm-inference-service] - '15' [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: File [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] terminationGracePeriodSeconds: 60 [e2e-llm-inference-service] dnsPolicy: ClusterFirst [e2e-llm-inference-service] securityContext: {} [e2e-llm-inference-service] schedulerName: default-scheduler [e2e-llm-inference-service] status: [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] fullyLabeledReplicas: 1 [e2e-llm-inference-service] readyReplicas: 1 [e2e-llm-inference-service] availableReplicas: 1 [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] kind: ReplicaSet [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-router-scheduler-59dc679cd [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 7a1d5383-f2a5-49cb-a2d0-400ce9969f04 [e2e-llm-inference-service] resourceVersion: '64785' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] pod-template-hash: 59dc679cd [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] deployment.kubernetes.io/desired-replicas: '1' [e2e-llm-inference-service] deployment.kubernetes.io/max-replicas: '1' [e2e-llm-inference-service] deployment.kubernetes.io/revision: '1' [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: apps/v1 [e2e-llm-inference-service] kind: Deployment [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-router-scheduler [e2e-llm-inference-service] uid: 61555698-bdcc-4d5b-a0b4-ef096692ebd3 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/desired-replicas: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/max-replicas: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/revision: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:pod-template-hash: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"61555698-bdcc-4d5b-a0b4-ef096692ebd3"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] f:selector: {} [e2e-llm-inference-service] f:template: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/version: {} [e2e-llm-inference-service] f:certificates.kserve.io/expiration-v2: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:pod-template-hash: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:containers: [e2e-llm-inference-service] k:{"name":"main"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:args: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"SSL_CERT_DIR"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:lifecycle: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:preStop: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:grpc: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:service: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":5557,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] k:{"containerPort":9002,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] k:{"containerPort":9003,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] k:{"containerPort":9090,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:grpc: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:service: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:requests: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:seccompProfile: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/tmp/tokenizer"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:dnsPolicy: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:schedulerName: {} [e2e-llm-inference-service] f:securityContext: {} [e2e-llm-inference-service] f:serviceAccount: {} [e2e-llm-inference-service] f:serviceAccountName: {} [e2e-llm-inference-service] f:terminationGracePeriodSeconds: {} [e2e-llm-inference-service] f:volumes: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"tls-certs"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:secret: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:defaultMode: {} [e2e-llm-inference-service] f:secretName: {} [e2e-llm-inference-service] k:{"name":"tokenizer-cache"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tokenizer-tmp"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tokenizer-uds"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:45Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:availableReplicas: {} [e2e-llm-inference-service] f:fullyLabeledReplicas: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:readyReplicas: {} [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] spec: [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] selector: [e2e-llm-inference-service] matchLabels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] pod-template-hash: 59dc679cd [e2e-llm-inference-service] template: [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] pod-template-hash: 59dc679cd [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] app.kubernetes.io/version: 0.9.0 [e2e-llm-inference-service] certificates.kserve.io/expiration-v2: 'true' [e2e-llm-inference-service] spec: [e2e-llm-inference-service] volumes: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] secret: [e2e-llm-inference-service] secretName: scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] - name: tokenizer-uds [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tokenizer-tmp [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tokenizer-cache [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/epp [e2e-llm-inference-service] - --pool-name [e2e-llm-inference-service] - scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] - --pool-namespace [e2e-llm-inference-service] - kserve-ci-e2e-test [e2e-llm-inference-service] - --zap-encoder [e2e-llm-inference-service] - json [e2e-llm-inference-service] - --grpc-port [e2e-llm-inference-service] - '9002' [e2e-llm-inference-service] - --grpc-health-port [e2e-llm-inference-service] - '9003' [e2e-llm-inference-service] - --enable-cert-reload=true [e2e-llm-inference-service] - --secure-serving=true [e2e-llm-inference-service] - --model-server-metrics-scheme=https [e2e-llm-inference-service] - --cert-path=/var/run/kserve/tls [e2e-llm-inference-service] args: [e2e-llm-inference-service] - --config-text [e2e-llm-inference-service] - "apiVersion: inference.networking.x-k8s.io/v1alpha1\nkind: EndpointPickerConfig\n\ [e2e-llm-inference-service] plugins:\n- type: disagg-headers-handler\n- type: prefill-filter\n- type:\ [e2e-llm-inference-service] \ decode-filter\n- type: always-disagg-pd-decider\n- parameters:\n deciders:\n\ [e2e-llm-inference-service] \ prefill: always-disagg-pd-decider\n type: disagg-profile-handler\n\ [e2e-llm-inference-service] - type: prefix-cache-scorer\n- type: queue-scorer\n- type: max-score-picker\n\ [e2e-llm-inference-service] schedulingProfiles:\n- name: prefill\n plugins:\n - pluginRef: prefill-filter\n\ [e2e-llm-inference-service] \ - pluginRef: queue-scorer\n weight: 2\n - pluginRef: prefix-cache-scorer\n\ [e2e-llm-inference-service] \ weight: 3\n - pluginRef: max-score-picker\n- name: decode\n plugins:\n\ [e2e-llm-inference-service] \ - pluginRef: decode-filter\n - pluginRef: queue-scorer\n weight:\ [e2e-llm-inference-service] \ 2\n - pluginRef: prefix-cache-scorer\n weight: 3\n - pluginRef: max-score-picker\n" [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - name: grpc [e2e-llm-inference-service] containerPort: 9002 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: grpc-health [e2e-llm-inference-service] containerPort: 9003 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: metrics [e2e-llm-inference-service] containerPort: 9090 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: zmq [e2e-llm-inference-service] containerPort: 5557 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: SSL_CERT_DIR [e2e-llm-inference-service] value: /var/run/kserve/tls:/var/run/secrets/kubernetes.io/serviceaccount:/etc/pki/tls/certs [e2e-llm-inference-service] resources: [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 256m [e2e-llm-inference-service] memory: 500Mi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] - name: tokenizer-uds [e2e-llm-inference-service] mountPath: /tmp/tokenizer [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] grpc: [e2e-llm-inference-service] port: 9003 [e2e-llm-inference-service] service: liveness [e2e-llm-inference-service] initialDelaySeconds: 5 [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 3 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] grpc: [e2e-llm-inference-service] port: 9003 [e2e-llm-inference-service] service: readiness [e2e-llm-inference-service] initialDelaySeconds: 30 [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 3 [e2e-llm-inference-service] lifecycle: [e2e-llm-inference-service] preStop: [e2e-llm-inference-service] exec: [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /bin/sleep [e2e-llm-inference-service] - '15' [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: FallbackToLogsOnError [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] terminationGracePeriodSeconds: 60 [e2e-llm-inference-service] dnsPolicy: ClusterFirst [e2e-llm-inference-service] serviceAccountName: scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] serviceAccount: scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] securityContext: {} [e2e-llm-inference-service] schedulerName: default-scheduler [e2e-llm-inference-service] status: [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] fullyLabeledReplicas: 1 [e2e-llm-inference-service] readyReplicas: 1 [e2e-llm-inference-service] availableReplicas: 1 [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] kind: ReplicaSet [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-rb [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: bd3073f3-ba3c-4dc0-a6fe-a5c458f1c251 [e2e-llm-inference-service] resourceVersion: '64157' [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:roleRef: {} [e2e-llm-inference-service] f:subjects: {} [e2e-llm-inference-service] subjects: [e2e-llm-inference-service] - kind: ServiceAccount [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] roleRef: [e2e-llm-inference-service] apiGroup: rbac.authorization.k8s.io [e2e-llm-inference-service] kind: Role [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-role [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] kind: RoleBinding [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-rb [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 7344b4d3-2e76-49be-8fb9-622d6ebd7d4b [e2e-llm-inference-service] resourceVersion: '64104' [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:roleRef: {} [e2e-llm-inference-service] f:subjects: {} [e2e-llm-inference-service] subjects: [e2e-llm-inference-service] - kind: ServiceAccount [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] roleRef: [e2e-llm-inference-service] apiGroup: rbac.authorization.k8s.io [e2e-llm-inference-service] kind: Role [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-role [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] kind: RoleBinding [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-role [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 2d193117-3db9-48de-a8b7-9b73d4c80d38 [e2e-llm-inference-service] resourceVersion: '64152' [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:rules: {} [e2e-llm-inference-service] rules: [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - '' [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - pods [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - inference.networking.k8s.io [e2e-llm-inference-service] - inference.networking.x-k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - inferencepools [e2e-llm-inference-service] - inferenceobjectives [e2e-llm-inference-service] - inferencemodels [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - inference.networking.x-k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - inferencemodelrewrites [e2e-llm-inference-service] - inferencepoolimports [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - discovery.k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - endpointslices [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] - create [e2e-llm-inference-service] - update [e2e-llm-inference-service] - patch [e2e-llm-inference-service] - delete [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - coordination.k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - leases [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] kind: Role [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-role [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 4e431c42-5a73-4cfd-89c4-7a8542b95934 [e2e-llm-inference-service] resourceVersion: '64101' [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:rules: {} [e2e-llm-inference-service] rules: [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - '' [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - pods [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - inference.networking.x-k8s.io [e2e-llm-inference-service] - inference.networking.k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - inferencepools [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] kind: Role [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-service-h5dzr [e2e-llm-inference-service] generateName: scheduler-v06-pd-migration-test-epp-service- [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: cddec31d-d3e9-458e-b009-fba61d67d4c6 [e2e-llm-inference-service] resourceVersion: '64783' [e2e-llm-inference-service] generation: 3 [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] endpointslice.kubernetes.io/managed-by: endpointslice-controller.k8s.io [e2e-llm-inference-service] kubernetes.io/service-name: scheduler-v06-pd-migration-test-epp-service [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] endpoints.kubernetes.io/last-change-trigger-time: '2026-07-09T19:03:45Z' [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: v1 [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-service [e2e-llm-inference-service] uid: ec40e646-8622-418a-ba75-27df7e2e17c2 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: discovery.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:45Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:addressType: {} [e2e-llm-inference-service] f:endpoints: {} [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:endpoints.kubernetes.io/last-change-trigger-time: {} [e2e-llm-inference-service] f:generateName: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:endpointslice.kubernetes.io/managed-by: {} [e2e-llm-inference-service] f:kubernetes.io/service-name: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"ec40e646-8622-418a-ba75-27df7e2e17c2"}: {} [e2e-llm-inference-service] f:ports: {} [e2e-llm-inference-service] addressType: IPv4 [e2e-llm-inference-service] endpoints: [e2e-llm-inference-service] - addresses: [e2e-llm-inference-service] - 10.134.0.52 [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] ready: true [e2e-llm-inference-service] serving: true [e2e-llm-inference-service] terminating: false [e2e-llm-inference-service] targetRef: [e2e-llm-inference-service] kind: Pod [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-router-scheduler-597gpth [e2e-llm-inference-service] uid: 5d3ca42d-5a94-4458-b798-1441859d857c [e2e-llm-inference-service] nodeName: ip-10-0-143-79.ec2.internal [e2e-llm-inference-service] zone: us-east-1a [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - name: grpc [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] port: 9002 [e2e-llm-inference-service] - name: grpc-health [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] port: 9003 [e2e-llm-inference-service] - name: metrics [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] port: 9090 [e2e-llm-inference-service] - name: zmq [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] port: 5557 [e2e-llm-inference-service] apiVersion: discovery.k8s.io/v1 [e2e-llm-inference-service] kind: EndpointSlice [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc-dqcqr [e2e-llm-inference-service] generateName: scheduler-v06-pd-migration-test-kserve-workload-svc- [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 61839858-f962-4649-9055-02d005ace840 [e2e-llm-inference-service] resourceVersion: '64431' [e2e-llm-inference-service] generation: 5 [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] endpointslice.kubernetes.io/managed-by: endpointslice-controller.k8s.io [e2e-llm-inference-service] kubernetes.io/service-name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] endpoints.kubernetes.io/last-change-trigger-time: '2026-07-09T19:03:23Z' [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: v1 [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] uid: 19840dc0-504d-40f5-add4-f1b21f338e8a [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: discovery.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:23Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:addressType: {} [e2e-llm-inference-service] f:endpoints: {} [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:endpoints.kubernetes.io/last-change-trigger-time: {} [e2e-llm-inference-service] f:generateName: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:endpointslice.kubernetes.io/managed-by: {} [e2e-llm-inference-service] f:kubernetes.io/service-name: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"19840dc0-504d-40f5-add4-f1b21f338e8a"}: {} [e2e-llm-inference-service] f:ports: {} [e2e-llm-inference-service] addressType: IPv4 [e2e-llm-inference-service] endpoints: [e2e-llm-inference-service] - addresses: [e2e-llm-inference-service] - 10.133.0.61 [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] ready: true [e2e-llm-inference-service] serving: true [e2e-llm-inference-service] terminating: false [e2e-llm-inference-service] targetRef: [e2e-llm-inference-service] kind: Pod [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4 [e2e-llm-inference-service] uid: 8b2f8683-e079-4829-bfbc-75e359df8dac [e2e-llm-inference-service] nodeName: ip-10-0-140-224.ec2.internal [e2e-llm-inference-service] zone: us-east-1a [e2e-llm-inference-service] - addresses: [e2e-llm-inference-service] - 10.132.0.78 [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] ready: true [e2e-llm-inference-service] serving: true [e2e-llm-inference-service] terminating: false [e2e-llm-inference-service] targetRef: [e2e-llm-inference-service] kind: Pod [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj [e2e-llm-inference-service] uid: ac168a80-a025-47b8-bf9d-7e8862b3b452 [e2e-llm-inference-service] nodeName: ip-10-0-141-82.ec2.internal [e2e-llm-inference-service] zone: us-east-1a [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - name: https [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] appProtocol: https [e2e-llm-inference-service] apiVersion: discovery.k8s.io/v1 [e2e-llm-inference-service] kind: EndpointSlice [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-rb [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: bd3073f3-ba3c-4dc0-a6fe-a5c458f1c251 [e2e-llm-inference-service] resourceVersion: '64157' [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:roleRef: {} [e2e-llm-inference-service] f:subjects: {} [e2e-llm-inference-service] userNames: [e2e-llm-inference-service] - system:serviceaccount:kserve-ci-e2e-test:scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] groupNames: null [e2e-llm-inference-service] subjects: [e2e-llm-inference-service] - kind: ServiceAccount [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] roleRef: [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-role [e2e-llm-inference-service] apiVersion: authorization.openshift.io/v1 [e2e-llm-inference-service] kind: RoleBinding [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-rb [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 7344b4d3-2e76-49be-8fb9-622d6ebd7d4b [e2e-llm-inference-service] resourceVersion: '64104' [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:roleRef: {} [e2e-llm-inference-service] f:subjects: {} [e2e-llm-inference-service] userNames: [e2e-llm-inference-service] - system:serviceaccount:kserve-ci-e2e-test:scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] groupNames: null [e2e-llm-inference-service] subjects: [e2e-llm-inference-service] - kind: ServiceAccount [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] roleRef: [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-role [e2e-llm-inference-service] apiVersion: authorization.openshift.io/v1 [e2e-llm-inference-service] kind: RoleBinding [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-role [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 2d193117-3db9-48de-a8b7-9b73d4c80d38 [e2e-llm-inference-service] resourceVersion: '64152' [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:rules: {} [e2e-llm-inference-service] rules: [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] attributeRestrictions: null [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - '' [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - pods [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] attributeRestrictions: null [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - inference.networking.k8s.io [e2e-llm-inference-service] - inference.networking.x-k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - inferencemodels [e2e-llm-inference-service] - inferenceobjectives [e2e-llm-inference-service] - inferencepools [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] attributeRestrictions: null [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - inference.networking.x-k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - inferencemodelrewrites [e2e-llm-inference-service] - inferencepoolimports [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] attributeRestrictions: null [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - discovery.k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - endpointslices [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - create [e2e-llm-inference-service] - delete [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - patch [e2e-llm-inference-service] - update [e2e-llm-inference-service] - watch [e2e-llm-inference-service] attributeRestrictions: null [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - coordination.k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - leases [e2e-llm-inference-service] apiVersion: authorization.openshift.io/v1 [e2e-llm-inference-service] kind: Role [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-role [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 4e431c42-5a73-4cfd-89c4-7a8542b95934 [e2e-llm-inference-service] resourceVersion: '64101' [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:rules: {} [e2e-llm-inference-service] rules: [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] attributeRestrictions: null [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - '' [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - pods [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] attributeRestrictions: null [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - inference.networking.x-k8s.io [e2e-llm-inference-service] - inference.networking.k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - inferencepools [e2e-llm-inference-service] apiVersion: authorization.openshift.io/v1 [e2e-llm-inference-service] kind: Role [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: gateway.networking.k8s.io/v1 [e2e-llm-inference-service] kind: HTTPRoute [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] serving.kserve.io/inference-pool-migrated: v1 [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] generation: 2 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: gateway.networking.k8s.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:serving.kserve.io/inference-pool-migrated: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:spec: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-09T19:03:29Z' [e2e-llm-inference-service] - apiVersion: gateway.networking.k8s.io/v1beta1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] manager: pilot-discovery [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] time: '2026-07-09T19:03:29Z' [e2e-llm-inference-service] - apiVersion: gateway.networking.k8s.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:parents: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] time: '2026-07-09T19:03:30Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-route [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] resourceVersion: '64511' [e2e-llm-inference-service] uid: 190ca81d-2e71-42b9-ac48-5df10e67a716 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] parentRefs: [e2e-llm-inference-service] - group: gateway.networking.k8s.io [e2e-llm-inference-service] kind: Gateway [e2e-llm-inference-service] name: openshift-ai-inference [e2e-llm-inference-service] namespace: openshift-ingress [e2e-llm-inference-service] rules: [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: /v1/completions [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/completions [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/completions [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/completions/ [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: /v1/chat/completions [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/chat/completions [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/chat/completions [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/chat/completions/ [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: /v1/responses [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/responses [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/responses [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/responses/ [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: /v1/messages [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/messages [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/messages [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/messages/ [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: '' [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: / [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: '' [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: / [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] status: [e2e-llm-inference-service] parents: [e2e-llm-inference-service] - conditions: [e2e-llm-inference-service] - lastTransitionTime: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] message: Route was valid [e2e-llm-inference-service] observedGeneration: 2 [e2e-llm-inference-service] reason: Accepted [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: Accepted [e2e-llm-inference-service] - lastTransitionTime: '2026-07-09T19:03:29Z' [e2e-llm-inference-service] message: All references resolved [e2e-llm-inference-service] observedGeneration: 2 [e2e-llm-inference-service] reason: ResolvedRefs [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: ResolvedRefs [e2e-llm-inference-service] controllerName: openshift.io/gateway-controller/v1 [e2e-llm-inference-service] parentRef: [e2e-llm-inference-service] group: gateway.networking.k8s.io [e2e-llm-inference-service] kind: Gateway [e2e-llm-inference-service] name: openshift-ai-inference [e2e-llm-inference-service] namespace: openshift-ingress [e2e-llm-inference-service] - conditions: [e2e-llm-inference-service] - lastTransitionTime: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] message: Object affected by AuthPolicy [kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route-authn [e2e-llm-inference-service] openshift-ingress/openshift-ai-inference-authn] [e2e-llm-inference-service] observedGeneration: 2 [e2e-llm-inference-service] reason: Accepted [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: kuadrant.io/AuthPolicyAffected [e2e-llm-inference-service] controllerName: kuadrant.io/policy-controller [e2e-llm-inference-service] parentRef: [e2e-llm-inference-service] group: gateway.networking.k8s.io [e2e-llm-inference-service] kind: Gateway [e2e-llm-inference-service] name: openshift-ai-inference [e2e-llm-inference-service] namespace: openshift-ingress [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: gateway.networking.k8s.io/v1beta1 [e2e-llm-inference-service] kind: HTTPRoute [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] serving.kserve.io/inference-pool-migrated: v1 [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] generation: 2 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: gateway.networking.k8s.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:serving.kserve.io/inference-pool-migrated: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:spec: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-09T19:03:29Z' [e2e-llm-inference-service] - apiVersion: gateway.networking.k8s.io/v1beta1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] manager: pilot-discovery [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] time: '2026-07-09T19:03:29Z' [e2e-llm-inference-service] - apiVersion: gateway.networking.k8s.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:parents: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] time: '2026-07-09T19:03:30Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-route [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] resourceVersion: '64511' [e2e-llm-inference-service] uid: 190ca81d-2e71-42b9-ac48-5df10e67a716 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] parentRefs: [e2e-llm-inference-service] - group: gateway.networking.k8s.io [e2e-llm-inference-service] kind: Gateway [e2e-llm-inference-service] name: openshift-ai-inference [e2e-llm-inference-service] namespace: openshift-ingress [e2e-llm-inference-service] rules: [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: /v1/completions [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/completions [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/completions [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/completions/ [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: /v1/chat/completions [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/chat/completions [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/chat/completions [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/chat/completions/ [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: /v1/responses [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/responses [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/responses [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/responses/ [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: /v1/messages [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/messages [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/messages [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/messages/ [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: '' [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: / [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: '' [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: / [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] status: [e2e-llm-inference-service] parents: [e2e-llm-inference-service] - conditions: [e2e-llm-inference-service] - lastTransitionTime: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] message: Route was valid [e2e-llm-inference-service] observedGeneration: 2 [e2e-llm-inference-service] reason: Accepted [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: Accepted [e2e-llm-inference-service] - lastTransitionTime: '2026-07-09T19:03:29Z' [e2e-llm-inference-service] message: All references resolved [e2e-llm-inference-service] observedGeneration: 2 [e2e-llm-inference-service] reason: ResolvedRefs [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: ResolvedRefs [e2e-llm-inference-service] controllerName: openshift.io/gateway-controller/v1 [e2e-llm-inference-service] parentRef: [e2e-llm-inference-service] group: gateway.networking.k8s.io [e2e-llm-inference-service] kind: Gateway [e2e-llm-inference-service] name: openshift-ai-inference [e2e-llm-inference-service] namespace: openshift-ingress [e2e-llm-inference-service] - conditions: [e2e-llm-inference-service] - lastTransitionTime: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] message: Object affected by AuthPolicy [kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route-authn [e2e-llm-inference-service] openshift-ingress/openshift-ai-inference-authn] [e2e-llm-inference-service] observedGeneration: 2 [e2e-llm-inference-service] reason: Accepted [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: kuadrant.io/AuthPolicyAffected [e2e-llm-inference-service] controllerName: kuadrant.io/policy-controller [e2e-llm-inference-service] parentRef: [e2e-llm-inference-service] group: gateway.networking.k8s.io [e2e-llm-inference-service] kind: Gateway [e2e-llm-inference-service] name: openshift-ai-inference [e2e-llm-inference-service] namespace: openshift-ingress [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: inference.networking.k8s.io/v1 [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: inference.networking.k8s.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:appProtocol: {} [e2e-llm-inference-service] f:endpointPickerRef: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureMode: {} [e2e-llm-inference-service] f:group: {} [e2e-llm-inference-service] f:kind: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:port: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:number: {} [e2e-llm-inference-service] f:selector: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:matchLabels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:targetPorts: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] - apiVersion: inference.networking.k8s.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:parents: {} [e2e-llm-inference-service] manager: pilot-discovery [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] time: '2026-07-09T19:03:29Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] resourceVersion: '64495' [e2e-llm-inference-service] uid: 99d1fb1e-a5f3-48bf-a769-bd6d5836789a [e2e-llm-inference-service] spec: [e2e-llm-inference-service] appProtocol: http [e2e-llm-inference-service] endpointPickerRef: [e2e-llm-inference-service] failureMode: FailOpen [e2e-llm-inference-service] group: '' [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-service [e2e-llm-inference-service] port: [e2e-llm-inference-service] number: 9002 [e2e-llm-inference-service] selector: [e2e-llm-inference-service] matchLabels: [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] targetPorts: [e2e-llm-inference-service] - number: 8000 [e2e-llm-inference-service] status: [e2e-llm-inference-service] parents: [e2e-llm-inference-service] - conditions: [e2e-llm-inference-service] - lastTransitionTime: '2026-07-09T19:03:29Z' [e2e-llm-inference-service] message: Referenced by an HTTPRoute accepted by the parentRef Gateway [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] reason: Accepted [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: Accepted [e2e-llm-inference-service] - lastTransitionTime: '2026-07-09T19:03:29Z' [e2e-llm-inference-service] message: Referenced ExtensionRef resolved successfully [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] reason: ResolvedRefs [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: ResolvedRefs [e2e-llm-inference-service] parentRef: [e2e-llm-inference-service] group: networking.istio.io [e2e-llm-inference-service] kind: Gateway [e2e-llm-inference-service] name: openshift-ai-inference [e2e-llm-inference-service] namespace: openshift-ingress [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: kuadrant.io/v1 [e2e-llm-inference-service] kind: AuthPolicy [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:15Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-policies [e2e-llm-inference-service] app.kubernetes.io/managed-by: odh-model-controller [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: kuadrant.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/managed-by: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:rules: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:authentication: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:public: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:anonymous: {} [e2e-llm-inference-service] f:credentials: {} [e2e-llm-inference-service] f:metrics: {} [e2e-llm-inference-service] f:overrides: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:fairness: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:objective: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:priority: {} [e2e-llm-inference-service] f:response: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:success: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:headers: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:x-gateway-inference-fairness-id: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:metrics: {} [e2e-llm-inference-service] f:plain: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:expression: {} [e2e-llm-inference-service] f:priority: {} [e2e-llm-inference-service] f:x-gateway-inference-objective: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:metrics: {} [e2e-llm-inference-service] f:plain: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:expression: {} [e2e-llm-inference-service] f:priority: {} [e2e-llm-inference-service] f:targetRef: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:group: {} [e2e-llm-inference-service] f:kind: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-09T19:03:15Z' [e2e-llm-inference-service] - apiVersion: kuadrant.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:conditions: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"type":"Accepted"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:message: {} [e2e-llm-inference-service] f:reason: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"Enforced"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:message: {} [e2e-llm-inference-service] f:reason: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] time: '2026-07-09T19:03:16Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-route-authn [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] resourceVersion: '64332' [e2e-llm-inference-service] uid: 23c5d08f-53b5-4ddc-b343-4b753e43f21c [e2e-llm-inference-service] spec: [e2e-llm-inference-service] rules: [e2e-llm-inference-service] authentication: [e2e-llm-inference-service] public: [e2e-llm-inference-service] anonymous: {} [e2e-llm-inference-service] credentials: {} [e2e-llm-inference-service] metrics: false [e2e-llm-inference-service] overrides: [e2e-llm-inference-service] fairness: [e2e-llm-inference-service] value: unauthenticated [e2e-llm-inference-service] objective: [e2e-llm-inference-service] value: unauthenticated [e2e-llm-inference-service] priority: 0 [e2e-llm-inference-service] response: [e2e-llm-inference-service] success: [e2e-llm-inference-service] headers: [e2e-llm-inference-service] x-gateway-inference-fairness-id: [e2e-llm-inference-service] metrics: false [e2e-llm-inference-service] plain: [e2e-llm-inference-service] expression: auth.identity.fairness [e2e-llm-inference-service] priority: 0 [e2e-llm-inference-service] x-gateway-inference-objective: [e2e-llm-inference-service] metrics: false [e2e-llm-inference-service] plain: [e2e-llm-inference-service] expression: auth.identity.objective [e2e-llm-inference-service] priority: 0 [e2e-llm-inference-service] targetRef: [e2e-llm-inference-service] group: gateway.networking.k8s.io [e2e-llm-inference-service] kind: HTTPRoute [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-route [e2e-llm-inference-service] status: [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] - lastTransitionTime: '2026-07-09T19:03:15Z' [e2e-llm-inference-service] message: AuthPolicy has been accepted [e2e-llm-inference-service] reason: Accepted [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: Accepted [e2e-llm-inference-service] - lastTransitionTime: '2026-07-09T19:03:16Z' [e2e-llm-inference-service] message: AuthPolicy has been successfully enforced [e2e-llm-inference-service] reason: Enforced [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: Enforced [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] kind: DestinationRule [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] llm-d.ai/managed: 'true' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:llm-d.ai/managed: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exportTo: {} [e2e-llm-inference-service] f:host: {} [e2e-llm-inference-service] f:trafficPolicy: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:tls: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:insecureSkipVerify: {} [e2e-llm-inference-service] f:mode: {} [e2e-llm-inference-service] f:sni: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-scheduler [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] resourceVersion: '64209' [e2e-llm-inference-service] uid: 1152f82d-e3bf-4757-9b6d-594bf5951689 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] exportTo: [e2e-llm-inference-service] - '*' [e2e-llm-inference-service] host: scheduler-v06-pd-migration-test-epp-service.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] trafficPolicy: [e2e-llm-inference-service] tls: [e2e-llm-inference-service] insecureSkipVerify: true [e2e-llm-inference-service] mode: SIMPLE [e2e-llm-inference-service] sni: scheduler-v06-pd-migration-test-epp-service.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] kind: DestinationRule [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:30Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-shadow-service [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] llm-d.ai/managed: 'true' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:llm-d.ai/managed: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exportTo: {} [e2e-llm-inference-service] f:host: {} [e2e-llm-inference-service] f:trafficPolicy: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:tls: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:insecureSkipVerify: {} [e2e-llm-inference-service] f:mode: {} [e2e-llm-inference-service] f:sni: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-09T19:03:30Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-shadow-svc [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] resourceVersion: '64502' [e2e-llm-inference-service] uid: 2d908fd8-9f27-450b-ae9d-1c69aaf08539 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] exportTo: [e2e-llm-inference-service] - '*' [e2e-llm-inference-service] host: scheduler-v06-pd-migration-test-inference-pool-ip-2bbd07cf.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] trafficPolicy: [e2e-llm-inference-service] tls: [e2e-llm-inference-service] insecureSkipVerify: true [e2e-llm-inference-service] mode: SIMPLE [e2e-llm-inference-service] sni: scheduler-v06-pd-migration-test-kserve-workload-svc.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] kind: DestinationRule [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] llm-d.ai/managed: 'true' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:llm-d.ai/managed: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exportTo: {} [e2e-llm-inference-service] f:host: {} [e2e-llm-inference-service] f:trafficPolicy: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:tls: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:insecureSkipVerify: {} [e2e-llm-inference-service] f:mode: {} [e2e-llm-inference-service] f:sni: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] resourceVersion: '64234' [e2e-llm-inference-service] uid: 36abe617-f440-44fb-89e0-93a929b90ef3 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] exportTo: [e2e-llm-inference-service] - '*' [e2e-llm-inference-service] host: scheduler-v06-pd-migration-test-kserve-workload-svc.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] trafficPolicy: [e2e-llm-inference-service] tls: [e2e-llm-inference-service] insecureSkipVerify: true [e2e-llm-inference-service] mode: SIMPLE [e2e-llm-inference-service] sni: scheduler-v06-pd-migration-test-kserve-workload-svc.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: networking.istio.io/v1beta1 [e2e-llm-inference-service] kind: DestinationRule [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] llm-d.ai/managed: 'true' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:llm-d.ai/managed: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exportTo: {} [e2e-llm-inference-service] f:host: {} [e2e-llm-inference-service] f:trafficPolicy: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:tls: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:insecureSkipVerify: {} [e2e-llm-inference-service] f:mode: {} [e2e-llm-inference-service] f:sni: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-scheduler [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] resourceVersion: '64209' [e2e-llm-inference-service] uid: 1152f82d-e3bf-4757-9b6d-594bf5951689 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] exportTo: [e2e-llm-inference-service] - '*' [e2e-llm-inference-service] host: scheduler-v06-pd-migration-test-epp-service.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] trafficPolicy: [e2e-llm-inference-service] tls: [e2e-llm-inference-service] insecureSkipVerify: true [e2e-llm-inference-service] mode: SIMPLE [e2e-llm-inference-service] sni: scheduler-v06-pd-migration-test-epp-service.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: networking.istio.io/v1beta1 [e2e-llm-inference-service] kind: DestinationRule [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:30Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-shadow-service [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] llm-d.ai/managed: 'true' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:llm-d.ai/managed: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exportTo: {} [e2e-llm-inference-service] f:host: {} [e2e-llm-inference-service] f:trafficPolicy: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:tls: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:insecureSkipVerify: {} [e2e-llm-inference-service] f:mode: {} [e2e-llm-inference-service] f:sni: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-09T19:03:30Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-shadow-svc [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] resourceVersion: '64502' [e2e-llm-inference-service] uid: 2d908fd8-9f27-450b-ae9d-1c69aaf08539 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] exportTo: [e2e-llm-inference-service] - '*' [e2e-llm-inference-service] host: scheduler-v06-pd-migration-test-inference-pool-ip-2bbd07cf.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] trafficPolicy: [e2e-llm-inference-service] tls: [e2e-llm-inference-service] insecureSkipVerify: true [e2e-llm-inference-service] mode: SIMPLE [e2e-llm-inference-service] sni: scheduler-v06-pd-migration-test-kserve-workload-svc.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: networking.istio.io/v1beta1 [e2e-llm-inference-service] kind: DestinationRule [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] llm-d.ai/managed: 'true' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:llm-d.ai/managed: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exportTo: {} [e2e-llm-inference-service] f:host: {} [e2e-llm-inference-service] f:trafficPolicy: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:tls: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:insecureSkipVerify: {} [e2e-llm-inference-service] f:mode: {} [e2e-llm-inference-service] f:sni: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] resourceVersion: '64234' [e2e-llm-inference-service] uid: 36abe617-f440-44fb-89e0-93a929b90ef3 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] exportTo: [e2e-llm-inference-service] - '*' [e2e-llm-inference-service] host: scheduler-v06-pd-migration-test-kserve-workload-svc.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] trafficPolicy: [e2e-llm-inference-service] tls: [e2e-llm-inference-service] insecureSkipVerify: true [e2e-llm-inference-service] mode: SIMPLE [e2e-llm-inference-service] sni: scheduler-v06-pd-migration-test-kserve-workload-svc.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: networking.istio.io/v1alpha3 [e2e-llm-inference-service] kind: DestinationRule [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] llm-d.ai/managed: 'true' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:llm-d.ai/managed: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exportTo: {} [e2e-llm-inference-service] f:host: {} [e2e-llm-inference-service] f:trafficPolicy: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:tls: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:insecureSkipVerify: {} [e2e-llm-inference-service] f:mode: {} [e2e-llm-inference-service] f:sni: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-scheduler [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] resourceVersion: '64209' [e2e-llm-inference-service] uid: 1152f82d-e3bf-4757-9b6d-594bf5951689 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] exportTo: [e2e-llm-inference-service] - '*' [e2e-llm-inference-service] host: scheduler-v06-pd-migration-test-epp-service.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] trafficPolicy: [e2e-llm-inference-service] tls: [e2e-llm-inference-service] insecureSkipVerify: true [e2e-llm-inference-service] mode: SIMPLE [e2e-llm-inference-service] sni: scheduler-v06-pd-migration-test-epp-service.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: networking.istio.io/v1alpha3 [e2e-llm-inference-service] kind: DestinationRule [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:30Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-shadow-service [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] llm-d.ai/managed: 'true' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:llm-d.ai/managed: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exportTo: {} [e2e-llm-inference-service] f:host: {} [e2e-llm-inference-service] f:trafficPolicy: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:tls: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:insecureSkipVerify: {} [e2e-llm-inference-service] f:mode: {} [e2e-llm-inference-service] f:sni: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-09T19:03:30Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-shadow-svc [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] resourceVersion: '64502' [e2e-llm-inference-service] uid: 2d908fd8-9f27-450b-ae9d-1c69aaf08539 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] exportTo: [e2e-llm-inference-service] - '*' [e2e-llm-inference-service] host: scheduler-v06-pd-migration-test-inference-pool-ip-2bbd07cf.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] trafficPolicy: [e2e-llm-inference-service] tls: [e2e-llm-inference-service] insecureSkipVerify: true [e2e-llm-inference-service] mode: SIMPLE [e2e-llm-inference-service] sni: scheduler-v06-pd-migration-test-kserve-workload-svc.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: networking.istio.io/v1alpha3 [e2e-llm-inference-service] kind: DestinationRule [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] llm-d.ai/managed: 'true' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:llm-d.ai/managed: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exportTo: {} [e2e-llm-inference-service] f:host: {} [e2e-llm-inference-service] f:trafficPolicy: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:tls: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:insecureSkipVerify: {} [e2e-llm-inference-service] f:mode: {} [e2e-llm-inference-service] f:sni: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-09T19:03:13Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] resourceVersion: '64234' [e2e-llm-inference-service] uid: 36abe617-f440-44fb-89e0-93a929b90ef3 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] exportTo: [e2e-llm-inference-service] - '*' [e2e-llm-inference-service] host: scheduler-v06-pd-migration-test-kserve-workload-svc.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] trafficPolicy: [e2e-llm-inference-service] tls: [e2e-llm-inference-service] insecureSkipVerify: true [e2e-llm-inference-service] mode: SIMPLE [e2e-llm-inference-service] sni: scheduler-v06-pd-migration-test-kserve-workload-svc.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: inference.networking.x-k8s.io/v1alpha2 [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: inference.networking.x-k8s.io/v1alpha2 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"b7447503-00e1-4e0f-a173-d146b929ca4f"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:extensionRef: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureMode: {} [e2e-llm-inference-service] f:group: {} [e2e-llm-inference-service] f:kind: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:portNumber: {} [e2e-llm-inference-service] f:selector: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:targetPortNumber: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-09T19:03:12Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: b7447503-00e1-4e0f-a173-d146b929ca4f [e2e-llm-inference-service] resourceVersion: '64174' [e2e-llm-inference-service] uid: 7996ca4b-8c2c-4f46-983b-0650b7cc87aa [e2e-llm-inference-service] spec: [e2e-llm-inference-service] extensionRef: [e2e-llm-inference-service] failureMode: FailOpen [e2e-llm-inference-service] group: '' [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-service [e2e-llm-inference-service] portNumber: 9002 [e2e-llm-inference-service] selector: [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] targetPortNumber: 8000 [e2e-llm-inference-service] status: [e2e-llm-inference-service] parent: [e2e-llm-inference-service] - conditions: [e2e-llm-inference-service] - lastTransitionTime: '1970-01-01T00:00:00Z' [e2e-llm-inference-service] message: Waiting for controller [e2e-llm-inference-service] reason: Pending [e2e-llm-inference-service] status: Unknown [e2e-llm-inference-service] type: Accepted [e2e-llm-inference-service] parentRef: [e2e-llm-inference-service] group: gateway.networking.k8s.io [e2e-llm-inference-service] kind: Status [e2e-llm-inference-service] name: default [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4 [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:22:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: decode [e2e-llm-inference-service] pod-template-hash: 5c87756974 [e2e-llm-inference-service] timestamp: '2026-07-09T19:21:49Z' [e2e-llm-inference-service] window: 16.729s [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] usage: [e2e-llm-inference-service] cpu: 18541215n [e2e-llm-inference-service] memory: 24548Ki [e2e-llm-inference-service] - name: llm-d-routing-sidecar [e2e-llm-inference-service] usage: [e2e-llm-inference-service] cpu: 11492913n [e2e-llm-inference-service] memory: 20204Ki [e2e-llm-inference-service] apiVersion: metrics.k8s.io/v1beta1 [e2e-llm-inference-service] kind: PodMetrics [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:22:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload-prefill [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: prefill [e2e-llm-inference-service] pod-template-hash: 78b7f4c847 [e2e-llm-inference-service] timestamp: '2026-07-09T19:21:57Z' [e2e-llm-inference-service] window: 24.805s [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] usage: [e2e-llm-inference-service] cpu: 19126305n [e2e-llm-inference-service] memory: 24504Ki [e2e-llm-inference-service] apiVersion: metrics.k8s.io/v1beta1 [e2e-llm-inference-service] kind: PodMetrics [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-router-scheduler-597gpth [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] creationTimestamp: '2026-07-09T19:22:12Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] pod-template-hash: 59dc679cd [e2e-llm-inference-service] timestamp: '2026-07-09T19:21:51Z' [e2e-llm-inference-service] window: 18.103s [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] usage: [e2e-llm-inference-service] cpu: 19867701n [e2e-llm-inference-service] memory: 32632Ki [e2e-llm-inference-service] apiVersion: metrics.k8s.io/v1beta1 [e2e-llm-inference-service] kind: PodMetrics [e2e-llm-inference-service] [e2e-llm-inference-service] ERROR e2e.llmisvc.logging:logging.py:48 [test_llm_inference_service] [2026-07-09T19:22:12.550744] end - ❌ 1163.520s: Service returned 502: [e2e-llm-inference-service] =============================== warnings summary =============================== [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-precise-prefix-cache-inline-config-workload-llmd-simulator-kvcache] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-gateway-ref-router-with-managed-route-model-fb-opt-125m-workload-llmd-simulator] [e2e-llm-inference-service] /workspace/source/python/kserve/.venv/lib64/python3.11/site-packages/pytest_asyncio/plugin.py:761: DeprecationWarning: The event_loop fixture provided by pytest-asyncio has been redefined in [e2e-llm-inference-service] /workspace/source/test/e2e/conftest.py:43 [e2e-llm-inference-service] Replacing the event_loop fixture with a custom implementation is deprecated [e2e-llm-inference-service] and will lead to errors in the future. [e2e-llm-inference-service] If you want to request an asyncio event loop with a scope other than function [e2e-llm-inference-service] scope, use the "scope" argument to the asyncio mark when marking the tests. [e2e-llm-inference-service] If you want to return different types of event loops, use the event_loop_policy [e2e-llm-inference-service] fixture. [e2e-llm-inference-service] [e2e-llm-inference-service] warnings.warn( [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-precise-prefix-cache-inline-config-workload-llmd-simulator-kvcache] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator0] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator1] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator2] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m-with-lora-hf0] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-gateway-ref-router-with-managed-route-model-fb-opt-125m-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m-with-lora-hf1] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-pvc] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-custom-route-timeout-scheduler-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-pd-cpu-model-pvc] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-refs-scheduler-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_multi_node-router-managed-workload-simulated-dp-ep-cpu-model-pvc] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-custom-route-timeout-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service_stop.py::test_llm_stop_feature[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service_stop.py:40: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-refs-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-no-scheduler-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_tls.py::test_llm_tls_resources[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_tls.py:93: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_multi_node-router-managed-workload-simulated-dp-ep-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-inline-config-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator-model-qwen2.5-0.5b] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-configmap-ref-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-replicas-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-custom-template-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-v06-nonzero-threshold-migration-workload-llmd-simulator-pd] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-v06-pd-config-migration-workload-llmd-simulator-pd] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html [e2e-llm-inference-service] ---------- generated xml file: /workspace/artifacts-dir/junit_e2e.xml ---------- [e2e-llm-inference-service] --------------------------------- JSON report ---------------------------------- [e2e-llm-inference-service] report saved to: /workspace/artifacts-dir/e2e_results.json [e2e-llm-inference-service] =========================== short test summary info ============================ [e2e-llm-inference-service] FAILED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-v06-pd-config-migration-workload-llmd-simulator-pd] [e2e-llm-inference-service] ====== 1 failed, 41 passed, 3 skipped, 29 warnings in 3925.59s (1:05:25) ======= [must-gather] [must-gather ] OUT 2026-07-09T19:22:14.145525398Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 [must-gather] When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: [must-gather] ClusterID: d780227f-8ab6-4179-a738-9e6ca489c19d [must-gather] ClientVersion: 4.21.10 [must-gather] ClusterVersion: Stable at "4.21.24" [must-gather] ClusterOperators: [must-gather] clusteroperator/authentication is missing [must-gather] clusteroperator/cloud-credential is missing [must-gather] clusteroperator/cluster-autoscaler is missing [must-gather] clusteroperator/config-operator is missing [must-gather] clusteroperator/etcd is missing [must-gather] clusteroperator/machine-api is missing [must-gather] clusteroperator/machine-approver is missing [must-gather] clusteroperator/machine-config is missing [must-gather] clusteroperator/marketplace is missing [must-gather] [must-gather] [must-gather] [must-gather ] OUT 2026-07-09T19:22:14.198473375Z namespace/openshift-must-gather-jst5r created [must-gather] [must-gather ] OUT 2026-07-09T19:22:14.204192231Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-24gbx created [must-gather] [must-gather ] OUT 2026-07-09T19:22:14.236473352Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:21.126442870Z [disk usage checker] Started [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:21.129587637Z [disk usage checker] Volume usage percentage: current = 20 ; allowed = 70 [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:21.398953144Z Error from server (NotFound): namespaces "redhat-ods-operator" not found [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:21.569085630Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:21.569118369Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:21.569118369Z namespaces "redhat-ods-operator" not found [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:21.571466518Z Error getting logs from redhat-ods-operator [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:21.741604522Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:21.741635641Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:21.741635641Z namespaces "redhat-ods-monitoring" not found [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:21.743670083Z Error getting logs from redhat-ods-monitoring [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:21.915166958Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:21.915221561Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:21.915221561Z namespaces "redhat-ods-applications" not found [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:21.917362491Z Error getting logs from redhat-ods-applications [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.087497873Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.087598414Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.087598414Z namespaces "rhods-notebooks" not found [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.089978623Z Error getting logs from rhods-notebooks [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.254114291Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.254143927Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.254143927Z namespaces "rhoai-model-registries" not found [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.256247396Z Error getting logs from rhoai-model-registries [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.425848675Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.425878066Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.425878066Z namespaces "istio-system" not found [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.427984676Z Error getting logs from istio-system [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.594104290Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.594132836Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.594132836Z namespaces "knative-serving" not found [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.596797046Z Error getting logs from knative-serving [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.761649171Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.761682187Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.761682187Z namespaces "redhat-ods-applications-auth-provider" not found [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:22.763906981Z Error getting logs from redhat-ods-applications-auth-provider [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:23.054539525Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:23.352896368Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:23.496496300Z error: the server doesn't have a resource type "auths" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:23.580396547Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:23.582472036Z Error collecting info from [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:23.719977527Z error: the server doesn't have a resource type "monitorings" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:23.802642423Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:23.804551860Z Error collecting info from [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:23.940937655Z error: the server doesn't have a resource type "featuretrackers" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:24.021752113Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:24.023810206Z Error collecting info from [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:24.158520855Z error: the server doesn't have a resource type "codeflares" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:24.243106274Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:24.245255626Z Error collecting info from [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:24.386939316Z error: the server doesn't have a resource type "dashboards" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:24.468557561Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:24.470611125Z Error collecting info from [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:24.609264124Z error: the server doesn't have a resource type "datasciencepipelines" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:24.693508855Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:24.695570539Z Error collecting info from [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:24.829543548Z error: the server doesn't have a resource type "feastoperators" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:24.916239451Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:24.918744886Z Error collecting info from [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:25.053882920Z error: the server doesn't have a resource type "kserves" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:25.140989469Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:25.143074815Z Error collecting info from [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:25.278343848Z error: the server doesn't have a resource type "kueues" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:25.361583760Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:25.363681857Z Error collecting info from [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:25.499281746Z error: the server doesn't have a resource type "modelcontrollers" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:25.580704212Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:25.582894361Z Error collecting info from [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:25.715809845Z error: the server doesn't have a resource type "modelmeshservings" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:25.800061288Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:25.802555584Z Error collecting info from [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:25.938789336Z error: the server doesn't have a resource type "modelregistries" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:26.021088169Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:26.023040339Z Error collecting info from [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:26.134996884Z [disk usage checker] Volume usage percentage: current = 20 ; allowed = 70 [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:26.165102218Z error: the server doesn't have a resource type "rays" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:26.253139081Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:26.255244970Z Error collecting info from [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:26.389220716Z error: the server doesn't have a resource type "trainingoperators" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:26.473800438Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:26.475910405Z Error collecting info from [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:26.611627065Z error: the server doesn't have a resource type "trustyais" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:26.694034647Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:26.696128038Z Error collecting info from [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:26.835871146Z error: the server doesn't have a resource type "workbenches" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:26.917587376Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:26.919823640Z Error collecting info from [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:27.057743288Z error: the server doesn't have a resource type "hardwareprofiles" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:27.142304465Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:27.144497523Z Error collecting info from [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:27.282266192Z error: the server doesn't have a resource type "llamastackoperators" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:27.364696003Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:27.366956365Z Error collecting info from [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:28.105919425Z error: the server doesn't have a resource type "predictors" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:28.242689884Z error: the server doesn't have a resource type "localmodelnodegroups" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:28.372492325Z error: the server doesn't have a resource type "smcp" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:28.505253491Z error: the server doesn't have a resource type "smm" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:28.636900435Z error: the server doesn't have a resource type "smmr" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:29.251560993Z error: the server doesn't have a resource type "knativeservings" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:29.380013932Z error: the server doesn't have a resource type "configurations" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:29.520028754Z error: the server doesn't have a resource type "routes" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:29.660958398Z error: the server doesn't have a resource type "services" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:29.796851586Z error: the server doesn't have a resource type "revisions" [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:30.362485243Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:30.785225643Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:31.141612863Z [disk usage checker] Volume usage percentage: current = 20 ; allowed = 70 [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:31.518042213Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:31.871212109Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:32.038612347Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:32.388857394Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:33.124166349Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:33.494558459Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:33.665646263Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:34.007457329Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:34.732718752Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:35.098072339Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:35.274029182Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:35.615588161Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:36.146391367Z [disk usage checker] Volume usage percentage: current = 20 ; allowed = 70 [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:36.347847492Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:36.701898330Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:36.884987486Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:37.224563907Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:37.936432810Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:38.329823262Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:38.501427366Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:38.873159969Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:39.595558714Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:39.947688732Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:40.126297226Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:40.483844098Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:41.153408478Z [disk usage checker] Volume usage percentage: current = 19 ; allowed = 70 [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:41.264084487Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:41.666972367Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:41.852438923Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:42.233414008Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:43.035512380Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:43.429840072Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:43.603270827Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:43.947434350Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:44.664271782Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:45.038260588Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:45.209026808Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:45.568969186Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:46.158071850Z [disk usage checker] Volume usage percentage: current = 19 ; allowed = 70 [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:46.301829704Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:46.687333795Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:46.862450880Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:47.230212866Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:48.008155691Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:48.363852715Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:48.535532752Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:48.911696785Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:49.644243313Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:50.044639911Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:50.232443011Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:50.630023613Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:51.162697426Z [disk usage checker] Volume usage percentage: current = 19 ; allowed = 70 [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:51.351555146Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:51.732119348Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:51.903596594Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:52.243242254Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:52.984100739Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:53.369628764Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:53.540954752Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:53.881335799Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:54.638072325Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:55.021980827Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:55.196269266Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:55.612358830Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:56.167452912Z [disk usage checker] Volume usage percentage: current = 19 ; allowed = 70 [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:56.338117355Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:56.699463229Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:56.881434554Z Gathering data for ns/openshift-ingress... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:57.420074274Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:57.590083483Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:57.984032662Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:58.151595514Z Gathering data for ns/openshift-ingress... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:58.670267152Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:58.854350726Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:59.254689804Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:59.422314949Z Gathering data for ns/openshift-ingress... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:22:59.947698703Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:00.097804624Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:00.484221823Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:00.656823071Z Gathering data for ns/openshift-ingress... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:01.171982400Z [disk usage checker] Volume usage percentage: current = 19 ; allowed = 70 [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:01.185631417Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:01.340797732Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:01.763351697Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:01.940909414Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:02.532400340Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:02.739293035Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:03.147764297Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:03.314122885Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:03.876093283Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:04.077122158Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:04.492055271Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:04.659820929Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:05.217406699Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:05.398485122Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:05.798709186Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:05.966247111Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:06.176502166Z [disk usage checker] Volume usage percentage: current = 19 ; allowed = 70 [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:06.545646085Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:06.731253922Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:07.151608266Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:07.322565240Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:07.887960197Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:08.078995292Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:08.491684464Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:08.664352620Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:09.244138656Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:09.429691743Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:09.829417248Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:10.004681883Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:10.592106041Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:10.786652591Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:11.181235690Z [disk usage checker] Volume usage percentage: current = 19 ; allowed = 70 [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:11.201476457Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:11.369914376Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:12.053814142Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:12.273402389Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:12.677761522Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:12.846364204Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:13.426503856Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:13.624840421Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:14.025658636Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:14.192741629Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:14.761654269Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:14.951773903Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:15.355443791Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:15.527245781Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:16.089793469Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:16.186297913Z [disk usage checker] Volume usage percentage: current = 19 ; allowed = 70 [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:16.282118940Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:16.683272171Z Wrote inspect data to must-gather. [must-gather] [must-gather-rkht6] POD 2026-07-09T19:23:16.707453440Z Caches written to disk [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:17.720661526Z waiting for gather to complete [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:17.724173444Z downloading gather output [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.02320134Z receiving incremental file list [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.041193237Z ./ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.041397182Z aggregated-discovery-api.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.041874843Z aggregated-discovery-apis.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.042761262Z event-filter.html [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.045343839Z timestamp [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.045512333Z version [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.045979423Z cluster-scoped-resources/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.045989583Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.045998503Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.046025094Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.046092545Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.046099696Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.046144477Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.046211408Z namespaces/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.046222338Z namespaces/kserve-ci-e2e-test/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.046250229Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.046342131Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.046378732Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.046417773Z namespaces/kserve-ci-e2e-test/apps/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.046457964Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.046540315Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.046842452Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.0472093Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.047255341Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.047319263Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.047379114Z namespaces/kserve-ci-e2e-test/batch/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.047420245Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.047506747Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.047567168Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.047605349Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.047689181Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.047735072Z namespaces/kserve-ci-e2e-test/core/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.047778723Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.047908925Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.048017648Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.054117882Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.054219615Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.054621064Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.054797548Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.055059483Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.055133735Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.05535869Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.055400541Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.055411411Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.055420681Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.055434351Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.055529804Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.055560244Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.055574755Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.055681847Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.055718918Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.055741448Z namespaces/kserve-ci-e2e-test/pods/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.055753749Z namespaces/kserve-ci-e2e-test/pods/e2e-pvc-model-download-24fsq/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.05579139Z namespaces/kserve-ci-e2e-test/pods/e2e-pvc-model-download-24fsq/e2e-pvc-model-download-24fsq.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.055871821Z namespaces/kserve-ci-e2e-test/pods/e2e-pvc-model-download-24fsq/storage-initializer/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.055882292Z namespaces/kserve-ci-e2e-test/pods/e2e-pvc-model-download-24fsq/storage-initializer/storage-initializer/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.055887281Z namespaces/kserve-ci-e2e-test/pods/e2e-pvc-model-download-24fsq/storage-initializer/storage-initializer/logs/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.055911222Z namespaces/kserve-ci-e2e-test/pods/e2e-pvc-model-download-24fsq/storage-initializer/storage-initializer/logs/current.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.056661279Z namespaces/kserve-ci-e2e-test/pods/e2e-pvc-model-download-24fsq/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.05673374Z namespaces/kserve-ci-e2e-test/pods/e2e-pvc-model-download-24fsq/storage-initializer/storage-initializer/logs/previous.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.056778321Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-5f8bbcf7c7-755f5/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.056835282Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-5f8bbcf7c7-755f5/router-gateway-1-openshift-default-5f8bbcf7c7-755f5.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.056981456Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-5f8bbcf7c7-755f5/istio-proxy/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.056989796Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-5f8bbcf7c7-755f5/istio-proxy/istio-proxy/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.056994656Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-5f8bbcf7c7-755f5/istio-proxy/istio-proxy/logs/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.057031137Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-5f8bbcf7c7-755f5/istio-proxy/istio-proxy/logs/current.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.057210581Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-5f8bbcf7c7-755f5/istio-proxy/istio-proxy/logs/previous.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.057350044Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-65d6b86cbf-m4ddf/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.057386134Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-65d6b86cbf-m4ddf/router-gateway-2-openshift-default-65d6b86cbf-m4ddf.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.057515168Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-65d6b86cbf-m4ddf/istio-proxy/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.057522428Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-65d6b86cbf-m4ddf/istio-proxy/istio-proxy/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.057526948Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-65d6b86cbf-m4ddf/istio-proxy/istio-proxy/logs/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.057575329Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-65d6b86cbf-m4ddf/istio-proxy/istio-proxy/logs/current.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.057732152Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-65d6b86cbf-m4ddf/istio-proxy/istio-proxy/logs/previous.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.057836595Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.057868315Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4/scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.057967378Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4/llm-d-routing-sidecar/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.057975058Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4/llm-d-routing-sidecar/llm-d-routing-sidecar/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.057980178Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4/llm-d-routing-sidecar/llm-d-routing-sidecar/logs/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.058023879Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4/llm-d-routing-sidecar/llm-d-routing-sidecar/logs/current.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.058308655Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4/llm-d-routing-sidecar/llm-d-routing-sidecar/logs/previous.insecure.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.058383367Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4/llm-d-routing-sidecar/llm-d-routing-sidecar/logs/previous.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.058422337Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4/main/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.058429298Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4/main/main/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.058439498Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4/main/main/logs/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.058474639Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4/main/main/logs/current.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.058589601Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4/main/main/logs/previous.insecure.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.058660043Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-dwjs4/main/main/logs/previous.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.058688983Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.058732104Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.058817646Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj/main/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.058825717Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj/main/main/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.058829686Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj/main/main/logs/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.058866667Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj/main/main/logs/current.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.05899305Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj/main/main/logs/previous.insecure.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.059062212Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-kz6fj/main/main/logs/previous.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.059095362Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-router-scheduler-597gpth/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.059140883Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-router-scheduler-597gpth/scheduler-v06-pd-migration-test-kserve-router-scheduler-597gpth.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.059234606Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-router-scheduler-597gpth/main/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.059244046Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-router-scheduler-597gpth/main/main/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.059248016Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-router-scheduler-597gpth/main/main/logs/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.059280647Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-router-scheduler-597gpth/main/main/logs/current.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.060005672Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-router-scheduler-597gpth/main/main/logs/previous.insecure.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.060073494Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-router-scheduler-597gpth/main/main/logs/previous.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.060109395Z namespaces/kserve-ci-e2e-test/policy/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.060147666Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.060205087Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.060244088Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.060314549Z namespaces/kuadrant-system/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.06036172Z namespaces/kuadrant-system/kuadrant-system.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.060425662Z namespaces/kuadrant-system/apps.openshift.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.060464913Z namespaces/kuadrant-system/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.060545234Z namespaces/kuadrant-system/apps/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.060597736Z namespaces/kuadrant-system/apps/daemonsets.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.060685698Z namespaces/kuadrant-system/apps/deployments.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.060972044Z namespaces/kuadrant-system/apps/replicasets.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.06124344Z namespaces/kuadrant-system/apps/statefulsets.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.061324292Z namespaces/kuadrant-system/autoscaling/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.061372323Z namespaces/kuadrant-system/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.061422994Z namespaces/kuadrant-system/batch/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.061464215Z namespaces/kuadrant-system/batch/cronjobs.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.061547777Z namespaces/kuadrant-system/batch/jobs.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.061589407Z namespaces/kuadrant-system/build.openshift.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.061641199Z namespaces/kuadrant-system/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.06171924Z namespaces/kuadrant-system/build.openshift.io/builds.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.061778802Z namespaces/kuadrant-system/core/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.061806772Z namespaces/kuadrant-system/core/configmaps.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.061968226Z namespaces/kuadrant-system/core/endpoints.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.062095578Z namespaces/kuadrant-system/core/events.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.062543798Z namespaces/kuadrant-system/core/persistentvolumeclaims.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.06262386Z namespaces/kuadrant-system/core/pods.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.062996188Z namespaces/kuadrant-system/core/replicationcontrollers.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.063129271Z namespaces/kuadrant-system/core/secrets.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.063375537Z namespaces/kuadrant-system/core/services.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.063495689Z namespaces/kuadrant-system/discovery.k8s.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.0635247Z namespaces/kuadrant-system/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.063640823Z namespaces/kuadrant-system/image.openshift.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.063666983Z namespaces/kuadrant-system/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.063725774Z namespaces/kuadrant-system/k8s.ovn.org/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.063760285Z namespaces/kuadrant-system/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.063853727Z namespaces/kuadrant-system/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.063883738Z namespaces/kuadrant-system/monitoring.coreos.com/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.063937919Z namespaces/kuadrant-system/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.06398855Z namespaces/kuadrant-system/networking.k8s.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.064020301Z namespaces/kuadrant-system/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.064072652Z namespaces/kuadrant-system/pods/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.064080882Z namespaces/kuadrant-system/pods/authorino-7c77957575-8rb4q/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.064125533Z namespaces/kuadrant-system/pods/authorino-7c77957575-8rb4q/authorino-7c77957575-8rb4q.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.064328588Z namespaces/kuadrant-system/pods/authorino-7c77957575-8rb4q/authorino/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.064338868Z namespaces/kuadrant-system/pods/authorino-7c77957575-8rb4q/authorino/authorino/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.064342788Z namespaces/kuadrant-system/pods/authorino-7c77957575-8rb4q/authorino/authorino/logs/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.064376979Z namespaces/kuadrant-system/pods/authorino-7c77957575-8rb4q/authorino/authorino/logs/current.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.067262383Z namespaces/kuadrant-system/pods/authorino-7c77957575-8rb4q/authorino/authorino/logs/previous.insecure.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.067351714Z namespaces/kuadrant-system/pods/authorino-7c77957575-8rb4q/authorino/authorino/logs/previous.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.067433936Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-trkjt/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.067449757Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-trkjt/authorino-operator-6d85f6564-trkjt.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.067552249Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-trkjt/manager/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.067561479Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-trkjt/manager/manager/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.067565539Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-trkjt/manager/manager/logs/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.067572519Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-trkjt/manager/manager/logs/current.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.067760923Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-trkjt/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.067829175Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-trkjt/manager/manager/logs/previous.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.067858546Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-94pfn/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.067905587Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-94pfn/dns-operator-controller-manager-65b49595d7-94pfn.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.067993749Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-94pfn/manager/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.068001769Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-94pfn/manager/manager/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.068005699Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-94pfn/manager/manager/logs/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.068029729Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-94pfn/manager/manager/logs/current.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.068145552Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-94pfn/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.068207093Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-94pfn/manager/manager/logs/previous.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.068239104Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-r9kdf/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.068301926Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-r9kdf/kuadrant-console-plugin-85fd4b8b9d-r9kdf.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.068380157Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-r9kdf/kuadrant-console-plugin/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.068387967Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-r9kdf/kuadrant-console-plugin/kuadrant-console-plugin/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.068392028Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-r9kdf/kuadrant-console-plugin/kuadrant-console-plugin/logs/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.068432398Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-r9kdf/kuadrant-console-plugin/kuadrant-console-plugin/logs/current.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.06851002Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-r9kdf/kuadrant-console-plugin/kuadrant-console-plugin/logs/previous.insecure.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.068577601Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-r9kdf/kuadrant-console-plugin/kuadrant-console-plugin/logs/previous.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.068617933Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-4x4rk/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.068656653Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-4x4rk/kuadrant-operator-controller-manager-bb7ddb7d7-4x4rk.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.068757885Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-4x4rk/manager/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.068767046Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-4x4rk/manager/manager/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.068771786Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-4x4rk/manager/manager/logs/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.068813247Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-4x4rk/manager/manager/logs/current.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.074806209Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-4x4rk/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.07487628Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-4x4rk/manager/manager/logs/previous.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.074913381Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-xw8v8/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.074964302Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-xw8v8/limitador-limitador-69574b596d-xw8v8.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.075059924Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-xw8v8/limitador/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.075069555Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-xw8v8/limitador/limitador/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.075074655Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-xw8v8/limitador/limitador/logs/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.075104405Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-xw8v8/limitador/limitador/logs/current.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.075192887Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-xw8v8/limitador/limitador/logs/previous.insecure.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.075259169Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-xw8v8/limitador/limitador/logs/previous.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.07531346Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-8kx2v/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.075352421Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-8kx2v/limitador-operator-controller-manager-6f9f468797-8kx2v.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.075448873Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-8kx2v/manager/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.075456683Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-8kx2v/manager/manager/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.075461303Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-8kx2v/manager/manager/logs/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.075498024Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-8kx2v/manager/manager/logs/current.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.075660078Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-8kx2v/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.075725489Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-8kx2v/manager/manager/logs/previous.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.0757631Z namespaces/kuadrant-system/policy/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.075798341Z namespaces/kuadrant-system/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.075844692Z namespaces/kuadrant-system/route.openshift.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.075890563Z namespaces/kuadrant-system/route.openshift.io/routes.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.075930874Z namespaces/openshift-ingress/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.075983485Z namespaces/openshift-ingress/openshift-ingress.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.076047146Z namespaces/openshift-ingress/apps.openshift.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.076088597Z namespaces/openshift-ingress/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.076133268Z namespaces/openshift-ingress/apps/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.076173299Z namespaces/openshift-ingress/apps/daemonsets.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.076252481Z namespaces/openshift-ingress/apps/deployments.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.076606809Z namespaces/openshift-ingress/apps/replicasets.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.076840114Z namespaces/openshift-ingress/apps/statefulsets.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.076889825Z namespaces/openshift-ingress/autoscaling/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.076935306Z namespaces/openshift-ingress/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.077001537Z namespaces/openshift-ingress/batch/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.077045928Z namespaces/openshift-ingress/batch/cronjobs.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.07712214Z namespaces/openshift-ingress/batch/jobs.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.077168411Z namespaces/openshift-ingress/build.openshift.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.077209862Z namespaces/openshift-ingress/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.077312794Z namespaces/openshift-ingress/build.openshift.io/builds.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.077377966Z namespaces/openshift-ingress/core/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.077424297Z namespaces/openshift-ingress/core/configmaps.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.077892357Z namespaces/openshift-ingress/core/endpoints.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.077993169Z namespaces/openshift-ingress/core/events.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.078236565Z namespaces/openshift-ingress/core/persistentvolumeclaims.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.078345867Z namespaces/openshift-ingress/core/pods.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.078655994Z namespaces/openshift-ingress/core/replicationcontrollers.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.078773106Z namespaces/openshift-ingress/core/secrets.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.079001891Z namespaces/openshift-ingress/core/services.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.079092684Z namespaces/openshift-ingress/discovery.k8s.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.079133334Z namespaces/openshift-ingress/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.079213656Z namespaces/openshift-ingress/image.openshift.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.079246907Z namespaces/openshift-ingress/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.079320369Z namespaces/openshift-ingress/k8s.ovn.org/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.079365219Z namespaces/openshift-ingress/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.079453541Z namespaces/openshift-ingress/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.079496822Z namespaces/openshift-ingress/monitoring.coreos.com/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.079538883Z namespaces/openshift-ingress/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.079591035Z namespaces/openshift-ingress/networking.k8s.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.079627925Z namespaces/openshift-ingress/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.079674336Z namespaces/openshift-ingress/pods/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.079683186Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.079711247Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/istiod-openshift-gateway-94bb8fbfd-4wpb9.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.07982772Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/discovery/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.07983452Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/discovery/discovery/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.07983863Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/discovery/discovery/logs/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.079870341Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/discovery/discovery/logs/current.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.101331084Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/discovery/discovery/logs/previous.insecure.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.101407646Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/discovery/discovery/logs/previous.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.101449597Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.101493928Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.10161232Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/istio-proxy/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.101621821Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/istio-proxy/istio-proxy/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.101626751Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/istio-proxy/istio-proxy/logs/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.101657891Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/istio-proxy/istio-proxy/logs/current.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.102694264Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/istio-proxy/istio-proxy/logs/previous.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.102852318Z namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.102894199Z namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router-default-6fd9c96588-sbl55.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.103028792Z namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.103035652Z namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router/router/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.103039522Z namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router/router/logs/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.103077673Z namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router/router/logs/current.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.103190825Z namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router/router/logs/previous.insecure.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.103257647Z namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router/router/logs/previous.log [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.103303518Z namespaces/openshift-ingress/policy/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.103351559Z namespaces/openshift-ingress/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.10339468Z namespaces/openshift-ingress/route.openshift.io/ [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.103442701Z namespaces/openshift-ingress/route.openshift.io/routes.yaml [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.11246246Z [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.112520621Z sent 3,443 bytes received 1,145,141 bytes 765,722.67 bytes/sec [must-gather] [must-gather-rkht6] OUT 2026-07-09T19:23:18.112540991Z total size is 14,136,759 speedup is 12.31 [must-gather] [must-gather ] OUT 2026-07-09T19:23:18.354012639Z namespace/openshift-must-gather-jst5r deleted [must-gather] [must-gather] [must-gather] Reprinting Cluster State: [must-gather] When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: [must-gather] ClusterID: d780227f-8ab6-4179-a738-9e6ca489c19d [must-gather] ClientVersion: 4.21.10 [must-gather] ClusterVersion: Stable at "4.21.24" [must-gather] ClusterOperators: [must-gather] clusteroperator/authentication is missing [must-gather] clusteroperator/cloud-credential is missing [must-gather] clusteroperator/cluster-autoscaler is missing [must-gather] clusteroperator/config-operator is missing [must-gather] clusteroperator/etcd is missing [must-gather] clusteroperator/machine-api is missing [must-gather] clusteroperator/machine-approver is missing [must-gather] clusteroperator/machine-config is missing [must-gather] clusteroperator/marketplace is missing [must-gather] [must-gather] [must-gather] [must-gather ] OUT 2026-07-09T19:23:18.483435584Z Using must-gather plug-in image: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ec435553f79197f28a94d55da851b8302383238997d790ed3335149e3ee4341f [must-gather] When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: [must-gather] ClusterID: d780227f-8ab6-4179-a738-9e6ca489c19d [must-gather] ClientVersion: 4.21.10 [must-gather] ClusterVersion: Stable at "4.21.24" [must-gather] ClusterOperators: [must-gather] clusteroperator/authentication is missing [must-gather] clusteroperator/cloud-credential is missing [must-gather] clusteroperator/cluster-autoscaler is missing [must-gather] clusteroperator/config-operator is missing [must-gather] clusteroperator/etcd is missing [must-gather] clusteroperator/machine-api is missing [must-gather] clusteroperator/machine-approver is missing [must-gather] clusteroperator/machine-config is missing [must-gather] clusteroperator/marketplace is missing [must-gather] [must-gather] [must-gather] [must-gather ] OUT 2026-07-09T19:23:18.50683733Z namespace/openshift-must-gather-vv9mp created [must-gather] [must-gather ] OUT 2026-07-09T19:23:18.517039855Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-pcqx7 created [must-gather] [must-gather ] OUT 2026-07-09T19:23:18.551633509Z pod for plug-in image quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ec435553f79197f28a94d55da851b8302383238997d790ed3335149e3ee4341f created [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:19.982656065Z [disk usage checker] Started [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:19.986015496Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:20.209100294Z Gathering data for ns/openshift-cluster-version... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:20.365066286Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:20.472078671Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:20.593776705Z Gathering data for ns/default... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:20.972956947Z Gathering data for ns/openshift... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:21.505065630Z Gathering data for ns/kube-system... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:22.297200304Z Gathering data for ns/openshift-etcd... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:22.662957847Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:22.663053255Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:22.663053255Z namespaces "assisted-installer" not found [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:22.991310184Z Waiting on subprocesses to finish execution. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:22.999133114Z INFO: Gathering on-disk MachineConfig from degraded nodes [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.001820695Z INFO: Collecting host service logs for crio [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.002160960Z INFO: Collecting host service logs for kubelet [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.002537605Z INFO: Collecting host service logs for rpm-ostreed [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.002933123Z INFO: Collecting host service logs for ostree-finalize-staged [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.003458319Z INFO: Collecting host service logs for machine-config-daemon-firstboot [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.003828739Z INFO: Collecting host service logs for machine-config-daemon-host [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.004170661Z INFO: Collecting host service logs for NetworkManager [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.004414389Z INFO: Gathering HAProxy config files [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.004538330Z INFO: Collecting host service logs for openvswitch [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.004861176Z INFO: Collecting host service logs for ovs-configuration [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.005211649Z INFO: Collecting host service logs for ovsdb-server [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.005810253Z INFO: Collecting host service logs for ovs-vswitchd [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.006221960Z INFO: Waiting for worker host service log collection to complete ... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.007389578Z INFO: Gathering machine config daemon's old logs from all nodes [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.018650234Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.025398164Z Executing Istio gather script [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.140891976Z INFO: Waiting for node performance related collection to complete ... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.764015357Z INFO: Collecting Insights Archives from insights-operator-68d9dd94cf-x6k6c [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.764015357Z insights-runtime-extractor-f2fxq [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.764015357Z insights-runtime-extractor-kmvpf [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.764015357Z insights-runtime-extractor-x4475 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:23.958633802Z No resources found [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:24.222829846Z No resources found in openshift-etcd namespace. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:24.225705444Z INFO: Found 1 replicas - prometheus-k8s-0 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:24.272489776Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:24.365971601Z INFO: Waiting for on-disk MachineConfig collection to complete ... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:24.366046903Z INFO: on-disk MachineConfig config collection complete. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:24.414675983Z INFO: "sriov-network-operator" not detected. Skipping. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:24.469925118Z error: the server doesn't have a resource type "performanceprofile" [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:24.487879905Z INFO: Worker host service log collection to complete. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:24.524104034Z INFO: namespace openshift-frr-k8s not detected. Skipping. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:24.581738431Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:24.581738431Z See 'oc rsync -h' for help and examples [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:24.696212478Z INFO: "metallb-operator" not detected. Skipping. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:24.712465136Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:24.761407189Z INFO: Getting alertmanagers from prometheus-k8s-0 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:24.998399333Z ERROR: No running kube-apiserver pods found [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:25.098974962Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:25.237977551Z INFO: Waiting for HAProxy config collection to complete ... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:25.248960906Z INFO: 'previous-logs' folder not found on ip-10-0-140-224.ec2.internal, skipping... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:25.273310341Z No resources found [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:25.715435432Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:25.777940403Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:25.865813161Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:25.931978131Z error: the server doesn't have a resource type "multi-networkpolicy" [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:26.012504631Z INFO: HAProxy config collection complete. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:26.124740008Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:26.229086572Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:26.243125373Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:26.302637011Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:26.330309100Z INFO: Getting rules from prometheus-k8s-0 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:26.354987810Z Inspecting resource clusterrole.rbac.authorization.k8s.io/istio-reader-clusterrole-openshift-gateway-openshift-ingress [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:26.373267713Z error: the server doesn't have a resource type "machineconfigs" [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:26.643656302Z INFO: 'previous-logs' folder not found on ip-10-0-141-82.ec2.internal, skipping... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:26.705609619Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:26.744016984Z error: the server doesn't have a resource type "machineconfigpools" [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:26.831511360Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:26.835622840Z Inspecting resource clusterrole.rbac.authorization.k8s.io/istiod-clusterrole-openshift-gateway-openshift-ingress [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:27.203666662Z INFO: 'previous-logs' folder not found on ip-10-0-143-79.ec2.internal, skipping... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:27.203666662Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:27.203666662Z INFO: Machine Config Daemon termination log collection complete. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:27.242989793Z INFO: Getting status/config from prometheus-k8s-0 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:27.253753770Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:27.274267703Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:27.320291383Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:27.348415309Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:27.351926115Z Inspecting resource clusterrole.rbac.authorization.k8s.io/istiod-gateway-controller-openshift-gateway-openshift-ingress [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:27.533499509Z error: the server doesn't have a resource type "kubeletconfigs" [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:27.682008161Z W0709 19:23:27.681961 1212 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:27.709018594Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:27.732779632Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:27.789212284Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:27.795422979Z Inspecting resource clusterrolebinding.rbac.authorization.k8s.io/istio-reader-clusterrole-openshift-gateway-openshift-ingress [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:27.959545264Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.032113187Z INFO: Getting status/flags from prometheus-k8s-0 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.066140721Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.155698882Z Gathering data for ns/openshift-monitoring... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.250705622Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.253967430Z Inspecting resource clusterrolebinding.rbac.authorization.k8s.io/istiod-clusterrole-openshift-gateway-openshift-ingress [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.256904453Z INFO: INTERCONNECT MODE [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.256980511Z INFO: Gathering ovn-kubernetes DBs [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.365508728Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.366108320Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.501061565Z INFO: Gathering OVN_Northbound from ovnkube-node-5s8lz... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.501414206Z INFO: Gathering OVN_Northbound from ovnkube-node-hvbkx... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.501692683Z INFO: Gathering OVN_Northbound from ovnkube-node-zqxhn... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.501998731Z INFO: Gathering OVN_Southbound from ovnkube-node-5s8lz... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.502500103Z INFO: Gathering OVN_Southbound from ovnkube-node-hvbkx... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.502798668Z INFO: Gathering OVN_Southbound from ovnkube-node-zqxhn... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.712313960Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.716189009Z Inspecting resource clusterrolebinding.rbac.authorization.k8s.io/istiod-gateway-controller-openshift-gateway-openshift-ingress [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.723094852Z INFO: Getting targets?state=active from prometheus-k8s-0 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.879641214Z tar: Removing leading `/' from member names [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.880705787Z tar: Removing leading `/' from member names [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.913792302Z tar: Removing leading `/' from member names [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.946213730Z tar: Removing leading `/' from member names [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.950794409Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.954457620Z tar: Removing leading `/' from member names [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:28.961664238Z tar: Removing leading `/' from member names [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:29.081446286Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:29.114757489Z INFO: Getting status/tsdb from prometheus-k8s-0 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:29.322951731Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:29.575060917Z INFO: Waiting for network log collection to complete ... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:29.575437254Z INFO: Waiting for ovnk database copies to complete ... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:29.575992704Z INFO: Copying ovnk databases complete. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:29.578107598Z 7.2M must-gather/network_logs/ovnk_database_store [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:29.581168186Z ovnk_database_store/ [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:29.581168186Z ovnk_database_store/ovnkube-node-5s8lz_sbdb [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:29.604268141Z INFO: Getting status from alertmanager-main-0 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:29.622907730Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:29.629284632Z ovnk_database_store/ovnkube-node-5s8lz_nbdb [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:29.646757581Z ovnk_database_store/ovnkube-node-hvbkx_nbdb [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:29.664484662Z ovnk_database_store/ovnkube-node-zqxhn_nbdb [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:29.682780218Z ovnk_database_store/ovnkube-node-zqxhn_sbdb [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:29.735271201Z ovnk_database_store/ovnkube-node-hvbkx_sbdb [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:29.785707224Z INFO: Network log collection complete. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:29.981862124Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:30.115037217Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:30.234152852Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:30.264796958Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:30.585369493Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:30.587827450Z INFO: Fallback to identify the container image from release info [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:30.774872254Z Gathering data for ns/openshift-network-console... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:31.170973322Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d8d5dc4ea635b13544e6f92103089219e732369ae30557b7beee2e8a11bf500d [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:31.253080855Z Inspecting resource crd/authorizationpolicies.security.istio.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:31.286438519Z Gathering data for ns/openshift-console-operator... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:31.309453749Z daemonset.apps/perf-node-gather-daemonset created [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:31.487472386Z Waiting for performance profile collector pods to become ready: 1 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:31.488948743Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:31.718639176Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:31.721999894Z Inspecting resource crd/destinationrules.networking.istio.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:31.808853913Z Gathering data for ns/openshift-console... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:32.011175523Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:32.228346041Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:32.231708294Z Inspecting resource crd/envoyfilters.networking.istio.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:32.421010833Z Gathering data for ns/openshift-cluster-storage-operator... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:32.439182581Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:32.635981283Z Waiting for performance profile collector pods to become ready: 2 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:32.698599931Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:32.701252969Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:32.910283938Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:33.046134728Z Gathering data for ns/openshift-dns-operator... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:33.158546501Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:33.161062268Z Inspecting resource crd/gateways.gateway.networking.k8s.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:33.396920704Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:33.430307482Z Gathering data for ns/openshift-dns... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:33.603973892Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:33.606382897Z Inspecting resource crd/gateways.networking.istio.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:33.789746593Z Waiting for performance profile collector pods to become ready: 3 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:33.819590113Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:34.034561170Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:34.036944907Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:34.178166651Z Gathering data for ns/openshift-image-registry... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:34.248979810Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:34.475563865Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:34.478418493Z Inspecting resource crd/httproutes.gateway.networking.k8s.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:34.707062488Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:34.796732601Z Gathering data for ns/openshift-ingress-operator... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:34.954676754Z Waiting for performance profile collector pods to become ready: 4 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:34.967157921Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:34.969279164Z Inspecting resource crd/inferencemodelrewrites.inference.networking.x-k8s.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:35.120065107Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:35.175264067Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:35.239598582Z Gathering data for ns/openshift-ingress... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:35.424909902Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:35.427784411Z Inspecting resource crd/inferenceobjectives.inference.networking.x-k8s.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:35.644975778Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:35.880804047Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:35.883664002Z Inspecting resource crd/inferencepoolimports.inference.networking.x-k8s.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:36.094611672Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:36.118869349Z Waiting for performance profile collector pods to become ready: 5 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:36.236590614Z Gathering data for ns/openshift-ingress-canary... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:36.316714953Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:36.318990396Z Inspecting resource crd/inferencepools.inference.networking.k8s.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:36.530493545Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:36.733630406Z Gathering data for ns/openshift-insights... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:36.770182465Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:36.772983915Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:36.937771843Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:37.160729549Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:37.163641185Z Inspecting resource crd/peerauthentications.security.istio.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:37.264327001Z Waiting for performance profile collector pods to become ready: 6 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:37.362616925Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:37.592636748Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:37.594849261Z Inspecting resource crd/proxyconfigs.networking.istio.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:37.769451348Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:37.979503780Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:37.982351698Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:38.163836907Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:38.372950130Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:38.376274991Z Inspecting resource crd/requestauthentications.security.istio.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:38.413716899Z Waiting for performance profile collector pods to become ready: 7 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:38.583320348Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:38.785744528Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:38.788109671Z Inspecting resource crd/serviceentries.networking.istio.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:39.003148035Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:39.218539355Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:39.220930791Z Inspecting resource crd/sidecars.networking.istio.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:39.421121823Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:39.568494770Z Daemonset perf-node-gather-daemonset ready 3 out of 3 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:39.652378523Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:39.668948621Z Inspecting resource crd/telemetries.telemetry.istio.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:39.891809431Z Collecting performance related data for node ip-10-0-140-224.ec2.internal [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:39.899352316Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:39.908794055Z Collecting performance related data for node ip-10-0-141-82.ec2.internal [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:39.919353354Z Collecting performance related data for node ip-10-0-143-79.ec2.internal [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:40.064442342Z Gathering data for ns/openshift-lws-operator... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:40.125115630Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:40.172734194Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:40.175141396Z Inspecting resource crd/virtualservices.networking.istio.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:40.446271345Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:40.734105829Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:40.737040449Z Inspecting resource crd/wasmplugins.extensions.istio.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:40.915583829Z Gathering data for ns/kserve... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:40.976491111Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:41.285999102Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:41.290551647Z Inspecting resource crd/workloadentries.networking.istio.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:41.599193352Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:41.879013466Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:41.883268731Z Inspecting resource crd/workloadgroups.networking.istio.io [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:42.062837660Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:42.302561150Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:42.439577143Z Inspecting resource mutatingwebhookconfiguration.admissionregistration.k8s.io/istio-sidecar-injector-openshift-gateway-openshift-ingress [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:42.705766371Z Gathering data for ns/openshift-ingress... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:43.421435740Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:43.561946588Z Gathering data for ns/openshift-config... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:43.615560407Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:43.763932730Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:43.918157764Z Inspecting resource validatingwebhookconfiguration.admissionregistration.k8s.io/istio-validator-openshift-gateway-openshift-ingress [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:43.944639561Z Gathering data for ns/openshift-config-managed... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:44.161899383Z Gathering data for ns/openshift-ingress... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:44.536644133Z Gathering data for ns/openshift-kube-apiserver-operator... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:44.852626157Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:44.926746096Z Gathering data for ns/openshift-kube-apiserver... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:45.108111404Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:45.130407755Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:45.276080268Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:45.356300591Z Gathering data for ns/openshift-kube-controller-manager... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:45.773202226Z Gathering data for ns/openshift-kube-controller-manager-operator... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:45.864360601Z Done executing Istio gather script [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:46.164183046Z Gathering data for ns/openshift-kube-scheduler... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:46.527865472Z Gathering data for ns/openshift-kube-scheduler-operator... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:46.887044400Z Gathering data for ns/openshift-kube-storage-version-migrator... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:47.334135252Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:47.709835604Z Gathering data for ns/openshift-user-workload-monitoring... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:48.276198024Z Gathering data for ns/openshift-multus... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:48.829412968Z Collecting kubelet logs for node ip-10-0-140-224.ec2.internal [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:48.831144357Z Collecting kubelet logs for node ip-10-0-141-82.ec2.internal [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:48.833104609Z Collecting kubelet logs for node ip-10-0-143-79.ec2.internal [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:49.246778585Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-vv9mp namespace [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:49.252899992Z INFO: Node performance data collection complete. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:49.974145826Z Gathering data for ns/openshift-ovn-kubernetes... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:50.135137777Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:51.546926247Z Gathering data for ns/openshift-host-network... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:51.933415423Z Gathering data for ns/openshift-network-diagnostics... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:52.559131323Z Gathering data for ns/openshift-network-node-identity... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:53.037459043Z Gathering data for ns/openshift-network-operator... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:53.475481339Z Gathering data for ns/openshift-cloud-network-config-controller... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:53.808488973Z Gathering data for ns/openshift-cluster-node-tuning-operator... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:54.353984665Z Gathering data for ns/openshift-apiserver-operator... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:54.725714393Z Gathering data for ns/openshift-apiserver... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:55.142735488Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70 [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:55.182614838Z Gathering data for ns/openshift-controller-manager-operator... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:55.494462802Z Gathering data for ns/openshift-controller-manager... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:55.828891883Z Gathering data for ns/openshift-cluster-samples-operator... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:56.553307929Z Gathering data for ns/openshift-operator-lifecycle-manager... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:56.878802270Z Gathering data for ns/openshift-service-ca-operator... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:57.232036261Z Gathering data for ns/openshift-service-ca... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:57.667917470Z Gathering data for ns/openshift-cluster-csi-drivers... [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:58.816951563Z Wrote inspect data to must-gather. [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:58.817008794Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:58.817008794Z skipping gathering secrets/support due to error: secrets "support" not found [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:58.960023422Z error: the server doesn't have a resource type "clusters" [must-gather] [must-gather-t6bfs] POD 2026-07-09T19:23:59.127006161Z Caches written to disk [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.139214454Z waiting for gather to complete [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.143347255Z downloading gather output [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.42539776Z receiving incremental file list [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.448224953Z ./ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.448411897Z aggregated-discovery-api.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.448747944Z aggregated-discovery-apis.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.449880569Z event-filter.html [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.452737062Z timestamp [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.452799593Z version [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.458902988Z cluster-scoped-resources/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.458927498Z cluster-scoped-resources/admissionregistration.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.458941649Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicies/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.459087702Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicies/default-network-annotation.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.459261256Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicies/servicecidrs.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.459380698Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicies/user-defined-networks-namespace-label.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.45944618Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicybindings/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.459513641Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicybindings/default-network-annotation-binding.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.459593573Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicybindings/servicecidrs-binding.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.459684395Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicybindings/user-defined-networks-namespace-label-binding.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.459820178Z cluster-scoped-resources/admissionregistration.k8s.io/validatingwebhookconfigurations/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.459877549Z cluster-scoped-resources/admissionregistration.k8s.io/validatingwebhookconfigurations/multus.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.460006322Z cluster-scoped-resources/admissionregistration.k8s.io/validatingwebhookconfigurations/network-node-identity.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.460081254Z cluster-scoped-resources/apiextensions.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.460528994Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.460575735Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/accounts.nim.opendatahub.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.460943423Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/adminnetworkpolicies.policy.networking.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.461220659Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/adminpolicybasedexternalroutes.k8s.ovn.org.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.461465214Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/alertingrules.monitoring.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.461616268Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/alertmanagerconfigs.monitoring.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.465528164Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/alertmanagers.monitoring.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.467328323Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/alertrelabelconfigs.monitoring.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.467476857Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/apikeyapprovals.devportal.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.467596019Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/apikeyrequests.devportal.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.467705212Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/apikeys.devportal.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.467836475Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/apiproducts.devportal.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.468338156Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/apirequestcounts.apiserver.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.468473089Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/apiservers.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.468634822Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/appliedmanifestworks.work.open-cluster-management.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.468755925Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/authconfigs.authorino.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.469552052Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/authentications.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.469810698Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/authorinos.operator.authorino.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.469936231Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/authorizationpolicies.security.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.470102464Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/authpolicies.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.471434894Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/baselineadminnetworkpolicies.policy.networking.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.471674009Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/builds.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.471842933Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/bundles.trust.cert-manager.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.471996396Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/catalogsources.operators.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.472320533Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/certificaterequests.cert-manager.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.472453916Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/certificates.cert-manager.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.472657351Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/certmanagers.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.472921477Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/challenges.acme.cert-manager.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.473624062Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/cloudcredentials.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.473747545Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/cloudeventsources.eventing.keda.sh.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.473864727Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/cloudprivateipconfigs.cloud.network.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.47397536Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterclaims.cluster.open-cluster-management.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.474076942Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clustercloudeventsources.eventing.keda.sh.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.474183894Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clustercsidrivers.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.474372269Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterimagepolicies.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.474556253Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterissuers.cert-manager.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.47536186Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusteroperators.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.475491533Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterresourcequotas.quota.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.475615876Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterserviceversions.operators.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.477645191Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterstoragecontainers.serving.kserve.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.477859975Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clustertriggerauthentications.keda.sh.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.478020039Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusteruserdefinednetworks.k8s.ovn.org.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.478259444Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterversions.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.478579221Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/configs.imageregistry.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.479001641Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/configs.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.479116763Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/configs.samples.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.479241716Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consoleclidownloads.console.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.479372759Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consoleexternalloglinks.console.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.479475751Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consolelinks.console.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.479591064Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consolenotifications.console.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.479701376Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consoleplugins.console.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.479847849Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consolequickstarts.console.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.479987142Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consoles.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.480091184Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consoles.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.480375591Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consolesamples.console.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.480549685Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consoleyamlsamples.console.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.480662177Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/controllerconfigs.machineconfiguration.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.481199889Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/credentialsrequests.cloudcredential.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.481340152Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/csisnapshotcontrollers.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.481460995Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/datascienceclusters.datasciencecluster.opendatahub.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.481641849Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/destinationrules.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.482453887Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dnses.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.482567019Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dnses.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.482755113Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dnshealthcheckprobes.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.482867406Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dnspolicies.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.483026819Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dnsrecords.ingress.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.483145712Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dnsrecords.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.483322086Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dscinitializations.dscinitialization.opendatahub.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.483454119Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/egressfirewalls.k8s.ovn.org.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.483572661Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/egressips.k8s.ovn.org.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.483693354Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/egressqoses.k8s.ovn.org.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.483815727Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/egressrouters.network.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.48396233Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/egressservices.k8s.ovn.org.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.484077243Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/envoyfilters.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.484223166Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/etcds.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.484379579Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/featuregates.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.484571933Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/gatewayclasses.gateway.networking.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.484743297Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/gateways.gateway.networking.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.485154996Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/gateways.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.485384131Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/grpcroutes.gateway.networking.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.486375713Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/helmchartrepositories.helm.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.486525486Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/httproutes.gateway.networking.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.487536459Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/httpscaledobjects.http.keda.sh.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.487680762Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/imagecontentpolicies.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.487831905Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/imagecontentsourcepolicies.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.487919887Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/imagedigestmirrorsets.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.48805646Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/imagepolicies.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.488312326Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/imagepruners.imageregistry.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.488576912Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/images.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.488718585Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/imagetagmirrorsets.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.488838747Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencegraphs.serving.kserve.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.489016681Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencemodelrewrites.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.489217226Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferenceobjectives.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.489301118Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencepoolimports.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.48943537Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencepools.inference.networking.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.489596774Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencepools.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.489731157Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferenceservices.serving.kserve.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.492107619Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/infrastructures.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.492633601Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ingresscontrollers.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.493370577Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ingresses.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.493551521Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/insightsoperators.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.493718545Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/installplans.operators.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.493870698Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/interceptorroutes.http.keda.sh.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.494003311Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ipamclaims.k8s.cni.cncf.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.494117304Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ippools.whereabouts.cni.cncf.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.494225906Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/issuers.cert-manager.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.495041164Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/istiocsrs.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.495358111Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/kedacontrollers.keda.sh.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.498197374Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/kuadrants.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.498340567Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/kubeapiservers.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.49849026Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/kubecontrollermanagers.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.502350725Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/kubeschedulers.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.502495858Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/kubestorageversionmigrators.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.502641521Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/leaderworkersetoperators.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.502781015Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/leaderworkersets.leaderworkerset.x-k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.505503884Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/limitadors.limitador.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.505810561Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/llminferenceserviceconfigs.serving.kserve.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.512965159Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/llminferenceservices.serving.kserve.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.517210193Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/machineconfignodes.machineconfiguration.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.517380656Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/machineconfigurations.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.517666352Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/machineosbuilds.machineconfiguration.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.517851556Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/machineosconfigs.machineconfiguration.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.5179963Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/network-attachment-definitions.k8s.cni.cncf.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.518108132Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/networks.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.518289786Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/networks.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.518543982Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/nodes.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.518660834Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/nodeslicepools.whereabouts.cni.cncf.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.518769067Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/oauths.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.518957041Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/oidcpolicies.extensions.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.519093974Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/olmconfigs.operators.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.519207646Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/openshiftapiservers.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.51935205Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/openshiftcontrollermanagers.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.519464362Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/operatorconditions.operators.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.519605085Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/operatorgroups.operators.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.519752569Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/operatorhubs.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.519894852Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/operatorpkis.network.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.520012034Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/operators.operators.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.520149487Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/orders.acme.cert-manager.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.520317821Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/overlappingrangeipreservations.whereabouts.cni.cncf.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.520429143Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/peerauthentications.security.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.520563076Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/pinnedimagesets.machineconfiguration.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.520671199Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/planpolicies.extensions.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.520798272Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/podmonitors.monitoring.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.521064277Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/podnetworkconnectivitychecks.controlplane.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.52118941Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/probes.monitoring.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.521460876Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/profiles.tuned.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.521593419Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/projecthelmchartrepositories.helm.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.521711722Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/projects.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.521825034Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/prometheuses.monitoring.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.523780987Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/prometheusrules.monitoring.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.52391104Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/proxies.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.524024072Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/proxyconfigs.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.524137915Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/rangeallocations.security.internal.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.524240027Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ratelimitpolicies.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.524464822Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/referencegrants.gateway.networking.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.524582555Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/requestauthentications.security.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.524736008Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/rolebindingrestrictions.authorization.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.524857511Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/scaledjobs.keda.sh.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.526419445Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/scaledobjects.keda.sh.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.526580399Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/schedulers.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.526697411Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/securitycontextconstraints.security.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.526845455Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/servicecas.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.526960557Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/serviceentries.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.527140651Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/servicemonitors.monitoring.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.527413837Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/servingruntimes.serving.kserve.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.527933459Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/sidecars.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.528207465Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/storages.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.528349068Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/storagestates.migration.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.52846559Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/storageversionmigrations.migration.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.528578233Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/subscriptions.operators.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.529196886Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/telemetries.telemetry.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.529416491Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/telemetrypolicies.extensions.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.529536794Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/thanosrulers.monitoring.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.531025857Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/tlspolicies.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.5311762Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/tokenratelimitpolicies.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.531357474Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/trainedmodels.serving.kserve.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.531464667Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/triggerauthentications.keda.sh.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.53161997Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/trustmanagers.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.531890636Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/tuneds.tuned.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.532016089Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/userdefinednetworks.k8s.ovn.org.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.532178662Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/virtualservices.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.532601321Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/volumepopulators.populator.storage.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.532707284Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/volumesnapshotclasses.snapshot.storage.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.532847597Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/volumesnapshotcontents.snapshot.storage.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.533015401Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/volumesnapshots.snapshot.storage.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.533171614Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/wasmplugins.extensions.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.533325017Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/workloadentries.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.533463971Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/workloadgroups.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.533643024Z cluster-scoped-resources/apiregistration.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.533947771Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.534002492Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1..yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.534101675Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.acme.cert-manager.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.534185067Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.admissionregistration.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.534292159Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.apiextensions.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.534382221Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.apiserver.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.534547115Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.apps.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.534653737Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.apps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.534745139Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.authentication.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.534837141Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.authorization.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.534939253Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.authorization.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.535031865Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.autoscaling.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.535128067Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.batch.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.535217489Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.build.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.535335092Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.cert-manager.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.535429274Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.certificates.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.535518696Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.cloud.network.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.535608688Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.cloudcredential.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.53569961Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.config.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.535790712Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.console.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.535881454Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.coordination.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.535972576Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.datasciencecluster.opendatahub.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.536062738Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.discovery.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.53614966Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.dscinitialization.opendatahub.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.536244542Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.events.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.536386455Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.flowcontrol.apiserver.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.536479687Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.gateway.networking.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.536576069Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.image.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.536672231Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.imageregistry.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.536760163Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.inference.networking.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.536855165Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.ingress.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.536941717Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.k8s.cni.cncf.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.537035349Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.k8s.ovn.org.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.537124131Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.537218623Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.leaderworkerset.x-k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.537330576Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.machineconfiguration.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.537420468Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.monitoring.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.5375144Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.monitoring.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.537603472Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.network.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.537697244Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.537799526Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.networking.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.537888898Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.nim.opendatahub.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.53798481Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.node.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.538078042Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.oauth.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.538173844Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.538273297Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.operators.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.538380979Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.packages.operators.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.538475831Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.policy.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.538579893Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.project.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.538681526Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.quota.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.538773908Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.rbac.authorization.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.53886959Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.resource.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.538964962Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.route.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.539061954Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.samples.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.539155626Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.scheduling.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.539254558Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.security.internal.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.539368321Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.security.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.539466153Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.security.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.539566645Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.snapshot.storage.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.539660577Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.storage.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.539760639Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.telemetry.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.539854791Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.template.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.539951574Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.tuned.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.540041316Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.user.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.540139978Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.work.open-cluster-management.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.54025306Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.cluster.open-cluster-management.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.540385773Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.controlplane.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.540488515Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.devportal.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.540581467Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.eventing.keda.sh.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.54067803Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.extensions.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.540770881Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.extensions.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.540867184Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.http.keda.sh.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.540973236Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.541070728Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.k8s.cni.cncf.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.54116376Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.keda.sh.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.541255362Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.541375555Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.limitador.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.541475957Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.migration.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.541569479Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.monitoring.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.541666341Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.operator.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.541769963Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.operators.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.541866016Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.policy.networking.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.541962218Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.serving.kserve.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.54205503Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.telemetry.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.542153902Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.trust.cert-manager.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.542247384Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.whereabouts.cni.cncf.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.542366017Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha2.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.542463349Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha2.operators.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.542558651Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha2.serving.kserve.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.542655163Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha3.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.542749135Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.admissionregistration.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.542846097Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.external.metrics.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.54295942Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.gateway.networking.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.543053812Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.helm.openshift.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.543147854Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.http.keda.sh.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.543243936Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.543360758Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.metrics.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.543461781Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.monitoring.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.543554773Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.543651705Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.operator.authorino.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.543749897Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.populator.storage.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.543847139Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.security.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.543943891Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.serving.kserve.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.544095015Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.storage.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.544187277Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta3.authorino.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.544283509Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v2.autoscaling.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.544416332Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v2.operators.coreos.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.544464163Z cluster-scoped-resources/certificates.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.544471203Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.544500714Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/system:openshift:openshift-monitoring-chn66.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.544647237Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/system:openshift:openshift-monitoring-p8bnx.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.544744589Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/system:openshift:openshift-monitoring-pdxq5.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.544921113Z cluster-scoped-resources/config.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.544968954Z cluster-scoped-resources/config.openshift.io/apiservers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.545145808Z cluster-scoped-resources/config.openshift.io/authentications.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.545285741Z cluster-scoped-resources/config.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.545402574Z cluster-scoped-resources/config.openshift.io/clusterimagepolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.545486885Z cluster-scoped-resources/config.openshift.io/clusteroperators.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.545852564Z cluster-scoped-resources/config.openshift.io/clusterversions.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.545966806Z cluster-scoped-resources/config.openshift.io/consoles.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.546056668Z cluster-scoped-resources/config.openshift.io/dnses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.54615312Z cluster-scoped-resources/config.openshift.io/featuregates.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.546278183Z cluster-scoped-resources/config.openshift.io/imagecontentpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.546408896Z cluster-scoped-resources/config.openshift.io/imagedigestmirrorsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.546508488Z cluster-scoped-resources/config.openshift.io/imagepolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.54659766Z cluster-scoped-resources/config.openshift.io/images.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.546690782Z cluster-scoped-resources/config.openshift.io/imagetagmirrorsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.546775984Z cluster-scoped-resources/config.openshift.io/infrastructures.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.546876636Z cluster-scoped-resources/config.openshift.io/ingresses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.546963708Z cluster-scoped-resources/config.openshift.io/networks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.54706752Z cluster-scoped-resources/config.openshift.io/nodes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.547156522Z cluster-scoped-resources/config.openshift.io/oauths.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.547249104Z cluster-scoped-resources/config.openshift.io/operatorhubs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.547359427Z cluster-scoped-resources/config.openshift.io/projects.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.547445079Z cluster-scoped-resources/config.openshift.io/proxies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.547533821Z cluster-scoped-resources/config.openshift.io/schedulers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.547635833Z cluster-scoped-resources/config.openshift.io/clusteroperators/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.547671013Z cluster-scoped-resources/config.openshift.io/clusteroperators/console.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.547780506Z cluster-scoped-resources/config.openshift.io/clusteroperators/csi-snapshot-controller.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.547879778Z cluster-scoped-resources/config.openshift.io/clusteroperators/dns.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.54796924Z cluster-scoped-resources/config.openshift.io/clusteroperators/image-registry.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.548063482Z cluster-scoped-resources/config.openshift.io/clusteroperators/ingress.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.548157424Z cluster-scoped-resources/config.openshift.io/clusteroperators/insights.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.548258786Z cluster-scoped-resources/config.openshift.io/clusteroperators/kube-apiserver.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.54843527Z cluster-scoped-resources/config.openshift.io/clusteroperators/kube-controller-manager.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.548537133Z cluster-scoped-resources/config.openshift.io/clusteroperators/kube-scheduler.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.548630525Z cluster-scoped-resources/config.openshift.io/clusteroperators/kube-storage-version-migrator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.548729527Z cluster-scoped-resources/config.openshift.io/clusteroperators/monitoring.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.548822409Z cluster-scoped-resources/config.openshift.io/clusteroperators/network.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.548962872Z cluster-scoped-resources/config.openshift.io/clusteroperators/node-tuning.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.549055334Z cluster-scoped-resources/config.openshift.io/clusteroperators/openshift-apiserver.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.549146916Z cluster-scoped-resources/config.openshift.io/clusteroperators/openshift-controller-manager.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.549242248Z cluster-scoped-resources/config.openshift.io/clusteroperators/openshift-samples.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.549361671Z cluster-scoped-resources/config.openshift.io/clusteroperators/operator-lifecycle-manager-catalog.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.549455303Z cluster-scoped-resources/config.openshift.io/clusteroperators/operator-lifecycle-manager-packageserver.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.549550235Z cluster-scoped-resources/config.openshift.io/clusteroperators/operator-lifecycle-manager.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.549642557Z cluster-scoped-resources/config.openshift.io/clusteroperators/service-ca.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.549747309Z cluster-scoped-resources/config.openshift.io/clusteroperators/storage.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.549828331Z cluster-scoped-resources/config.openshift.io/clusterversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.549865692Z cluster-scoped-resources/config.openshift.io/clusterversions/version.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.549951294Z cluster-scoped-resources/config.openshift.io/consoles/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.549980095Z cluster-scoped-resources/config.openshift.io/consoles/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.550054306Z cluster-scoped-resources/config.openshift.io/featuregates/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.550090007Z cluster-scoped-resources/config.openshift.io/featuregates/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.550159528Z cluster-scoped-resources/config.openshift.io/infrastructures/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.550195799Z cluster-scoped-resources/config.openshift.io/infrastructures/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.550256941Z cluster-scoped-resources/config.openshift.io/oauths/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.550320202Z cluster-scoped-resources/config.openshift.io/oauths/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.550384923Z cluster-scoped-resources/config.openshift.io/proxies/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.550421434Z cluster-scoped-resources/config.openshift.io/proxies/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.550485186Z cluster-scoped-resources/console.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.550503056Z cluster-scoped-resources/console.openshift.io/consoleplugins/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.550544277Z cluster-scoped-resources/console.openshift.io/consoleplugins/kuadrant-console-plugin.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.550638759Z cluster-scoped-resources/console.openshift.io/consoleplugins/monitoring-plugin.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.550723171Z cluster-scoped-resources/console.openshift.io/consoleplugins/networking-console-plugin.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.550762042Z cluster-scoped-resources/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.550782952Z cluster-scoped-resources/core/nodes/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.550824913Z cluster-scoped-resources/core/nodes/ip-10-0-140-224.ec2.internal.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.551021177Z cluster-scoped-resources/core/nodes/ip-10-0-141-82.ec2.internal.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.551178171Z cluster-scoped-resources/core/nodes/ip-10-0-143-79.ec2.internal.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.551280883Z cluster-scoped-resources/core/persistentvolumes/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.551348334Z cluster-scoped-resources/core/persistentvolumes/pvc-1030d2a9-7a19-4fc9-acdf-cc609db07d6f.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.551428036Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.551496908Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.551547519Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/catch-all.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.551647631Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/exempt.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.551741113Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/global-default.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.551829255Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/kube-controller-manager.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.551912837Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/kube-scheduler.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.551998389Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/kube-system-service-accounts.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.552149842Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-apiserver-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.552257075Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-apiserver-sar.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.552365617Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-apiserver.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.552454799Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-authentication-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.552552221Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-controller-manager.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.552645323Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-kube-apiserver-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.552746745Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-monitoring-metrics.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.552837697Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-oauth-apiserver-sar.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.552925229Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-oauth-apiserver.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.553021211Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-oauth-server.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.553114364Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/probes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.553210786Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/service-accounts.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.553353029Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/system-leader-election.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.553451601Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/system-node-high.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.553539133Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/system-nodes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.553625655Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.553660136Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/catch-all.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.553763738Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/exempt.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.553841629Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/global-default.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.553928582Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/leader-election.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.554015543Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/node-high.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.554104275Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/openshift-control-plane-operators.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.554252429Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/system.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.554407382Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/workload-high.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.554502324Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/workload-low.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.554551465Z cluster-scoped-resources/gateway.networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.554561275Z cluster-scoped-resources/gateway.networking.k8s.io/gatewayclasses/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.554626377Z cluster-scoped-resources/gateway.networking.k8s.io/gatewayclasses/openshift-default.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.554686858Z cluster-scoped-resources/imageregistry.operator.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.554697018Z cluster-scoped-resources/imageregistry.operator.openshift.io/configs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.554724369Z cluster-scoped-resources/imageregistry.operator.openshift.io/configs/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.55479243Z cluster-scoped-resources/imageregistry.operator.openshift.io/imagepruners/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.554848582Z cluster-scoped-resources/imageregistry.operator.openshift.io/imagepruners/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.554901863Z cluster-scoped-resources/migration.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.554911273Z cluster-scoped-resources/migration.k8s.io/storageversionmigrations/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.554971714Z cluster-scoped-resources/migration.k8s.io/storageversionmigrations/console-plugin-storage-version-migration.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.555071397Z cluster-scoped-resources/migration.k8s.io/storageversionmigrations/machineconfiguration-controllerconfig-storage-version-migration.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.55521534Z cluster-scoped-resources/migration.k8s.io/storageversionmigrations/machineconfiguration-machineconfigpool-storage-version-migration.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.555260011Z cluster-scoped-resources/oauth.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.555280571Z cluster-scoped-resources/oauth.openshift.io/oauthclients/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.555344603Z cluster-scoped-resources/oauth.openshift.io/oauthclients/console.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.555412904Z cluster-scoped-resources/operator.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.555426975Z cluster-scoped-resources/operator.openshift.io/clustercsidrivers/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.555462025Z cluster-scoped-resources/operator.openshift.io/clustercsidrivers/ebs.csi.aws.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.555545037Z cluster-scoped-resources/operator.openshift.io/consoles/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.555577608Z cluster-scoped-resources/operator.openshift.io/consoles/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.555706601Z cluster-scoped-resources/operator.openshift.io/csisnapshotcontrollers/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.555723191Z cluster-scoped-resources/operator.openshift.io/csisnapshotcontrollers/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.555815373Z cluster-scoped-resources/operator.openshift.io/dnses/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.555858814Z cluster-scoped-resources/operator.openshift.io/dnses/default.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.555928526Z cluster-scoped-resources/operator.openshift.io/insightsoperators/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.555959416Z cluster-scoped-resources/operator.openshift.io/insightsoperators/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.556079219Z cluster-scoped-resources/operator.openshift.io/kubeapiservers/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.55611731Z cluster-scoped-resources/operator.openshift.io/kubeapiservers/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.556183181Z cluster-scoped-resources/operator.openshift.io/kubecontrollermanagers/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.556214472Z cluster-scoped-resources/operator.openshift.io/kubecontrollermanagers/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.556287573Z cluster-scoped-resources/operator.openshift.io/kubeschedulers/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.556322094Z cluster-scoped-resources/operator.openshift.io/kubeschedulers/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.556397146Z cluster-scoped-resources/operator.openshift.io/kubestorageversionmigrators/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.556433617Z cluster-scoped-resources/operator.openshift.io/kubestorageversionmigrators/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.556515498Z cluster-scoped-resources/operator.openshift.io/networks/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.556551059Z cluster-scoped-resources/operator.openshift.io/networks/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.556633081Z cluster-scoped-resources/operator.openshift.io/openshiftapiservers/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.556669802Z cluster-scoped-resources/operator.openshift.io/openshiftapiservers/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.556723183Z cluster-scoped-resources/operator.openshift.io/openshiftcontrollermanagers/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.556758314Z cluster-scoped-resources/operator.openshift.io/openshiftcontrollermanagers/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.556814245Z cluster-scoped-resources/operator.openshift.io/servicecas/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.556849276Z cluster-scoped-resources/operator.openshift.io/servicecas/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.556909297Z cluster-scoped-resources/operator.openshift.io/storages/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.556945528Z cluster-scoped-resources/operator.openshift.io/storages/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.55704453Z cluster-scoped-resources/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.55705163Z cluster-scoped-resources/operators.coreos.com/olmconfigs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.557075341Z cluster-scoped-resources/operators.coreos.com/olmconfigs/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.557162643Z cluster-scoped-resources/operators.coreos.com/operators/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.557198854Z cluster-scoped-resources/operators.coreos.com/operators/authorino-operator.kuadrant-system.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.557348167Z cluster-scoped-resources/operators.coreos.com/operators/dns-operator.kuadrant-system.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.557444799Z cluster-scoped-resources/operators.coreos.com/operators/leader-worker-set.openshift-lws-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.557605152Z cluster-scoped-resources/operators.coreos.com/operators/limitador-operator.kuadrant-system.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.557711885Z cluster-scoped-resources/operators.coreos.com/operators/openshift-cert-manager-operator.cert-manager-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.557849588Z cluster-scoped-resources/operators.coreos.com/operators/openshift-custom-metrics-autoscaler-operator.openshift-keda.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.55795675Z cluster-scoped-resources/operators.coreos.com/operators/rhcl-operator.kuadrant-system.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.558042922Z cluster-scoped-resources/rbac.authorization.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.558118654Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.558155695Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/aws-ebs-csi-driver-operator-clusterrolebinding.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.558251357Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/cloud-network-config-controller.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.558357839Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/cluster-node-tuning-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.558503502Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/cluster-storage-operator-role.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.558629735Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/csi-snapshot-controller-operator-clusterrole.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.558720347Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/csi-snapshot-controller-runner-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.558811159Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/metrics-daemon-sa-rolebinding.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.558898571Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/multus-admission-controller-webhook.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.558991213Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/multus-ancillary-tools.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.559073875Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/multus-cluster-readers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.559162537Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/multus-group.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.559248089Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/multus-transient.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.559362381Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/multus-whereabouts.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.559451413Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/network-diagnostics.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.559540495Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/network-node-identity.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.559624857Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/openshift-image-registry-pruner.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.559718659Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/openshift-iptables-alerter.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.559804161Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/openshift-ovn-kubernetes-control-plane-limited.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.559892893Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/openshift-ovn-kubernetes-node-identity-limited.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.559982805Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/openshift-ovn-kubernetes-node-kube-rbac-proxy.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.560071607Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/registry-registry-role.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.560183319Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.56021977Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/aws-ebs-csi-driver-operator-clusterrole.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.560346093Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/cloud-network-config-controller.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.560429005Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/cluster-node-tuning-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.560518087Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/console-extensions-reader.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.56066741Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/console-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.560765032Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/console.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.560857024Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/csi-snapshot-controller-operator-clusterrole.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.560952596Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/helm-chartrepos-viewer.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.561040508Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/metrics-daemon-role.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.5611355Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/multus-admission-controller-webhook.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.561223692Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/multus-ancillary-tools.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.561431887Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/multus.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.561552479Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/net-attach-def-project.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.561659652Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/network-diagnostics.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.561777614Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/network-node-identity.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.561885117Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-csi-snapshot-controller-runner.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.561993669Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-iptables-alerter.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.562104942Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-ovn-kubernetes-cluster-reader.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.562211604Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-ovn-kubernetes-control-plane-limited.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.562349007Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-ovn-kubernetes-kube-rbac-proxy.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.562455639Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-ovn-kubernetes-node-limited.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.562564352Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-ovn-kubernetes-udn-editor.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.562670484Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-ovn-kubernetes-udn-viewer.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.562775256Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/project-helm-chartrepository-editor.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.562881329Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/system:openshift:aggregate-snapshots-to-admin.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.562991051Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/system:openshift:aggregate-snapshots-to-basic-user.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.563095633Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/system:openshift:aggregate-snapshots-to-storage-admin.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.563203066Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/system:openshift:aggregate-snapshots-to-view.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.563336579Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/system:registry.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.563447531Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/whereabouts-cni.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.563512013Z cluster-scoped-resources/samples.operator.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.563519073Z cluster-scoped-resources/samples.operator.openshift.io/configs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.563550974Z cluster-scoped-resources/samples.operator.openshift.io/configs/cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.563625445Z cluster-scoped-resources/snapshot.storage.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.563632855Z cluster-scoped-resources/snapshot.storage.k8s.io/volumesnapshotclasses/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.563680076Z cluster-scoped-resources/snapshot.storage.k8s.io/volumesnapshotclasses/csi-aws-vsc.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.563766538Z cluster-scoped-resources/storage.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.563774088Z cluster-scoped-resources/storage.k8s.io/csidrivers/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.56382836Z cluster-scoped-resources/storage.k8s.io/csidrivers/ebs.csi.aws.com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.563909531Z cluster-scoped-resources/storage.k8s.io/csinodes/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.563954552Z cluster-scoped-resources/storage.k8s.io/csinodes/ip-10-0-140-224.ec2.internal.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.564069695Z cluster-scoped-resources/storage.k8s.io/csinodes/ip-10-0-141-82.ec2.internal.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.564160467Z cluster-scoped-resources/storage.k8s.io/csinodes/ip-10-0-143-79.ec2.internal.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.564232918Z cluster-scoped-resources/storage.k8s.io/storageclasses/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.564280739Z cluster-scoped-resources/storage.k8s.io/storageclasses/gp2-csi.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.564399382Z cluster-scoped-resources/storage.k8s.io/storageclasses/gp3-csi.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.564457643Z host_service_logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.564468354Z host_service_logs/masters/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.564527725Z host_service_logs/masters/NetworkManager_service.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.564606447Z host_service_logs/masters/crio_service.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.564686688Z host_service_logs/masters/kubelet_service.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.56475501Z host_service_logs/masters/machine-config-daemon-firstboot_service.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.564911504Z host_service_logs/masters/machine-config-daemon-host_service.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.565039376Z host_service_logs/masters/openvswitch_service.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.565123708Z host_service_logs/masters/ostree-finalize-staged_service.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.56519782Z host_service_logs/masters/ovs-configuration_service.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.565282592Z host_service_logs/masters/ovs-vswitchd_service.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.565369874Z host_service_logs/masters/ovsdb-server_service.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.565441235Z host_service_logs/masters/rpm-ostreed_service.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.565480886Z ingress_controllers/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.565490336Z ingress_controllers/default/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.565494316Z ingress_controllers/default/router-default-6fd9c96588-sbl55/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.565552347Z ingress_controllers/default/router-default-6fd9c96588-sbl55/haproxy.config [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.56566511Z insights-data/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.56567486Z istio/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.565742242Z istio/aggregated-discovery-api.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.565858394Z istio/aggregated-discovery-apis.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.566487668Z istio/event-filter.html [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.566633251Z istio/timestamp [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.566776825Z istio/cluster-scoped-resources/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.566789705Z istio/cluster-scoped-resources/admissionregistration.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.566794765Z istio/cluster-scoped-resources/admissionregistration.k8s.io/mutatingwebhookconfigurations/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.566830716Z istio/cluster-scoped-resources/admissionregistration.k8s.io/mutatingwebhookconfigurations/istio-sidecar-injector-openshift-gateway-openshift-ingress.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.566910077Z istio/cluster-scoped-resources/admissionregistration.k8s.io/validatingwebhookconfigurations/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.566939498Z istio/cluster-scoped-resources/admissionregistration.k8s.io/validatingwebhookconfigurations/istio-validator-openshift-gateway-openshift-ingress.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.56701197Z istio/cluster-scoped-resources/apiextensions.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.567105582Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.567165333Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/authorizationpolicies.security.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.567371718Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/destinationrules.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.568149605Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/envoyfilters.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.56837725Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/gatewayclasses.gateway.networking.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.568542824Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/gateways.gateway.networking.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.568937722Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/gateways.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.569116026Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/grpcroutes.gateway.networking.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.569539515Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/httproutes.gateway.networking.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.570412495Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencemodelrewrites.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.570553308Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferenceobjectives.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.570709651Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencepoolimports.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.570863304Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencepools.inference.networking.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.571017718Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencepools.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.571168091Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/peerauthentications.security.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.571331865Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/proxyconfigs.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.571471038Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/referencegrants.gateway.networking.k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.571593911Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/requestauthentications.security.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.571765904Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/serviceentries.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.571966439Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/sidecars.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.572252295Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/telemetries.telemetry.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.57247155Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/virtualservices.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.572891549Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/wasmplugins.extensions.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.573049813Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/workloadentries.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.573215866Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/workloadgroups.networking.istio.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.57337733Z istio/cluster-scoped-resources/gateway.networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.5733923Z istio/cluster-scoped-resources/gateway.networking.k8s.io/gatewayclasses/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.573443851Z istio/cluster-scoped-resources/gateway.networking.k8s.io/gatewayclasses/openshift-default.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.573533833Z istio/cluster-scoped-resources/rbac.authorization.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.573543814Z istio/cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.573594225Z istio/cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/istio-reader-clusterrole-openshift-gateway-openshift-ingress.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.573707547Z istio/cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/istiod-clusterrole-openshift-gateway-openshift-ingress.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.573886611Z istio/cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/istiod-gateway-controller-openshift-gateway-openshift-ingress.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.573970633Z istio/cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.574011894Z istio/cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/istio-reader-clusterrole-openshift-gateway-openshift-ingress.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.574123747Z istio/cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/istiod-clusterrole-openshift-gateway-openshift-ingress.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.574374532Z istio/cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/istiod-gateway-controller-openshift-gateway-openshift-ingress.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.574444894Z istio/namespaces/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.574481384Z istio/namespaces/kserve-ci-e2e-test/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.574487755Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.574491624Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/gateways/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.574541176Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/gateways/router-gateway-1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.574649208Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/gateways/router-gateway-2.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.57474228Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/httproutes/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.574787871Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/httproutes/router-route-1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.574882113Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/httproutes/router-route-2.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.574981785Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/httproutes/router-route-3.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.575066637Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/httproutes/router-route-4.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.575153929Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/httproutes/scheduler-v06-pd-migration-test-kserve-route.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.575284422Z istio/namespaces/kserve-ci-e2e-test/inference.networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.575297112Z istio/namespaces/kserve-ci-e2e-test/inference.networking.k8s.io/inferencepools/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.575357174Z istio/namespaces/kserve-ci-e2e-test/inference.networking.k8s.io/inferencepools/scheduler-v06-pd-migration-test-inference-pool.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.575417755Z istio/namespaces/kserve-ci-e2e-test/inference.networking.x-k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.575429495Z istio/namespaces/kserve-ci-e2e-test/inference.networking.x-k8s.io/inferencepools/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.575473426Z istio/namespaces/kserve-ci-e2e-test/inference.networking.x-k8s.io/inferencepools/scheduler-v06-pd-migration-test-inference-pool.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.575517417Z istio/namespaces/kserve-ci-e2e-test/networking.istio.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.575563668Z istio/namespaces/kserve-ci-e2e-test/networking.istio.io/destinationrules/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.575618009Z istio/namespaces/kserve-ci-e2e-test/networking.istio.io/destinationrules/scheduler-v06-pd-migration-test-kserve-scheduler.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.575729882Z istio/namespaces/kserve-ci-e2e-test/networking.istio.io/destinationrules/scheduler-v06-pd-migration-test-kserve-shadow-svc.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.575865335Z istio/namespaces/kserve-ci-e2e-test/networking.istio.io/destinationrules/scheduler-v06-pd-migration-test-kserve-workload-svc.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.575971647Z istio/namespaces/openshift-ingress/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.576021948Z istio/namespaces/openshift-ingress/openshift-ingress.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.57608785Z istio/namespaces/openshift-ingress/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.57611658Z istio/namespaces/openshift-ingress/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.576188432Z istio/namespaces/openshift-ingress/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.576236633Z istio/namespaces/openshift-ingress/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.576350995Z istio/namespaces/openshift-ingress/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.576584181Z istio/namespaces/openshift-ingress/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.576783595Z istio/namespaces/openshift-ingress/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.576839586Z istio/namespaces/openshift-ingress/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.576878687Z istio/namespaces/openshift-ingress/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.576966859Z istio/namespaces/openshift-ingress/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.57701143Z istio/namespaces/openshift-ingress/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.577104352Z istio/namespaces/openshift-ingress/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.577144723Z istio/namespaces/openshift-ingress/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.577207534Z istio/namespaces/openshift-ingress/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.577299076Z istio/namespaces/openshift-ingress/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.577392579Z istio/namespaces/openshift-ingress/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.577434849Z istio/namespaces/openshift-ingress/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.577864779Z istio/namespaces/openshift-ingress/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.577959941Z istio/namespaces/openshift-ingress/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.578192896Z istio/namespaces/openshift-ingress/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.578274928Z istio/namespaces/openshift-ingress/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.578546854Z istio/namespaces/openshift-ingress/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.578677957Z istio/namespaces/openshift-ingress/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.578883401Z istio/namespaces/openshift-ingress/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.578979163Z istio/namespaces/openshift-ingress/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.579027904Z istio/namespaces/openshift-ingress/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.579108186Z istio/namespaces/openshift-ingress/gateway.networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.579117376Z istio/namespaces/openshift-ingress/gateway.networking.k8s.io/gateways/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.579131797Z istio/namespaces/openshift-ingress/gateway.networking.k8s.io/gateways/openshift-ai-inference.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.579233229Z istio/namespaces/openshift-ingress/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.57928258Z istio/namespaces/openshift-ingress/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.579383542Z istio/namespaces/openshift-ingress/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.579430193Z istio/namespaces/openshift-ingress/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.579522505Z istio/namespaces/openshift-ingress/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.579624857Z istio/namespaces/openshift-ingress/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.579657778Z istio/namespaces/openshift-ingress/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.579698549Z istio/namespaces/openshift-ingress/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.579767721Z istio/namespaces/openshift-ingress/networking.istio.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.579777371Z istio/namespaces/openshift-ingress/networking.istio.io/envoyfilters/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.579840572Z istio/namespaces/openshift-ingress/networking.istio.io/envoyfilters/kuadrant-auth-openshift-ai-inference.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.579926904Z istio/namespaces/openshift-ingress/networking.istio.io/envoyfilters/kuadrant-openshift-ai-inference.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.580049527Z istio/namespaces/openshift-ingress/networking.istio.io/envoyfilters/openshift-ai-inference-authn-ssl.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.580150689Z istio/namespaces/openshift-ingress/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.580225011Z istio/namespaces/openshift-ingress/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.580322693Z istio/namespaces/openshift-ingress/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.580333263Z istio/namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.580379384Z istio/namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/istiod-openshift-gateway-94bb8fbfd-4wpb9.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.580490127Z istio/namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/discovery/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.580497617Z istio/namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/discovery/discovery/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.580510297Z istio/namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/discovery/discovery/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.580565568Z istio/namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/discovery/discovery/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.59244884Z istio/namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/discovery/discovery/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.592516992Z istio/namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/discovery/discovery/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.592561093Z istio/namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.592600654Z istio/namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.592728396Z istio/namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/istio-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.592737286Z istio/namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/istio-proxy/istio-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.592748237Z istio/namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/istio-proxy/istio-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.592809088Z istio/namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/istio-proxy/istio-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.593712398Z istio/namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/istio-proxy/istio-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.59379399Z istio/namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.593839591Z istio/namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router-default-6fd9c96588-sbl55.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.593966904Z istio/namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.593974254Z istio/namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router/router/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.593980754Z istio/namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router/router/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.594032415Z istio/namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router/router/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.594145508Z istio/namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router/router/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.594218329Z istio/namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router/router/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.59424812Z istio/namespaces/openshift-ingress/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.594316411Z istio/namespaces/openshift-ingress/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.594361402Z istio/namespaces/openshift-ingress/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.594409053Z istio/namespaces/openshift-ingress/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.594445854Z machine_config_ondisk/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.594452414Z machine_config_termination_logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.594458804Z monitoring/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.594465415Z monitoring/alertmanager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.594524476Z monitoring/alertmanager/status.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.594623428Z monitoring/alertmanager/status.stderr [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.59468864Z monitoring/prometheus/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.59473531Z monitoring/prometheus/alertmanagers.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.594829063Z monitoring/prometheus/alertmanagers.stderr [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.594913364Z monitoring/prometheus/rules.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.595670291Z monitoring/prometheus/rules.stderr [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.595705012Z monitoring/prometheus/prometheus-k8s-0/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.595760423Z monitoring/prometheus/prometheus-k8s-0/active-targets.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.596685493Z monitoring/prometheus/prometheus-k8s-0/active-targets.stderr [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.596744815Z monitoring/prometheus/prometheus-k8s-0/status/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.596780686Z monitoring/prometheus/prometheus-k8s-0/status/runtimeinfo.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.596876248Z monitoring/prometheus/prometheus-k8s-0/status/runtimeinfo.stderr [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.596945329Z monitoring/prometheus/prometheus-k8s-0/status/tsdb.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.597039581Z monitoring/prometheus/prometheus-k8s-0/status/tsdb.stderr [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.597067982Z monitoring/prometheus/status/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.597112113Z monitoring/prometheus/status/config.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.597589173Z monitoring/prometheus/status/config.stderr [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.597657915Z monitoring/prometheus/status/flags.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.597764327Z monitoring/prometheus/status/flags.stderr [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.597984422Z namespaces/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.597992202Z namespaces/cert-manager-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.597996182Z namespaces/cert-manager-operator/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.598000233Z namespaces/cert-manager-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.598037353Z namespaces/cert-manager-operator/coordination.k8s.io/leases/cert-manager-operator-lock.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.598108405Z namespaces/cert-manager-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.598116155Z namespaces/cert-manager-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.598164726Z namespaces/cert-manager-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.598385171Z namespaces/cert-manager-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.598597795Z namespaces/cert-manager-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.598742669Z namespaces/cert-manager-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.598955763Z namespaces/cert-manager-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.599205839Z namespaces/cert-manager-operator/operators.coreos.com/installplans/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.59924271Z namespaces/cert-manager-operator/operators.coreos.com/installplans/install-mz5m4.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.599422584Z namespaces/cert-manager-operator/operators.coreos.com/operatorconditions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.599455345Z namespaces/cert-manager-operator/operators.coreos.com/operatorconditions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.599533046Z namespaces/cert-manager-operator/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.599602268Z namespaces/cert-manager-operator/operators.coreos.com/operatorgroups/openshift-cert-manager-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.599667799Z namespaces/cert-manager-operator/operators.coreos.com/subscriptions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.59969809Z namespaces/cert-manager-operator/operators.coreos.com/subscriptions/openshift-cert-manager-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.599771772Z namespaces/cert-manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.599780142Z namespaces/cert-manager/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.599788152Z namespaces/cert-manager/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.599844153Z namespaces/cert-manager/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.600006097Z namespaces/cert-manager/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.60017787Z namespaces/cert-manager/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.600350314Z namespaces/cert-manager/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.600571559Z namespaces/cert-manager/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.600793734Z namespaces/default/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.600830395Z namespaces/default/default.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.600912886Z namespaces/default/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.600957078Z namespaces/default/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.601034029Z namespaces/default/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.60106565Z namespaces/default/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.601167352Z namespaces/default/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.601246544Z namespaces/default/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.601359687Z namespaces/default/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.601403497Z namespaces/default/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.601446708Z namespaces/default/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.60149809Z namespaces/default/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.60152747Z namespaces/default/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.601615042Z namespaces/default/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.601678703Z namespaces/default/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.601711604Z namespaces/default/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.601817426Z namespaces/default/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.601901948Z namespaces/default/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.601933409Z namespaces/default/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.602058272Z namespaces/default/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.602145294Z namespaces/default/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.602353478Z namespaces/default/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.60243376Z namespaces/default/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.602524672Z namespaces/default/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.602652125Z namespaces/default/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.602814088Z namespaces/default/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.60288304Z namespaces/default/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.602925061Z namespaces/default/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.602999732Z namespaces/default/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.603031103Z namespaces/default/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.603119475Z namespaces/default/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.603155386Z namespaces/default/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.603243358Z namespaces/default/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.60335556Z namespaces/default/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.603386851Z namespaces/default/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.603426912Z namespaces/default/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.603487543Z namespaces/default/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.603515904Z namespaces/default/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.603572485Z namespaces/default/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.603579655Z namespaces/default/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.603604776Z namespaces/default/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.603764099Z namespaces/default/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.604000905Z namespaces/default/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.604138788Z namespaces/default/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.604388173Z namespaces/default/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.604580277Z namespaces/default/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.604617808Z namespaces/default/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.604669809Z namespaces/default/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.60470577Z namespaces/default/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.604755751Z namespaces/kserve-ci-e2e-test/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.604763182Z namespaces/kserve-ci-e2e-test/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.604769811Z namespaces/kserve-ci-e2e-test/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.604818393Z namespaces/kserve-ci-e2e-test/coordination.k8s.io/leases/epp-kserve-ci-e2e-test-scheduler-ha-replicas-test-inference-pool.llm-d.ai.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.604888884Z namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.604896394Z namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/gateways/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.604929385Z namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/gateways/router-gateway-1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.605037328Z namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/gateways/router-gateway-2.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.605105859Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.605113539Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/podmonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.60515905Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/podmonitors/kserve-llm-isvc-vllm-engine-default.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.605260012Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/podmonitors/kserve-llm-isvc-vllm-engine.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.605358115Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.605395155Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors/kserve-llm-isvc-scheduler-default.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.605490198Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors/kserve-llm-isvc-scheduler.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.605548179Z namespaces/kserve-ci-e2e-test/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.605561079Z namespaces/kserve-ci-e2e-test/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.60561049Z namespaces/kserve-ci-e2e-test/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.605773284Z namespaces/kserve-ci-e2e-test/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.605952388Z namespaces/kserve-ci-e2e-test/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.606091731Z namespaces/kserve-ci-e2e-test/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.606324896Z namespaces/kserve-ci-e2e-test/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.606558341Z namespaces/kserve/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.606591172Z namespaces/kserve/kserve.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.606681384Z namespaces/kserve/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.606713414Z namespaces/kserve/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.606795026Z namespaces/kserve/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.606823317Z namespaces/kserve/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.606918459Z namespaces/kserve/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.607131424Z namespaces/kserve/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.607345178Z namespaces/kserve/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.607376139Z namespaces/kserve/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.60743174Z namespaces/kserve/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.607485242Z namespaces/kserve/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.607502022Z namespaces/kserve/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.607598134Z namespaces/kserve/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.607699306Z namespaces/kserve/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.607728907Z namespaces/kserve/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.607824009Z namespaces/kserve/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.60786959Z namespaces/kserve/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.60787731Z namespaces/kserve/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.607917801Z namespaces/kserve/coordination.k8s.io/leases/kserve-controller-manager-leader-lock.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.608013793Z namespaces/kserve/coordination.k8s.io/leases/llminferenceservice-kserve-controller-manager.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.608096705Z namespaces/kserve/coordination.k8s.io/leases/odh-model-controller.opendatahub.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.608217347Z namespaces/kserve/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.608257228Z namespaces/kserve/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.608539025Z namespaces/kserve/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.608641097Z namespaces/kserve/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.608934093Z namespaces/kserve/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.609016135Z namespaces/kserve/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.609293381Z namespaces/kserve/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.609435144Z namespaces/kserve/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.60969556Z namespaces/kserve/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.609805553Z namespaces/kserve/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.609848334Z namespaces/kserve/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.609956586Z namespaces/kserve/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.609991257Z namespaces/kserve/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.610063978Z namespaces/kserve/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.610092119Z namespaces/kserve/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.610187281Z namespaces/kserve/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.610282433Z namespaces/kserve/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.610358025Z namespaces/kserve/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.610398526Z namespaces/kserve/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.610466787Z namespaces/kserve/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.610510878Z namespaces/kserve/monitoring.coreos.com/servicemonitors/model-serving-api-metrics.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.61060249Z namespaces/kserve/monitoring.coreos.com/servicemonitors/odh-model-controller-metrics-monitor.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.610635301Z namespaces/kserve/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.610689872Z namespaces/kserve/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.610730163Z namespaces/kserve/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.610740773Z namespaces/kserve/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.610802624Z namespaces/kserve/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.610951218Z namespaces/kserve/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.611131412Z namespaces/kserve/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.611280865Z namespaces/kserve/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.61152435Z namespaces/kserve/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.611733285Z namespaces/kserve/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.611740985Z namespaces/kserve/pods/kserve-controller-manager-748bdf6488-jqrkk/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.611784826Z namespaces/kserve/pods/kserve-controller-manager-748bdf6488-jqrkk/kserve-controller-manager-748bdf6488-jqrkk.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.611886788Z namespaces/kserve/pods/kserve-controller-manager-748bdf6488-jqrkk/manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.611894519Z namespaces/kserve/pods/kserve-controller-manager-748bdf6488-jqrkk/manager/manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.611898359Z namespaces/kserve/pods/kserve-controller-manager-748bdf6488-jqrkk/manager/manager/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.61194161Z namespaces/kserve/pods/kserve-controller-manager-748bdf6488-jqrkk/manager/manager/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.612063272Z namespaces/kserve/pods/kserve-controller-manager-748bdf6488-jqrkk/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.612144944Z namespaces/kserve/pods/kserve-controller-manager-748bdf6488-jqrkk/manager/manager/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.612177325Z namespaces/kserve/pods/llmisvc-controller-manager-6b8b6f4bc5-n4wjm/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.612230936Z namespaces/kserve/pods/llmisvc-controller-manager-6b8b6f4bc5-n4wjm/llmisvc-controller-manager-6b8b6f4bc5-n4wjm.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.612341718Z namespaces/kserve/pods/llmisvc-controller-manager-6b8b6f4bc5-n4wjm/manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.612352879Z namespaces/kserve/pods/llmisvc-controller-manager-6b8b6f4bc5-n4wjm/manager/manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.612359479Z namespaces/kserve/pods/llmisvc-controller-manager-6b8b6f4bc5-n4wjm/manager/manager/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.61240458Z namespaces/kserve/pods/llmisvc-controller-manager-6b8b6f4bc5-n4wjm/manager/manager/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.614318012Z namespaces/kserve/pods/llmisvc-controller-manager-6b8b6f4bc5-n4wjm/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.614395774Z namespaces/kserve/pods/llmisvc-controller-manager-6b8b6f4bc5-n4wjm/manager/manager/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.614436384Z namespaces/kserve/pods/model-serving-api-fd65d7d6-jpp7h/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.614483365Z namespaces/kserve/pods/model-serving-api-fd65d7d6-jpp7h/model-serving-api-fd65d7d6-jpp7h.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.614580748Z namespaces/kserve/pods/model-serving-api-fd65d7d6-jpp7h/server/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.614589548Z namespaces/kserve/pods/model-serving-api-fd65d7d6-jpp7h/server/server/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.614600618Z namespaces/kserve/pods/model-serving-api-fd65d7d6-jpp7h/server/server/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.614655419Z namespaces/kserve/pods/model-serving-api-fd65d7d6-jpp7h/server/server/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.614737691Z namespaces/kserve/pods/model-serving-api-fd65d7d6-jpp7h/server/server/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.614816123Z namespaces/kserve/pods/model-serving-api-fd65d7d6-jpp7h/server/server/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.614831973Z namespaces/kserve/pods/odh-model-controller-84b54b7f97-chmc9/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.614888905Z namespaces/kserve/pods/odh-model-controller-84b54b7f97-chmc9/odh-model-controller-84b54b7f97-chmc9.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.614968846Z namespaces/kserve/pods/odh-model-controller-84b54b7f97-chmc9/manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.614978956Z namespaces/kserve/pods/odh-model-controller-84b54b7f97-chmc9/manager/manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.614982977Z namespaces/kserve/pods/odh-model-controller-84b54b7f97-chmc9/manager/manager/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.615032888Z namespaces/kserve/pods/odh-model-controller-84b54b7f97-chmc9/manager/manager/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.636202614Z namespaces/kserve/pods/odh-model-controller-84b54b7f97-chmc9/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.636239175Z namespaces/kserve/pods/odh-model-controller-84b54b7f97-chmc9/manager/manager/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.636329737Z namespaces/kserve/pods/s3-init-hp242/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.636359767Z namespaces/kserve/pods/s3-init-hp242/s3-init-hp242.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.63647525Z namespaces/kserve/pods/s3-init-hp242/download-hf-model/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.63648501Z namespaces/kserve/pods/s3-init-hp242/download-hf-model/download-hf-model/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.636490201Z namespaces/kserve/pods/s3-init-hp242/download-hf-model/download-hf-model/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.636528261Z namespaces/kserve/pods/s3-init-hp242/download-hf-model/download-hf-model/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.636621003Z namespaces/kserve/pods/s3-init-hp242/download-hf-model/download-hf-model/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.636689845Z namespaces/kserve/pods/s3-init-hp242/download-hf-model/download-hf-model/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.636722995Z namespaces/kserve/pods/s3-init-hp242/s3-init/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.636731146Z namespaces/kserve/pods/s3-init-hp242/s3-init/s3-init/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.636747576Z namespaces/kserve/pods/s3-init-hp242/s3-init/s3-init/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.636815117Z namespaces/kserve/pods/s3-init-hp242/s3-init/s3-init/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.637074703Z namespaces/kserve/pods/s3-init-hp242/s3-init/s3-init/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.637144895Z namespaces/kserve/pods/s3-init-hp242/s3-init/s3-init/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.637172725Z namespaces/kserve/pods/seaweedfs-64568bcd49-lrtg7/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.637216056Z namespaces/kserve/pods/seaweedfs-64568bcd49-lrtg7/seaweedfs-64568bcd49-lrtg7.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.637333969Z namespaces/kserve/pods/seaweedfs-64568bcd49-lrtg7/seaweedfs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.637345329Z namespaces/kserve/pods/seaweedfs-64568bcd49-lrtg7/seaweedfs/seaweedfs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.63736048Z namespaces/kserve/pods/seaweedfs-64568bcd49-lrtg7/seaweedfs/seaweedfs/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.637409881Z namespaces/kserve/pods/seaweedfs-64568bcd49-lrtg7/seaweedfs/seaweedfs/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.637598005Z namespaces/kserve/pods/seaweedfs-64568bcd49-lrtg7/seaweedfs/seaweedfs/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.637670256Z namespaces/kserve/pods/seaweedfs-64568bcd49-lrtg7/seaweedfs/seaweedfs/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.637697677Z namespaces/kserve/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.637758488Z namespaces/kserve/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.63782117Z namespaces/kserve/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.63784889Z namespaces/kserve/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.637994194Z namespaces/kuadrant-system/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.638047835Z namespaces/kuadrant-system/kuadrant-system.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.638125377Z namespaces/kuadrant-system/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.638155917Z namespaces/kuadrant-system/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.638218848Z namespaces/kuadrant-system/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.638247529Z namespaces/kuadrant-system/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.638364942Z namespaces/kuadrant-system/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.638653428Z namespaces/kuadrant-system/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.638943055Z namespaces/kuadrant-system/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.639017106Z namespaces/kuadrant-system/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.639050537Z namespaces/kuadrant-system/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.639133619Z namespaces/kuadrant-system/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.639163249Z namespaces/kuadrant-system/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.639258201Z namespaces/kuadrant-system/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.639320543Z namespaces/kuadrant-system/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.639372724Z namespaces/kuadrant-system/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.639452846Z namespaces/kuadrant-system/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.639493677Z namespaces/kuadrant-system/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.639500107Z namespaces/kuadrant-system/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.639536097Z namespaces/kuadrant-system/coordination.k8s.io/leases/3745a16e.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.63963447Z namespaces/kuadrant-system/coordination.k8s.io/leases/a3f98d6c.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.639720752Z namespaces/kuadrant-system/coordination.k8s.io/leases/aac3a15d.authorino.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.639807263Z namespaces/kuadrant-system/coordination.k8s.io/leases/f139389e.kuadrant.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.639859575Z namespaces/kuadrant-system/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.639888275Z namespaces/kuadrant-system/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.640050479Z namespaces/kuadrant-system/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.640167762Z namespaces/kuadrant-system/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.640595851Z namespaces/kuadrant-system/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.640675253Z namespaces/kuadrant-system/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.64099453Z namespaces/kuadrant-system/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.641139523Z namespaces/kuadrant-system/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.641400249Z namespaces/kuadrant-system/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.641520881Z namespaces/kuadrant-system/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.641548582Z namespaces/kuadrant-system/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.641681745Z namespaces/kuadrant-system/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.641769407Z namespaces/kuadrant-system/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.641833788Z namespaces/kuadrant-system/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.641871909Z namespaces/kuadrant-system/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.641966801Z namespaces/kuadrant-system/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.642047523Z namespaces/kuadrant-system/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.642097694Z namespaces/kuadrant-system/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.642135565Z namespaces/kuadrant-system/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.642197956Z namespaces/kuadrant-system/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.642235907Z namespaces/kuadrant-system/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.642349979Z namespaces/kuadrant-system/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.64235997Z namespaces/kuadrant-system/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.642417661Z namespaces/kuadrant-system/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.642599115Z namespaces/kuadrant-system/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.642887931Z namespaces/kuadrant-system/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.643035315Z namespaces/kuadrant-system/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.64328253Z namespaces/kuadrant-system/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.643497735Z namespaces/kuadrant-system/operators.coreos.com/installplans/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.643533896Z namespaces/kuadrant-system/operators.coreos.com/installplans/install-lsvs4.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.643843883Z namespaces/kuadrant-system/operators.coreos.com/operatorconditions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.643880193Z namespaces/kuadrant-system/operators.coreos.com/operatorconditions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.643978546Z namespaces/kuadrant-system/operators.coreos.com/operatorconditions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.644064227Z namespaces/kuadrant-system/operators.coreos.com/operatorconditions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.644150459Z namespaces/kuadrant-system/operators.coreos.com/operatorconditions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.6442117Z namespaces/kuadrant-system/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.644249041Z namespaces/kuadrant-system/operators.coreos.com/operatorgroups/kuadrant.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.644371074Z namespaces/kuadrant-system/operators.coreos.com/subscriptions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.644404125Z namespaces/kuadrant-system/operators.coreos.com/subscriptions/authorino-operator-stable-redhat-operators-openshift-marketplace.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.644515327Z namespaces/kuadrant-system/operators.coreos.com/subscriptions/dns-operator-stable-redhat-operators-openshift-marketplace.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.644665501Z namespaces/kuadrant-system/operators.coreos.com/subscriptions/limitador-operator-stable-redhat-operators-openshift-marketplace.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.644761633Z namespaces/kuadrant-system/operators.coreos.com/subscriptions/rhcl-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.644852845Z namespaces/kuadrant-system/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.644860005Z namespaces/kuadrant-system/pods/authorino-7c77957575-8rb4q/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.644897606Z namespaces/kuadrant-system/pods/authorino-7c77957575-8rb4q/authorino-7c77957575-8rb4q.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.644979877Z namespaces/kuadrant-system/pods/authorino-7c77957575-8rb4q/authorino/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.644987498Z namespaces/kuadrant-system/pods/authorino-7c77957575-8rb4q/authorino/authorino/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.644993968Z namespaces/kuadrant-system/pods/authorino-7c77957575-8rb4q/authorino/authorino/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.645042619Z namespaces/kuadrant-system/pods/authorino-7c77957575-8rb4q/authorino/authorino/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.647951363Z namespaces/kuadrant-system/pods/authorino-7c77957575-8rb4q/authorino/authorino/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.648020415Z namespaces/kuadrant-system/pods/authorino-7c77957575-8rb4q/authorino/authorino/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.648073686Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-trkjt/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.648108557Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-trkjt/authorino-operator-6d85f6564-trkjt.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.648222229Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-trkjt/manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.648231569Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-trkjt/manager/manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.648242829Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-trkjt/manager/manager/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.648315251Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-trkjt/manager/manager/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.648513895Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-trkjt/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.648568036Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-trkjt/manager/manager/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.648632118Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-94pfn/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.648671159Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-94pfn/dns-operator-controller-manager-65b49595d7-94pfn.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.648761051Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-94pfn/manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.648770051Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-94pfn/manager/manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.648781071Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-94pfn/manager/manager/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.648838042Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-94pfn/manager/manager/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.648951145Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-94pfn/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.648996646Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-94pfn/manager/manager/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.649049067Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-r9kdf/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.649076108Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-r9kdf/kuadrant-console-plugin-85fd4b8b9d-r9kdf.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.64917183Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-r9kdf/kuadrant-console-plugin/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.64918192Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-r9kdf/kuadrant-console-plugin/kuadrant-console-plugin/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.64918768Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-r9kdf/kuadrant-console-plugin/kuadrant-console-plugin/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.64919683Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-r9kdf/kuadrant-console-plugin/kuadrant-console-plugin/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.649283522Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-r9kdf/kuadrant-console-plugin/kuadrant-console-plugin/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.649373974Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-r9kdf/kuadrant-console-plugin/kuadrant-console-plugin/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.649413565Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-4x4rk/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.649443046Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-4x4rk/kuadrant-operator-controller-manager-bb7ddb7d7-4x4rk.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.649560308Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-4x4rk/manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.649569389Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-4x4rk/manager/manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.649574139Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-4x4rk/manager/manager/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.649604749Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-4x4rk/manager/manager/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.654866695Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-4x4rk/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.654939707Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-4x4rk/manager/manager/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.654979188Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-xw8v8/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.655018458Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-xw8v8/limitador-limitador-69574b596d-xw8v8.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.655126071Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-xw8v8/limitador/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.655134061Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-xw8v8/limitador/limitador/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.655138001Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-xw8v8/limitador/limitador/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.655184352Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-xw8v8/limitador/limitador/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.655287664Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-xw8v8/limitador/limitador/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.655377137Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-xw8v8/limitador/limitador/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.655411717Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-8kx2v/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.655469848Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-8kx2v/limitador-operator-controller-manager-6f9f468797-8kx2v.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.655576221Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-8kx2v/manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.655586661Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-8kx2v/manager/manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.655592321Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-8kx2v/manager/manager/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.655624652Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-8kx2v/manager/manager/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.655777395Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-8kx2v/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.655849597Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-8kx2v/manager/manager/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.655886758Z namespaces/kuadrant-system/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.655915328Z namespaces/kuadrant-system/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.65597524Z namespaces/kuadrant-system/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.65601236Z namespaces/kuadrant-system/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.656058301Z namespaces/kube-node-lease/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.656065582Z namespaces/kube-node-lease/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.656074962Z namespaces/kube-node-lease/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.656143883Z namespaces/kube-node-lease/coordination.k8s.io/leases/ip-10-0-140-224.ec2.internal.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.656237016Z namespaces/kube-node-lease/coordination.k8s.io/leases/ip-10-0-141-82.ec2.internal.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.656346118Z namespaces/kube-node-lease/coordination.k8s.io/leases/ip-10-0-143-79.ec2.internal.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.656390609Z namespaces/kube-node-lease/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.656403879Z namespaces/kube-node-lease/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.656460961Z namespaces/kube-node-lease/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.656651475Z namespaces/kube-node-lease/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.65688567Z namespaces/kube-node-lease/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.657033663Z namespaces/kube-node-lease/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.657253208Z namespaces/kube-node-lease/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.657534084Z namespaces/kube-public/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.657548724Z namespaces/kube-public/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.657556805Z namespaces/kube-public/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.657598986Z namespaces/kube-public/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.65778243Z namespaces/kube-public/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.657961234Z namespaces/kube-public/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.658103777Z namespaces/kube-public/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.658339472Z namespaces/kube-public/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.658598748Z namespaces/kube-system/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.658646099Z namespaces/kube-system/kube-system.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.65870182Z namespaces/kube-system/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.658746371Z namespaces/kube-system/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.658800952Z namespaces/kube-system/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.658837283Z namespaces/kube-system/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.658974606Z namespaces/kube-system/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.659056308Z namespaces/kube-system/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.65914108Z namespaces/kube-system/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.659190281Z namespaces/kube-system/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.659236082Z namespaces/kube-system/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.659282403Z namespaces/kube-system/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.659348884Z namespaces/kube-system/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.659426486Z namespaces/kube-system/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.659477167Z namespaces/kube-system/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.659508517Z namespaces/kube-system/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.659595459Z namespaces/kube-system/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.65962872Z namespaces/kube-system/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.659639151Z namespaces/kube-system/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.659709022Z namespaces/kube-system/coordination.k8s.io/leases/apiserver-ui6ucos3xq2nbqr5b2bk4o7xiy.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.659793064Z namespaces/kube-system/coordination.k8s.io/leases/cert-manager-cainjector-leader-election.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.659886386Z namespaces/kube-system/coordination.k8s.io/leases/cert-manager-controller.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.659973898Z namespaces/kube-system/coordination.k8s.io/leases/kube-controller-manager.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.660132511Z namespaces/kube-system/coordination.k8s.io/leases/kube-scheduler.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.660207653Z namespaces/kube-system/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.660246144Z namespaces/kube-system/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.660449768Z namespaces/kube-system/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.660551671Z namespaces/kube-system/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.660807886Z namespaces/kube-system/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.660889148Z namespaces/kube-system/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.661171524Z namespaces/kube-system/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.661375669Z namespaces/kube-system/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.661757317Z namespaces/kube-system/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.661828459Z namespaces/kube-system/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.66186464Z namespaces/kube-system/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.661939741Z namespaces/kube-system/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.661978602Z namespaces/kube-system/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.662012823Z namespaces/kube-system/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.662073504Z namespaces/kube-system/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.662157416Z namespaces/kube-system/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.662245198Z namespaces/kube-system/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.662295709Z namespaces/kube-system/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.66234323Z namespaces/kube-system/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.662378901Z namespaces/kube-system/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.662431012Z namespaces/kube-system/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.662464453Z namespaces/kube-system/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.662482453Z namespaces/kube-system/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.662551105Z namespaces/kube-system/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.662703188Z namespaces/kube-system/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.662892182Z namespaces/kube-system/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.663022335Z namespaces/kube-system/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.663221779Z namespaces/kube-system/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.663457155Z namespaces/kube-system/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.663471095Z namespaces/kube-system/pods/global-pull-secret-syncer-7c7ll/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.663512056Z namespaces/kube-system/pods/global-pull-secret-syncer-7c7ll/global-pull-secret-syncer-7c7ll.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.663591958Z namespaces/kube-system/pods/global-pull-secret-syncer-7c7ll/global-pull-secret-syncer/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.663599868Z namespaces/kube-system/pods/global-pull-secret-syncer-7c7ll/global-pull-secret-syncer/global-pull-secret-syncer/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.663603898Z namespaces/kube-system/pods/global-pull-secret-syncer-7c7ll/global-pull-secret-syncer/global-pull-secret-syncer/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.663637288Z namespaces/kube-system/pods/global-pull-secret-syncer-7c7ll/global-pull-secret-syncer/global-pull-secret-syncer/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.663947725Z namespaces/kube-system/pods/global-pull-secret-syncer-7c7ll/global-pull-secret-syncer/global-pull-secret-syncer/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.664019877Z namespaces/kube-system/pods/global-pull-secret-syncer-7c7ll/global-pull-secret-syncer/global-pull-secret-syncer/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.664050548Z namespaces/kube-system/pods/global-pull-secret-syncer-kmbmg/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.664095309Z namespaces/kube-system/pods/global-pull-secret-syncer-kmbmg/global-pull-secret-syncer-kmbmg.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.664232162Z namespaces/kube-system/pods/global-pull-secret-syncer-kmbmg/global-pull-secret-syncer/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.664241822Z namespaces/kube-system/pods/global-pull-secret-syncer-kmbmg/global-pull-secret-syncer/global-pull-secret-syncer/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.664246502Z namespaces/kube-system/pods/global-pull-secret-syncer-kmbmg/global-pull-secret-syncer/global-pull-secret-syncer/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.664281813Z namespaces/kube-system/pods/global-pull-secret-syncer-kmbmg/global-pull-secret-syncer/global-pull-secret-syncer/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.66461701Z namespaces/kube-system/pods/global-pull-secret-syncer-kmbmg/global-pull-secret-syncer/global-pull-secret-syncer/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.664687012Z namespaces/kube-system/pods/global-pull-secret-syncer-kmbmg/global-pull-secret-syncer/global-pull-secret-syncer/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.664714912Z namespaces/kube-system/pods/global-pull-secret-syncer-ql4td/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.664761083Z namespaces/kube-system/pods/global-pull-secret-syncer-ql4td/global-pull-secret-syncer-ql4td.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.664836445Z namespaces/kube-system/pods/global-pull-secret-syncer-ql4td/global-pull-secret-syncer/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.664844625Z namespaces/kube-system/pods/global-pull-secret-syncer-ql4td/global-pull-secret-syncer/global-pull-secret-syncer/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.664854275Z namespaces/kube-system/pods/global-pull-secret-syncer-ql4td/global-pull-secret-syncer/global-pull-secret-syncer/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.664910416Z namespaces/kube-system/pods/global-pull-secret-syncer-ql4td/global-pull-secret-syncer/global-pull-secret-syncer/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.665200543Z namespaces/kube-system/pods/global-pull-secret-syncer-ql4td/global-pull-secret-syncer/global-pull-secret-syncer/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.665283475Z namespaces/kube-system/pods/global-pull-secret-syncer-ql4td/global-pull-secret-syncer/global-pull-secret-syncer/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.665327716Z namespaces/kube-system/pods/konnectivity-agent-44zx7/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.665377757Z namespaces/kube-system/pods/konnectivity-agent-44zx7/konnectivity-agent-44zx7.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.665463749Z namespaces/kube-system/pods/konnectivity-agent-44zx7/konnectivity-agent/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.665474639Z namespaces/kube-system/pods/konnectivity-agent-44zx7/konnectivity-agent/konnectivity-agent/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.665487799Z namespaces/kube-system/pods/konnectivity-agent-44zx7/konnectivity-agent/konnectivity-agent/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.665539661Z namespaces/kube-system/pods/konnectivity-agent-44zx7/konnectivity-agent/konnectivity-agent/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.666360939Z namespaces/kube-system/pods/konnectivity-agent-44zx7/konnectivity-agent/konnectivity-agent/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.6664365Z namespaces/kube-system/pods/konnectivity-agent-44zx7/konnectivity-agent/konnectivity-agent/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.666498522Z namespaces/kube-system/pods/konnectivity-agent-87jjw/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.666526222Z namespaces/kube-system/pods/konnectivity-agent-87jjw/konnectivity-agent-87jjw.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.666613304Z namespaces/kube-system/pods/konnectivity-agent-87jjw/konnectivity-agent/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.666620544Z namespaces/kube-system/pods/konnectivity-agent-87jjw/konnectivity-agent/konnectivity-agent/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.666624354Z namespaces/kube-system/pods/konnectivity-agent-87jjw/konnectivity-agent/konnectivity-agent/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.666674435Z namespaces/kube-system/pods/konnectivity-agent-87jjw/konnectivity-agent/konnectivity-agent/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.667480053Z namespaces/kube-system/pods/konnectivity-agent-87jjw/konnectivity-agent/konnectivity-agent/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.667553335Z namespaces/kube-system/pods/konnectivity-agent-87jjw/konnectivity-agent/konnectivity-agent/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.667589056Z namespaces/kube-system/pods/konnectivity-agent-dgwzk/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.667617946Z namespaces/kube-system/pods/konnectivity-agent-dgwzk/konnectivity-agent-dgwzk.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.667712528Z namespaces/kube-system/pods/konnectivity-agent-dgwzk/konnectivity-agent/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.667719729Z namespaces/kube-system/pods/konnectivity-agent-dgwzk/konnectivity-agent/konnectivity-agent/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.667723698Z namespaces/kube-system/pods/konnectivity-agent-dgwzk/konnectivity-agent/konnectivity-agent/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.66777415Z namespaces/kube-system/pods/konnectivity-agent-dgwzk/konnectivity-agent/konnectivity-agent/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.668591638Z namespaces/kube-system/pods/konnectivity-agent-dgwzk/konnectivity-agent/konnectivity-agent/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.668665249Z namespaces/kube-system/pods/konnectivity-agent-dgwzk/konnectivity-agent/konnectivity-agent/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.668722561Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.668756621Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.668848683Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal/haproxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.668855894Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal/haproxy/haproxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.668862184Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal/haproxy/haproxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.668907565Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal/haproxy/haproxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.669091829Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal/haproxy/haproxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.66916363Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal/haproxy/haproxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.669218751Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-141-82.ec2.internal/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.669248082Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-141-82.ec2.internal/kube-apiserver-proxy-ip-10-0-141-82.ec2.internal.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.669397455Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-141-82.ec2.internal/haproxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.669410656Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-141-82.ec2.internal/haproxy/haproxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.669414586Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-141-82.ec2.internal/haproxy/haproxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.669463527Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-141-82.ec2.internal/haproxy/haproxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.669746213Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-141-82.ec2.internal/haproxy/haproxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.669828585Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-141-82.ec2.internal/haproxy/haproxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.669855565Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-143-79.ec2.internal/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.669906527Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-143-79.ec2.internal/kube-apiserver-proxy-ip-10-0-143-79.ec2.internal.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.669972938Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-143-79.ec2.internal/haproxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.669980338Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-143-79.ec2.internal/haproxy/haproxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.669985838Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-143-79.ec2.internal/haproxy/haproxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.670023579Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-143-79.ec2.internal/haproxy/haproxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.670325306Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-143-79.ec2.internal/haproxy/haproxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.670396748Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-143-79.ec2.internal/haproxy/haproxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.670434298Z namespaces/kube-system/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.670461839Z namespaces/kube-system/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.67051541Z namespaces/kube-system/rbac.authorization.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.67052501Z namespaces/kube-system/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.670577081Z namespaces/kube-system/rbac.authorization.k8s.io/rolebindings/csi-snapshot-controller-operator-authentication-reader.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.670674563Z namespaces/kube-system/rbac.authorization.k8s.io/rolebindings/network-diagnostics.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.670738525Z namespaces/kube-system/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.670773216Z namespaces/kube-system/rbac.authorization.k8s.io/roles/extension-apiserver-authentication-reader.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.670833567Z namespaces/kube-system/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.670868328Z namespaces/kube-system/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.670920609Z namespaces/open-cluster-management-4aa91c40-e787-4671-b288-3d23c862e/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.670931939Z namespaces/open-cluster-management-4aa91c40-e787-4671-b288-3d23c862e/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.670938419Z namespaces/open-cluster-management-4aa91c40-e787-4671-b288-3d23c862e/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.670987801Z namespaces/open-cluster-management-4aa91c40-e787-4671-b288-3d23c862e/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.671184075Z namespaces/open-cluster-management-4aa91c40-e787-4671-b288-3d23c862e/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.67140286Z namespaces/open-cluster-management-4aa91c40-e787-4671-b288-3d23c862e/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.671554113Z namespaces/open-cluster-management-4aa91c40-e787-4671-b288-3d23c862e/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.671829879Z namespaces/open-cluster-management-4aa91c40-e787-4671-b288-3d23c862e/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.672032913Z namespaces/open-cluster-management-agent-addon/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.672040404Z namespaces/open-cluster-management-agent-addon/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.672044394Z namespaces/open-cluster-management-agent-addon/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.672093745Z namespaces/open-cluster-management-agent-addon/coordination.k8s.io/leases/cluster-proxy.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.672185867Z namespaces/open-cluster-management-agent-addon/coordination.k8s.io/leases/work-manager.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.672208757Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.672240408Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.67231283Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.672477973Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.672655597Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.67280301Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.673008015Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.67322711Z namespaces/openshift-apiserver-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.673278511Z namespaces/openshift-apiserver-operator/openshift-apiserver-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.673383613Z namespaces/openshift-apiserver-operator/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.673421984Z namespaces/openshift-apiserver-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.673500516Z namespaces/openshift-apiserver-operator/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.673546777Z namespaces/openshift-apiserver-operator/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.673635519Z namespaces/openshift-apiserver-operator/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.673714601Z namespaces/openshift-apiserver-operator/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.673806023Z namespaces/openshift-apiserver-operator/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.673843084Z namespaces/openshift-apiserver-operator/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.673897575Z namespaces/openshift-apiserver-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.673920015Z namespaces/openshift-apiserver-operator/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.673984867Z namespaces/openshift-apiserver-operator/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.674070889Z namespaces/openshift-apiserver-operator/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.674109149Z namespaces/openshift-apiserver-operator/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.67415125Z namespaces/openshift-apiserver-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.674236122Z namespaces/openshift-apiserver-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.674286943Z namespaces/openshift-apiserver-operator/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.674356585Z namespaces/openshift-apiserver-operator/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.675290205Z namespaces/openshift-apiserver-operator/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.675420718Z namespaces/openshift-apiserver-operator/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.6755102Z namespaces/openshift-apiserver-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.675591492Z namespaces/openshift-apiserver-operator/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.675674334Z namespaces/openshift-apiserver-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.675807407Z namespaces/openshift-apiserver-operator/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.675984811Z namespaces/openshift-apiserver-operator/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.676123004Z namespaces/openshift-apiserver-operator/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.676158604Z namespaces/openshift-apiserver-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.676225276Z namespaces/openshift-apiserver-operator/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.676260147Z namespaces/openshift-apiserver-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.676359039Z namespaces/openshift-apiserver-operator/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.676382479Z namespaces/openshift-apiserver-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.676477062Z namespaces/openshift-apiserver-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.676556393Z namespaces/openshift-apiserver-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.676616385Z namespaces/openshift-apiserver-operator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.676648875Z namespaces/openshift-apiserver-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.676726687Z namespaces/openshift-apiserver-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.676761028Z namespaces/openshift-apiserver-operator/monitoring.coreos.com/servicemonitors/openshift-apiserver-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.676824829Z namespaces/openshift-apiserver-operator/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.67685717Z namespaces/openshift-apiserver-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.676928621Z namespaces/openshift-apiserver-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.676937461Z namespaces/openshift-apiserver-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.676956822Z namespaces/openshift-apiserver-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.677125286Z namespaces/openshift-apiserver-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.677370891Z namespaces/openshift-apiserver-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.677520465Z namespaces/openshift-apiserver-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.677739409Z namespaces/openshift-apiserver-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.677961134Z namespaces/openshift-apiserver-operator/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.677989065Z namespaces/openshift-apiserver-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.678048956Z namespaces/openshift-apiserver-operator/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.678082267Z namespaces/openshift-apiserver-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.678186979Z namespaces/openshift-apiserver/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.678243261Z namespaces/openshift-apiserver/openshift-apiserver.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.678326982Z namespaces/openshift-apiserver/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.678358533Z namespaces/openshift-apiserver/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.678418504Z namespaces/openshift-apiserver/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.678456215Z namespaces/openshift-apiserver/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.678545697Z namespaces/openshift-apiserver/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.678626599Z namespaces/openshift-apiserver/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.678707811Z namespaces/openshift-apiserver/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.678757452Z namespaces/openshift-apiserver/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.678800723Z namespaces/openshift-apiserver/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.678863324Z namespaces/openshift-apiserver/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.678901245Z namespaces/openshift-apiserver/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.678990527Z namespaces/openshift-apiserver/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.679046688Z namespaces/openshift-apiserver/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.679086819Z namespaces/openshift-apiserver/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.679172751Z namespaces/openshift-apiserver/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.679252812Z namespaces/openshift-apiserver/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.679302594Z namespaces/openshift-apiserver/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.679419206Z namespaces/openshift-apiserver/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.679500038Z namespaces/openshift-apiserver/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.67958258Z namespaces/openshift-apiserver/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.679664082Z namespaces/openshift-apiserver/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.679746043Z namespaces/openshift-apiserver/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.679870546Z namespaces/openshift-apiserver/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.68003158Z namespaces/openshift-apiserver/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.680087231Z namespaces/openshift-apiserver/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.680125502Z namespaces/openshift-apiserver/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.680195023Z namespaces/openshift-apiserver/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.680238554Z namespaces/openshift-apiserver/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.680317426Z namespaces/openshift-apiserver/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.680348917Z namespaces/openshift-apiserver/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.680441159Z namespaces/openshift-apiserver/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.680525511Z namespaces/openshift-apiserver/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.680583952Z namespaces/openshift-apiserver/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.680625553Z namespaces/openshift-apiserver/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.680685784Z namespaces/openshift-apiserver/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.680736575Z namespaces/openshift-apiserver/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.680783966Z namespaces/openshift-apiserver/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.680810607Z namespaces/openshift-apiserver/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.680863068Z namespaces/openshift-apiserver/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.681011771Z namespaces/openshift-apiserver/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.681193395Z namespaces/openshift-apiserver/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.681354469Z namespaces/openshift-apiserver/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.681564983Z namespaces/openshift-apiserver/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.681765868Z namespaces/openshift-apiserver/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.681803679Z namespaces/openshift-apiserver/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.68187254Z namespaces/openshift-apiserver/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.681919601Z namespaces/openshift-apiserver/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.682344391Z namespaces/openshift-authentication-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.682357681Z namespaces/openshift-authentication-operator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.682367841Z namespaces/openshift-authentication-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.682421812Z namespaces/openshift-authentication-operator/monitoring.coreos.com/servicemonitors/authentication-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.682487974Z namespaces/openshift-authentication-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.682502324Z namespaces/openshift-authentication-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.682560965Z namespaces/openshift-authentication-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.682710159Z namespaces/openshift-authentication-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.682891733Z namespaces/openshift-authentication-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.683035956Z namespaces/openshift-authentication-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.6832335Z namespaces/openshift-authentication-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.683445775Z namespaces/openshift-authentication/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.683461735Z namespaces/openshift-authentication/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.683473296Z namespaces/openshift-authentication/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.683513477Z namespaces/openshift-authentication/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.68366841Z namespaces/openshift-authentication/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.683849184Z namespaces/openshift-authentication/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.683989517Z namespaces/openshift-authentication/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.684187511Z namespaces/openshift-authentication/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.684402336Z namespaces/openshift-cloud-controller-manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.684415236Z namespaces/openshift-cloud-controller-manager/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.684429667Z namespaces/openshift-cloud-controller-manager/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.684463587Z namespaces/openshift-cloud-controller-manager/coordination.k8s.io/leases/cloud-controller-manager.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.684528189Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.684549359Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.6845952Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.684748754Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.684933238Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.685105492Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.685448869Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.685678674Z namespaces/openshift-cloud-credential-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.685690434Z namespaces/openshift-cloud-credential-operator/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.685696734Z namespaces/openshift-cloud-credential-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.685746166Z namespaces/openshift-cloud-credential-operator/coordination.k8s.io/leases/cloud-credential-operator-leader.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.685799317Z namespaces/openshift-cloud-credential-operator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.685811227Z namespaces/openshift-cloud-credential-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.685860688Z namespaces/openshift-cloud-credential-operator/monitoring.coreos.com/servicemonitors/cloud-credential-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.68593378Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.685947Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.685987281Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.686140634Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.686346399Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.686487292Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.686688156Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.686907581Z namespaces/openshift-cloud-network-config-controller/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.686952672Z namespaces/openshift-cloud-network-config-controller/openshift-cloud-network-config-controller.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.687009523Z namespaces/openshift-cloud-network-config-controller/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.687063175Z namespaces/openshift-cloud-network-config-controller/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.687130816Z namespaces/openshift-cloud-network-config-controller/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.687176007Z namespaces/openshift-cloud-network-config-controller/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.687279789Z namespaces/openshift-cloud-network-config-controller/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.687369071Z namespaces/openshift-cloud-network-config-controller/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.687445373Z namespaces/openshift-cloud-network-config-controller/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.687494674Z namespaces/openshift-cloud-network-config-controller/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.687538925Z namespaces/openshift-cloud-network-config-controller/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.687583036Z namespaces/openshift-cloud-network-config-controller/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.687630967Z namespaces/openshift-cloud-network-config-controller/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.687715839Z namespaces/openshift-cloud-network-config-controller/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.68776198Z namespaces/openshift-cloud-network-config-controller/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.687810991Z namespaces/openshift-cloud-network-config-controller/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.687885813Z namespaces/openshift-cloud-network-config-controller/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.687935854Z namespaces/openshift-cloud-network-config-controller/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.687945374Z namespaces/openshift-cloud-network-config-controller/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.687992015Z namespaces/openshift-cloud-network-config-controller/coordination.k8s.io/leases/cloud-network-config-controller-lock.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.688086277Z namespaces/openshift-cloud-network-config-controller/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.688125788Z namespaces/openshift-cloud-network-config-controller/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.68821754Z namespaces/openshift-cloud-network-config-controller/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.688329663Z namespaces/openshift-cloud-network-config-controller/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.688408104Z namespaces/openshift-cloud-network-config-controller/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.688488056Z namespaces/openshift-cloud-network-config-controller/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.688569578Z namespaces/openshift-cloud-network-config-controller/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.688724161Z namespaces/openshift-cloud-network-config-controller/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.688835854Z namespaces/openshift-cloud-network-config-controller/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.688886715Z namespaces/openshift-cloud-network-config-controller/core/serviceaccounts/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.688940886Z namespaces/openshift-cloud-network-config-controller/core/serviceaccounts/cloud-network-config-controller.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.688981157Z namespaces/openshift-cloud-network-config-controller/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.689035438Z namespaces/openshift-cloud-network-config-controller/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.689076739Z namespaces/openshift-cloud-network-config-controller/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.68912026Z namespaces/openshift-cloud-network-config-controller/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.689221342Z namespaces/openshift-cloud-network-config-controller/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.689279564Z namespaces/openshift-cloud-network-config-controller/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.689363125Z namespaces/openshift-cloud-network-config-controller/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.689452677Z namespaces/openshift-cloud-network-config-controller/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.689501378Z namespaces/openshift-cloud-network-config-controller/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.689539749Z namespaces/openshift-cloud-network-config-controller/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.68959065Z namespaces/openshift-cloud-network-config-controller/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.689639581Z namespaces/openshift-cloud-network-config-controller/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.689670062Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.689677342Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.689738154Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.689887057Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.690083481Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.690222514Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.690435419Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.690782177Z namespaces/openshift-cloud-network-config-controller/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.690810837Z namespaces/openshift-cloud-network-config-controller/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.690879499Z namespaces/openshift-cloud-network-config-controller/rbac.authorization.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.690889559Z namespaces/openshift-cloud-network-config-controller/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.69090968Z namespaces/openshift-cloud-network-config-controller/rbac.authorization.k8s.io/rolebindings/cloud-network-config-controller-rb.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.690974531Z namespaces/openshift-cloud-network-config-controller/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.691001462Z namespaces/openshift-cloud-network-config-controller/rbac.authorization.k8s.io/roles/cloud-network-config-controller.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.691067763Z namespaces/openshift-cloud-network-config-controller/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.691111774Z namespaces/openshift-cloud-network-config-controller/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.691198646Z namespaces/openshift-cluster-csi-drivers/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.691238097Z namespaces/openshift-cluster-csi-drivers/openshift-cluster-csi-drivers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.691330339Z namespaces/openshift-cluster-csi-drivers/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.691362199Z namespaces/openshift-cluster-csi-drivers/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.691444481Z namespaces/openshift-cluster-csi-drivers/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.691481662Z namespaces/openshift-cluster-csi-drivers/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.691619545Z namespaces/openshift-cluster-csi-drivers/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.691699727Z namespaces/openshift-cluster-csi-drivers/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.691780149Z namespaces/openshift-cluster-csi-drivers/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.69182644Z namespaces/openshift-cluster-csi-drivers/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.69185664Z namespaces/openshift-cluster-csi-drivers/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.691923652Z namespaces/openshift-cluster-csi-drivers/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.691978223Z namespaces/openshift-cluster-csi-drivers/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.692056075Z namespaces/openshift-cluster-csi-drivers/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.692116126Z namespaces/openshift-cluster-csi-drivers/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.692168797Z namespaces/openshift-cluster-csi-drivers/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.692243649Z namespaces/openshift-cluster-csi-drivers/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.69232574Z namespaces/openshift-cluster-csi-drivers/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.692338771Z namespaces/openshift-cluster-csi-drivers/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.692362861Z namespaces/openshift-cluster-csi-drivers/coordination.k8s.io/leases/ebs-csi-aws-com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.692460923Z namespaces/openshift-cluster-csi-drivers/coordination.k8s.io/leases/external-attacher-leader-ebs-csi-aws-com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.692545885Z namespaces/openshift-cluster-csi-drivers/coordination.k8s.io/leases/external-resizer-ebs-csi-aws-com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.692656878Z namespaces/openshift-cluster-csi-drivers/coordination.k8s.io/leases/external-snapshotter-leader-ebs-csi-aws-com.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.69276509Z namespaces/openshift-cluster-csi-drivers/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.692797271Z namespaces/openshift-cluster-csi-drivers/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.692914473Z namespaces/openshift-cluster-csi-drivers/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.692990535Z namespaces/openshift-cluster-csi-drivers/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.693409184Z namespaces/openshift-cluster-csi-drivers/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.693493816Z namespaces/openshift-cluster-csi-drivers/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.693698431Z namespaces/openshift-cluster-csi-drivers/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.693888615Z namespaces/openshift-cluster-csi-drivers/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.694004257Z namespaces/openshift-cluster-csi-drivers/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.694041929Z namespaces/openshift-cluster-csi-drivers/core/serviceaccounts/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.69410675Z namespaces/openshift-cluster-csi-drivers/core/serviceaccounts/aws-ebs-csi-driver-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.694149531Z namespaces/openshift-cluster-csi-drivers/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.694195402Z namespaces/openshift-cluster-csi-drivers/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.694243643Z namespaces/openshift-cluster-csi-drivers/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.694296274Z namespaces/openshift-cluster-csi-drivers/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.694346035Z namespaces/openshift-cluster-csi-drivers/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.694391756Z namespaces/openshift-cluster-csi-drivers/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.694469138Z namespaces/openshift-cluster-csi-drivers/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.69455486Z namespaces/openshift-cluster-csi-drivers/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.69458505Z namespaces/openshift-cluster-csi-drivers/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.694649292Z namespaces/openshift-cluster-csi-drivers/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.694689423Z namespaces/openshift-cluster-csi-drivers/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.694734534Z namespaces/openshift-cluster-csi-drivers/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.694806085Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.694820786Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.694865216Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.69502173Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.695203704Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.695358127Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.695581252Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.695793917Z namespaces/openshift-cluster-csi-drivers/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.695802117Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.695852178Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/aws-ebs-csi-driver-node-6cgzl.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.69594543Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/csi-driver/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.69595486Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/csi-driver/csi-driver/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.695958851Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/csi-driver/csi-driver/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.696015782Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/csi-driver/csi-driver/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.696117084Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/csi-driver/csi-driver/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.696187276Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/csi-driver/csi-driver/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.696220006Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/csi-liveness-probe/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.696227057Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/csi-liveness-probe/csi-liveness-probe/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.696237937Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/csi-liveness-probe/csi-liveness-probe/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.696284678Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/csi-liveness-probe/csi-liveness-probe/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.69639999Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/csi-liveness-probe/csi-liveness-probe/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.696468302Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/csi-liveness-probe/csi-liveness-probe/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.696666946Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/csi-node-driver-registrar/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.696677667Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/csi-node-driver-registrar/csi-node-driver-registrar/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.696682747Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/csi-node-driver-registrar/csi-node-driver-registrar/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.696728548Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/csi-node-driver-registrar/csi-node-driver-registrar/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.69683192Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/csi-node-driver-registrar/csi-node-driver-registrar/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.696899481Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-6cgzl/csi-node-driver-registrar/csi-node-driver-registrar/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.696949122Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.696991903Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/aws-ebs-csi-driver-node-d4n2l.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.697084405Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/csi-driver/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.697094356Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/csi-driver/csi-driver/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.697109666Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/csi-driver/csi-driver/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.697158117Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/csi-driver/csi-driver/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.69727809Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/csi-driver/csi-driver/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.697357542Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/csi-driver/csi-driver/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.697372042Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/csi-liveness-probe/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.697378502Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/csi-liveness-probe/csi-liveness-probe/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.697399902Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/csi-liveness-probe/csi-liveness-probe/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.697458454Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/csi-liveness-probe/csi-liveness-probe/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.697539086Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/csi-liveness-probe/csi-liveness-probe/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.697610067Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/csi-liveness-probe/csi-liveness-probe/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.697637318Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/csi-node-driver-registrar/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.697643688Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/csi-node-driver-registrar/csi-node-driver-registrar/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.697649998Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/csi-node-driver-registrar/csi-node-driver-registrar/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.697711449Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/csi-node-driver-registrar/csi-node-driver-registrar/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.697816141Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/csi-node-driver-registrar/csi-node-driver-registrar/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.697886633Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-d4n2l/csi-node-driver-registrar/csi-node-driver-registrar/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.697946714Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.697979405Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/aws-ebs-csi-driver-node-zxp2c.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.698079267Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/csi-driver/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.698090138Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/csi-driver/csi-driver/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.698097008Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/csi-driver/csi-driver/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.698151529Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/csi-driver/csi-driver/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.698251571Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/csi-driver/csi-driver/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.698351013Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/csi-driver/csi-driver/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.698376794Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/csi-liveness-probe/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.698391154Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/csi-liveness-probe/csi-liveness-probe/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.698398754Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/csi-liveness-probe/csi-liveness-probe/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.698446615Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/csi-liveness-probe/csi-liveness-probe/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.698538668Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/csi-liveness-probe/csi-liveness-probe/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.698620759Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/csi-liveness-probe/csi-liveness-probe/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.69864827Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/csi-node-driver-registrar/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.69865684Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/csi-node-driver-registrar/csi-node-driver-registrar/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.69866379Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/csi-node-driver-registrar/csi-node-driver-registrar/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.698727652Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/csi-node-driver-registrar/csi-node-driver-registrar/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.698817224Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/csi-node-driver-registrar/csi-node-driver-registrar/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.698884635Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-zxp2c/csi-node-driver-registrar/csi-node-driver-registrar/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.698925016Z namespaces/openshift-cluster-csi-drivers/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.698974577Z namespaces/openshift-cluster-csi-drivers/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.699040439Z namespaces/openshift-cluster-csi-drivers/rbac.authorization.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.699051149Z namespaces/openshift-cluster-csi-drivers/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.69909415Z namespaces/openshift-cluster-csi-drivers/rbac.authorization.k8s.io/rolebindings/aws-ebs-csi-driver-operator-rolebinding.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.699151061Z namespaces/openshift-cluster-csi-drivers/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.699191752Z namespaces/openshift-cluster-csi-drivers/rbac.authorization.k8s.io/roles/aws-ebs-csi-driver-operator-role.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.699249013Z namespaces/openshift-cluster-csi-drivers/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.699309994Z namespaces/openshift-cluster-csi-drivers/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.699373406Z namespaces/openshift-cluster-machine-approver/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.699380936Z namespaces/openshift-cluster-machine-approver/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.699392076Z namespaces/openshift-cluster-machine-approver/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.699434217Z namespaces/openshift-cluster-machine-approver/coordination.k8s.io/leases/cluster-machine-approver-leader.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.699501599Z namespaces/openshift-cluster-machine-approver/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.699513389Z namespaces/openshift-cluster-machine-approver/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.69953603Z namespaces/openshift-cluster-machine-approver/monitoring.coreos.com/servicemonitors/cluster-machine-approver.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.699602621Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.699612421Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.699662502Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.699817966Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.70003453Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.700171404Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.700392588Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.700594333Z namespaces/openshift-cluster-node-tuning-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.700637494Z namespaces/openshift-cluster-node-tuning-operator/openshift-cluster-node-tuning-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.700712355Z namespaces/openshift-cluster-node-tuning-operator/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.700749756Z namespaces/openshift-cluster-node-tuning-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.700827408Z namespaces/openshift-cluster-node-tuning-operator/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.700870549Z namespaces/openshift-cluster-node-tuning-operator/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.700998112Z namespaces/openshift-cluster-node-tuning-operator/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.701079693Z namespaces/openshift-cluster-node-tuning-operator/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.701161835Z namespaces/openshift-cluster-node-tuning-operator/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.701210787Z namespaces/openshift-cluster-node-tuning-operator/apps/daemonsets/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.701239377Z namespaces/openshift-cluster-node-tuning-operator/apps/daemonsets/tuned.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.701436201Z namespaces/openshift-cluster-node-tuning-operator/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.701467952Z namespaces/openshift-cluster-node-tuning-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.701512923Z namespaces/openshift-cluster-node-tuning-operator/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.701560704Z namespaces/openshift-cluster-node-tuning-operator/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.701648626Z namespaces/openshift-cluster-node-tuning-operator/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.701685867Z namespaces/openshift-cluster-node-tuning-operator/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.701749828Z namespaces/openshift-cluster-node-tuning-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.70183758Z namespaces/openshift-cluster-node-tuning-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.701885581Z namespaces/openshift-cluster-node-tuning-operator/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.701903582Z namespaces/openshift-cluster-node-tuning-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.701958063Z namespaces/openshift-cluster-node-tuning-operator/coordination.k8s.io/leases/node-tuning-operator-lock.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.702044115Z namespaces/openshift-cluster-node-tuning-operator/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.702080846Z namespaces/openshift-cluster-node-tuning-operator/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.703066467Z namespaces/openshift-cluster-node-tuning-operator/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.70317235Z namespaces/openshift-cluster-node-tuning-operator/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.703342883Z namespaces/openshift-cluster-node-tuning-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.703426005Z namespaces/openshift-cluster-node-tuning-operator/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.703624249Z namespaces/openshift-cluster-node-tuning-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.703776263Z namespaces/openshift-cluster-node-tuning-operator/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.703920706Z namespaces/openshift-cluster-node-tuning-operator/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.704067319Z namespaces/openshift-cluster-node-tuning-operator/core/serviceaccounts/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.70411549Z namespaces/openshift-cluster-node-tuning-operator/core/serviceaccounts/cluster-node-tuning-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.704183442Z namespaces/openshift-cluster-node-tuning-operator/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.704213533Z namespaces/openshift-cluster-node-tuning-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.704283354Z namespaces/openshift-cluster-node-tuning-operator/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.704348305Z namespaces/openshift-cluster-node-tuning-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.704412847Z namespaces/openshift-cluster-node-tuning-operator/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.704457478Z namespaces/openshift-cluster-node-tuning-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.70455035Z namespaces/openshift-cluster-node-tuning-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.704637292Z namespaces/openshift-cluster-node-tuning-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.704702293Z namespaces/openshift-cluster-node-tuning-operator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.704752784Z namespaces/openshift-cluster-node-tuning-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.704816746Z namespaces/openshift-cluster-node-tuning-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.704872977Z namespaces/openshift-cluster-node-tuning-operator/monitoring.coreos.com/prometheusrules/node-tuning-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.704938918Z namespaces/openshift-cluster-node-tuning-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.70498745Z namespaces/openshift-cluster-node-tuning-operator/monitoring.coreos.com/servicemonitors/node-tuning-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.70502906Z namespaces/openshift-cluster-node-tuning-operator/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.705080522Z namespaces/openshift-cluster-node-tuning-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.705130183Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.705145733Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.705215324Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.705417999Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.705612943Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.705781607Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.705995062Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.706228337Z namespaces/openshift-cluster-node-tuning-operator/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.706242397Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-nvswk/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.70634336Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-nvswk/tuned-nvswk.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.706433831Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-nvswk/tuned/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.706441752Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-nvswk/tuned/tuned/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.706448082Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-nvswk/tuned/tuned/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.706534604Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-nvswk/tuned/tuned/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.706656556Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-nvswk/tuned/tuned/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.706725708Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-nvswk/tuned/tuned/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.70683847Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-qjvln/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.706881641Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-qjvln/tuned-qjvln.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.706972623Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-qjvln/tuned/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.706980083Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-qjvln/tuned/tuned/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.706984034Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-qjvln/tuned/tuned/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.707021184Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-qjvln/tuned/tuned/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.707136677Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-qjvln/tuned/tuned/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.707223429Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-qjvln/tuned/tuned/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.70727711Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-xfltw/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.707328651Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-xfltw/tuned-xfltw.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.707420023Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-xfltw/tuned/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.707427453Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-xfltw/tuned/tuned/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.707431553Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-xfltw/tuned/tuned/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.707464794Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-xfltw/tuned/tuned/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.707569276Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-xfltw/tuned/tuned/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.707648668Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-xfltw/tuned/tuned/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.707675729Z namespaces/openshift-cluster-node-tuning-operator/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.707711759Z namespaces/openshift-cluster-node-tuning-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.707768851Z namespaces/openshift-cluster-node-tuning-operator/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.707818012Z namespaces/openshift-cluster-node-tuning-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.707865413Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.707936164Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/profiles/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.707974655Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/profiles/ip-10-0-140-224.ec2.internal.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.708080508Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/profiles/ip-10-0-141-82.ec2.internal.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.708164589Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/profiles/ip-10-0-143-79.ec2.internal.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.708215741Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/tuneds/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.708260472Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/tuneds/default.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.708381614Z namespaces/openshift-cluster-samples-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.708416225Z namespaces/openshift-cluster-samples-operator/openshift-cluster-samples-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.708516837Z namespaces/openshift-cluster-samples-operator/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.708558098Z namespaces/openshift-cluster-samples-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.7086298Z namespaces/openshift-cluster-samples-operator/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.708661451Z namespaces/openshift-cluster-samples-operator/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.708751202Z namespaces/openshift-cluster-samples-operator/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.708863495Z namespaces/openshift-cluster-samples-operator/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.708965837Z namespaces/openshift-cluster-samples-operator/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.709013358Z namespaces/openshift-cluster-samples-operator/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.709057189Z namespaces/openshift-cluster-samples-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.70911033Z namespaces/openshift-cluster-samples-operator/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.709162371Z namespaces/openshift-cluster-samples-operator/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.709239793Z namespaces/openshift-cluster-samples-operator/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.709382396Z namespaces/openshift-cluster-samples-operator/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.709420017Z namespaces/openshift-cluster-samples-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.709508259Z namespaces/openshift-cluster-samples-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.709580811Z namespaces/openshift-cluster-samples-operator/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.709634672Z namespaces/openshift-cluster-samples-operator/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.709832456Z namespaces/openshift-cluster-samples-operator/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.709919178Z namespaces/openshift-cluster-samples-operator/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.710053011Z namespaces/openshift-cluster-samples-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.710133143Z namespaces/openshift-cluster-samples-operator/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.710245265Z namespaces/openshift-cluster-samples-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.710394519Z namespaces/openshift-cluster-samples-operator/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.710560732Z namespaces/openshift-cluster-samples-operator/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.710618704Z namespaces/openshift-cluster-samples-operator/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.710648524Z namespaces/openshift-cluster-samples-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.710722346Z namespaces/openshift-cluster-samples-operator/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.710760607Z namespaces/openshift-cluster-samples-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.710839968Z namespaces/openshift-cluster-samples-operator/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.710884549Z namespaces/openshift-cluster-samples-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.710972591Z namespaces/openshift-cluster-samples-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.711051693Z namespaces/openshift-cluster-samples-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.711102574Z namespaces/openshift-cluster-samples-operator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.711131885Z namespaces/openshift-cluster-samples-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.711193686Z namespaces/openshift-cluster-samples-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.711223627Z namespaces/openshift-cluster-samples-operator/monitoring.coreos.com/prometheusrules/samples-operator-alerts.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.71133605Z namespaces/openshift-cluster-samples-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.71136723Z namespaces/openshift-cluster-samples-operator/monitoring.coreos.com/servicemonitors/cluster-samples-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.711431692Z namespaces/openshift-cluster-samples-operator/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.711458942Z namespaces/openshift-cluster-samples-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.711515594Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.711523354Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.711569035Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.711715468Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.711897502Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.712038845Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.712240849Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.712444124Z namespaces/openshift-cluster-samples-operator/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.712459204Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-65db858894-r95tx/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.712472875Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-65db858894-r95tx/cluster-samples-operator-65db858894-r95tx.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.712573157Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-65db858894-r95tx/cluster-samples-operator-watch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.712585147Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-65db858894-r95tx/cluster-samples-operator-watch/cluster-samples-operator-watch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.712591367Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-65db858894-r95tx/cluster-samples-operator-watch/cluster-samples-operator-watch/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.712642748Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-65db858894-r95tx/cluster-samples-operator-watch/cluster-samples-operator-watch/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.712754621Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-65db858894-r95tx/cluster-samples-operator-watch/cluster-samples-operator-watch/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.712821972Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-65db858894-r95tx/cluster-samples-operator-watch/cluster-samples-operator-watch/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.712863983Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-65db858894-r95tx/cluster-samples-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.712870793Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-65db858894-r95tx/cluster-samples-operator/cluster-samples-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.712877093Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-65db858894-r95tx/cluster-samples-operator/cluster-samples-operator/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.712928214Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-65db858894-r95tx/cluster-samples-operator/cluster-samples-operator/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.713568819Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-65db858894-r95tx/cluster-samples-operator/cluster-samples-operator/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.7136287Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-65db858894-r95tx/cluster-samples-operator/cluster-samples-operator/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.713679701Z namespaces/openshift-cluster-samples-operator/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.713714302Z namespaces/openshift-cluster-samples-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.713795154Z namespaces/openshift-cluster-samples-operator/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.713823644Z namespaces/openshift-cluster-samples-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.713940737Z namespaces/openshift-cluster-storage-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.713989658Z namespaces/openshift-cluster-storage-operator/openshift-cluster-storage-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.714051109Z namespaces/openshift-cluster-storage-operator/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.71408227Z namespaces/openshift-cluster-storage-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.714156512Z namespaces/openshift-cluster-storage-operator/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.714200442Z namespaces/openshift-cluster-storage-operator/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.714309175Z namespaces/openshift-cluster-storage-operator/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.714419307Z namespaces/openshift-cluster-storage-operator/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.71453032Z namespaces/openshift-cluster-storage-operator/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.714588521Z namespaces/openshift-cluster-storage-operator/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.714641532Z namespaces/openshift-cluster-storage-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.715036341Z namespaces/openshift-cluster-storage-operator/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.715067462Z namespaces/openshift-cluster-storage-operator/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.715165654Z namespaces/openshift-cluster-storage-operator/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.715209895Z namespaces/openshift-cluster-storage-operator/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.715250916Z namespaces/openshift-cluster-storage-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.715526662Z namespaces/openshift-cluster-storage-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.715564433Z namespaces/openshift-cluster-storage-operator/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.715574103Z namespaces/openshift-cluster-storage-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.715632124Z namespaces/openshift-cluster-storage-operator/coordination.k8s.io/leases/data-source-validator-leader.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.715722726Z namespaces/openshift-cluster-storage-operator/coordination.k8s.io/leases/snapshot-controller-leader.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.715803328Z namespaces/openshift-cluster-storage-operator/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.715849949Z namespaces/openshift-cluster-storage-operator/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.715969132Z namespaces/openshift-cluster-storage-operator/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.716053343Z namespaces/openshift-cluster-storage-operator/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.716383461Z namespaces/openshift-cluster-storage-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.716460672Z namespaces/openshift-cluster-storage-operator/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.716574395Z namespaces/openshift-cluster-storage-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.716724138Z namespaces/openshift-cluster-storage-operator/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.716894122Z namespaces/openshift-cluster-storage-operator/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.716956793Z namespaces/openshift-cluster-storage-operator/core/serviceaccounts/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.716998054Z namespaces/openshift-cluster-storage-operator/core/serviceaccounts/csi-snapshot-controller-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.717067966Z namespaces/openshift-cluster-storage-operator/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.717111897Z namespaces/openshift-cluster-storage-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.717185108Z namespaces/openshift-cluster-storage-operator/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.717221299Z namespaces/openshift-cluster-storage-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.717416353Z namespaces/openshift-cluster-storage-operator/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.717436684Z namespaces/openshift-cluster-storage-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.717529376Z namespaces/openshift-cluster-storage-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.717628138Z namespaces/openshift-cluster-storage-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.717689919Z namespaces/openshift-cluster-storage-operator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.717742751Z namespaces/openshift-cluster-storage-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.717798092Z namespaces/openshift-cluster-storage-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.717855813Z namespaces/openshift-cluster-storage-operator/monitoring.coreos.com/prometheusrules/prometheus.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.717950455Z namespaces/openshift-cluster-storage-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.717982586Z namespaces/openshift-cluster-storage-operator/monitoring.coreos.com/servicemonitors/cluster-storage-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.718047957Z namespaces/openshift-cluster-storage-operator/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.718083628Z namespaces/openshift-cluster-storage-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.71816526Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.718175Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.718226941Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.718405915Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.718601899Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.718751933Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.718961098Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.719148692Z namespaces/openshift-cluster-storage-operator/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.719158792Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-78495597f6-pqf7p/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.719168702Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-78495597f6-pqf7p/volume-data-source-validator-78495597f6-pqf7p.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.719261914Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-78495597f6-pqf7p/volume-data-source-validator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.719292015Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-78495597f6-pqf7p/volume-data-source-validator/volume-data-source-validator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.719297075Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-78495597f6-pqf7p/volume-data-source-validator/volume-data-source-validator/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.719322846Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-78495597f6-pqf7p/volume-data-source-validator/volume-data-source-validator/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.719432618Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-78495597f6-pqf7p/volume-data-source-validator/volume-data-source-validator/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.71950329Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-78495597f6-pqf7p/volume-data-source-validator/volume-data-source-validator/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.7195463Z namespaces/openshift-cluster-storage-operator/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.719564951Z namespaces/openshift-cluster-storage-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.719628022Z namespaces/openshift-cluster-storage-operator/rbac.authorization.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.719639282Z namespaces/openshift-cluster-storage-operator/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.719652523Z namespaces/openshift-cluster-storage-operator/rbac.authorization.k8s.io/rolebindings/csi-snapshot-controller-operator-role.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.719735955Z namespaces/openshift-cluster-storage-operator/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.719786676Z namespaces/openshift-cluster-storage-operator/rbac.authorization.k8s.io/roles/csi-snapshot-controller-operator-role.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.719848397Z namespaces/openshift-cluster-storage-operator/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.719887118Z namespaces/openshift-cluster-storage-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.71997306Z namespaces/openshift-cluster-version/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.720026281Z namespaces/openshift-cluster-version/openshift-cluster-version.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.720084892Z namespaces/openshift-cluster-version/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.720127683Z namespaces/openshift-cluster-version/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.720177464Z namespaces/openshift-cluster-version/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.720220445Z namespaces/openshift-cluster-version/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.720322937Z namespaces/openshift-cluster-version/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.720404849Z namespaces/openshift-cluster-version/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.720486091Z namespaces/openshift-cluster-version/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.720543272Z namespaces/openshift-cluster-version/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.720591183Z namespaces/openshift-cluster-version/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.720648305Z namespaces/openshift-cluster-version/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.720702056Z namespaces/openshift-cluster-version/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.720775378Z namespaces/openshift-cluster-version/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.720841719Z namespaces/openshift-cluster-version/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.72089115Z namespaces/openshift-cluster-version/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.720974072Z namespaces/openshift-cluster-version/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.721030633Z namespaces/openshift-cluster-version/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.721039153Z namespaces/openshift-cluster-version/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.721073484Z namespaces/openshift-cluster-version/coordination.k8s.io/leases/version.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.721167466Z namespaces/openshift-cluster-version/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.721212467Z namespaces/openshift-cluster-version/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.72134087Z namespaces/openshift-cluster-version/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.721422852Z namespaces/openshift-cluster-version/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.721522514Z namespaces/openshift-cluster-version/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.721602756Z namespaces/openshift-cluster-version/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.721687267Z namespaces/openshift-cluster-version/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.721826841Z namespaces/openshift-cluster-version/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.722005585Z namespaces/openshift-cluster-version/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.722081486Z namespaces/openshift-cluster-version/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.722130637Z namespaces/openshift-cluster-version/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.722192279Z namespaces/openshift-cluster-version/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.7222424Z namespaces/openshift-cluster-version/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.722307381Z namespaces/openshift-cluster-version/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.722348392Z namespaces/openshift-cluster-version/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.722436134Z namespaces/openshift-cluster-version/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.722517406Z namespaces/openshift-cluster-version/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.722565077Z namespaces/openshift-cluster-version/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.722611088Z namespaces/openshift-cluster-version/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.722665359Z namespaces/openshift-cluster-version/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.7227186Z namespaces/openshift-cluster-version/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.722772921Z namespaces/openshift-cluster-version/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.722785812Z namespaces/openshift-cluster-version/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.722831363Z namespaces/openshift-cluster-version/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.722988716Z namespaces/openshift-cluster-version/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.7231643Z namespaces/openshift-cluster-version/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.723331864Z namespaces/openshift-cluster-version/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.723525448Z namespaces/openshift-cluster-version/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.723730772Z namespaces/openshift-cluster-version/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.723772973Z namespaces/openshift-cluster-version/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.723824394Z namespaces/openshift-cluster-version/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.723877126Z namespaces/openshift-cluster-version/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.723976188Z namespaces/openshift-config-managed/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.724023459Z namespaces/openshift-config-managed/openshift-config-managed.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.724098891Z namespaces/openshift-config-managed/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.724124161Z namespaces/openshift-config-managed/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.724209003Z namespaces/openshift-config-managed/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.724249034Z namespaces/openshift-config-managed/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.724357686Z namespaces/openshift-config-managed/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.724436738Z namespaces/openshift-config-managed/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.72452074Z namespaces/openshift-config-managed/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.724555941Z namespaces/openshift-config-managed/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.724616012Z namespaces/openshift-config-managed/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.724660333Z namespaces/openshift-config-managed/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.724697714Z namespaces/openshift-config-managed/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.724777696Z namespaces/openshift-config-managed/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.724832207Z namespaces/openshift-config-managed/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.724865197Z namespaces/openshift-config-managed/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.7249603Z namespaces/openshift-config-managed/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.725036641Z namespaces/openshift-config-managed/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.725071022Z namespaces/openshift-config-managed/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.728388745Z namespaces/openshift-config-managed/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.728471647Z namespaces/openshift-config-managed/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.728565139Z namespaces/openshift-config-managed/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.728648501Z namespaces/openshift-config-managed/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.728732133Z namespaces/openshift-config-managed/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.728883016Z namespaces/openshift-config-managed/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.728993639Z namespaces/openshift-config-managed/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.72907179Z namespaces/openshift-config-managed/core/configmaps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.729120331Z namespaces/openshift-config-managed/core/configmaps/console-public.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.729208593Z namespaces/openshift-config-managed/core/configmaps/openshift-network-features.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.729259354Z namespaces/openshift-config-managed/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.729325996Z namespaces/openshift-config-managed/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.729373247Z namespaces/openshift-config-managed/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.729402868Z namespaces/openshift-config-managed/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.729491839Z namespaces/openshift-config-managed/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.72952946Z namespaces/openshift-config-managed/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.729624212Z namespaces/openshift-config-managed/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.729703204Z namespaces/openshift-config-managed/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.729773556Z namespaces/openshift-config-managed/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.729790086Z namespaces/openshift-config-managed/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.729870628Z namespaces/openshift-config-managed/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.729888508Z namespaces/openshift-config-managed/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.72996721Z namespaces/openshift-config-managed/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.72998191Z namespaces/openshift-config-managed/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.730036262Z namespaces/openshift-config-managed/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.730219546Z namespaces/openshift-config-managed/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.7304399Z namespaces/openshift-config-managed/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.730578663Z namespaces/openshift-config-managed/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.730792048Z namespaces/openshift-config-managed/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.731022963Z namespaces/openshift-config-managed/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.731055924Z namespaces/openshift-config-managed/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.731096205Z namespaces/openshift-config-managed/rbac.authorization.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.731106905Z namespaces/openshift-config-managed/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.731168886Z namespaces/openshift-config-managed/rbac.authorization.k8s.io/rolebindings/openshift-network-public-role-binding.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.731246308Z namespaces/openshift-config-managed/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.731284189Z namespaces/openshift-config-managed/rbac.authorization.k8s.io/roles/openshift-network-public-role.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.731367921Z namespaces/openshift-config-managed/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.731383141Z namespaces/openshift-config-managed/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.731456663Z namespaces/openshift-config-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.731466043Z namespaces/openshift-config-operator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.731471573Z namespaces/openshift-config-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.731551675Z namespaces/openshift-config-operator/monitoring.coreos.com/servicemonitors/config-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.731582076Z namespaces/openshift-config-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.731596726Z namespaces/openshift-config-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.731656427Z namespaces/openshift-config-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.73181363Z namespaces/openshift-config-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.731992174Z namespaces/openshift-config-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.732130618Z namespaces/openshift-config-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.732379873Z namespaces/openshift-config-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.732585888Z namespaces/openshift-config/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.732623599Z namespaces/openshift-config/openshift-config.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.732810792Z namespaces/openshift-config/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.732849904Z namespaces/openshift-config/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.732929165Z namespaces/openshift-config/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.732958486Z namespaces/openshift-config/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.733055598Z namespaces/openshift-config/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.73313596Z namespaces/openshift-config/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.733219781Z namespaces/openshift-config/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.733279023Z namespaces/openshift-config/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.733460857Z namespaces/openshift-config/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.733514298Z namespaces/openshift-config/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.733555559Z namespaces/openshift-config/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.733640771Z namespaces/openshift-config/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.733688792Z namespaces/openshift-config/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.733725393Z namespaces/openshift-config/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.733837245Z namespaces/openshift-config/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.733872286Z namespaces/openshift-config/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.733926117Z namespaces/openshift-config/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.734072991Z namespaces/openshift-config/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.734152032Z namespaces/openshift-config/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.734235744Z namespaces/openshift-config/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.734344057Z namespaces/openshift-config/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.734432408Z namespaces/openshift-config/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.734616792Z namespaces/openshift-config/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.734800416Z namespaces/openshift-config/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.734851408Z namespaces/openshift-config/core/secrets/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.734882818Z namespaces/openshift-config/core/secrets/pull-secret.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.73494586Z namespaces/openshift-config/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.734983651Z namespaces/openshift-config/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.735043222Z namespaces/openshift-config/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.735084433Z namespaces/openshift-config/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.735150844Z namespaces/openshift-config/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.735196145Z namespaces/openshift-config/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.735285377Z namespaces/openshift-config/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.73539092Z namespaces/openshift-config/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.7354249Z namespaces/openshift-config/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.735470371Z namespaces/openshift-config/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.735529112Z namespaces/openshift-config/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.735569183Z namespaces/openshift-config/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.735611324Z namespaces/openshift-config/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.735620765Z namespaces/openshift-config/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.735682186Z namespaces/openshift-config/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.735834819Z namespaces/openshift-config/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.736025553Z namespaces/openshift-config/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.736173126Z namespaces/openshift-config/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.736400402Z namespaces/openshift-config/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.736575355Z namespaces/openshift-config/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.736604806Z namespaces/openshift-config/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.736662748Z namespaces/openshift-config/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.736692428Z namespaces/openshift-config/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.73679179Z namespaces/openshift-console-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.736840351Z namespaces/openshift-console-operator/openshift-console-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.737002275Z namespaces/openshift-console-operator/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.737037466Z namespaces/openshift-console-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.737121187Z namespaces/openshift-console-operator/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.737159358Z namespaces/openshift-console-operator/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.73724751Z namespaces/openshift-console-operator/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.737386393Z namespaces/openshift-console-operator/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.737490756Z namespaces/openshift-console-operator/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.737525407Z namespaces/openshift-console-operator/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.737586388Z namespaces/openshift-console-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.737637789Z namespaces/openshift-console-operator/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.73767356Z namespaces/openshift-console-operator/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.737778352Z namespaces/openshift-console-operator/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.737822393Z namespaces/openshift-console-operator/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.737869344Z namespaces/openshift-console-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.737949146Z namespaces/openshift-console-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.737984237Z namespaces/openshift-console-operator/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.737991357Z namespaces/openshift-console-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.738050868Z namespaces/openshift-console-operator/coordination.k8s.io/leases/console-operator-lock.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.738110229Z namespaces/openshift-console-operator/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.73814464Z namespaces/openshift-console-operator/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.738759414Z namespaces/openshift-console-operator/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.738846516Z namespaces/openshift-console-operator/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.739086511Z namespaces/openshift-console-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.739167693Z namespaces/openshift-console-operator/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.739310306Z namespaces/openshift-console-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.739447779Z namespaces/openshift-console-operator/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.739645863Z namespaces/openshift-console-operator/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.739699424Z namespaces/openshift-console-operator/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.739740145Z namespaces/openshift-console-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.739776116Z namespaces/openshift-console-operator/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.739814137Z namespaces/openshift-console-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.739893689Z namespaces/openshift-console-operator/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.73992986Z namespaces/openshift-console-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.740020431Z namespaces/openshift-console-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.740102523Z namespaces/openshift-console-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.740169035Z namespaces/openshift-console-operator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.740209855Z namespaces/openshift-console-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.740280667Z namespaces/openshift-console-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.740322048Z namespaces/openshift-console-operator/monitoring.coreos.com/prometheusrules/cluster-monitoring-prometheus-rules.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.74039652Z namespaces/openshift-console-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.74040952Z namespaces/openshift-console-operator/monitoring.coreos.com/servicemonitors/console-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.740477912Z namespaces/openshift-console-operator/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.740531013Z namespaces/openshift-console-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.740579214Z namespaces/openshift-console-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.740588944Z namespaces/openshift-console-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.740638365Z namespaces/openshift-console-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.740792888Z namespaces/openshift-console-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.740982852Z namespaces/openshift-console-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.741117306Z namespaces/openshift-console-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.741420382Z namespaces/openshift-console-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.741624317Z namespaces/openshift-console-operator/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.741631697Z namespaces/openshift-console-operator/pods/console-operator-7866497494-89h9v/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.741663278Z namespaces/openshift-console-operator/pods/console-operator-7866497494-89h9v/console-operator-7866497494-89h9v.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.741862692Z namespaces/openshift-console-operator/pods/console-operator-7866497494-89h9v/console-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.741870092Z namespaces/openshift-console-operator/pods/console-operator-7866497494-89h9v/console-operator/console-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.741874062Z namespaces/openshift-console-operator/pods/console-operator-7866497494-89h9v/console-operator/console-operator/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.741925353Z namespaces/openshift-console-operator/pods/console-operator-7866497494-89h9v/console-operator/console-operator/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.742458535Z namespaces/openshift-console-operator/pods/console-operator-7866497494-89h9v/console-operator/console-operator/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.742492276Z namespaces/openshift-console-operator/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.742538247Z namespaces/openshift-console-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.742604228Z namespaces/openshift-console-operator/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.742634649Z namespaces/openshift-console-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.74270249Z namespaces/openshift-console-user-settings/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.742710051Z namespaces/openshift-console-user-settings/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.742716221Z namespaces/openshift-console-user-settings/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.742769482Z namespaces/openshift-console-user-settings/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.742927635Z namespaces/openshift-console-user-settings/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.743104219Z namespaces/openshift-console-user-settings/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.743253283Z namespaces/openshift-console-user-settings/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.743485818Z namespaces/openshift-console-user-settings/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.743706513Z namespaces/openshift-console/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.743742653Z namespaces/openshift-console/openshift-console.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.743945088Z namespaces/openshift-console/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.743993089Z namespaces/openshift-console/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.74406352Z namespaces/openshift-console/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.744092811Z namespaces/openshift-console/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.744188353Z namespaces/openshift-console/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.744370877Z namespaces/openshift-console/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.744703615Z namespaces/openshift-console/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.744741735Z namespaces/openshift-console/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.744778856Z namespaces/openshift-console/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.744850778Z namespaces/openshift-console/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.744900939Z namespaces/openshift-console/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.744983001Z namespaces/openshift-console/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.745039852Z namespaces/openshift-console/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.745079783Z namespaces/openshift-console/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.745167295Z namespaces/openshift-console/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.745227666Z namespaces/openshift-console/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.745280757Z namespaces/openshift-console/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.745900951Z namespaces/openshift-console/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.745988943Z namespaces/openshift-console/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.746230378Z namespaces/openshift-console/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.74633078Z namespaces/openshift-console/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.746504864Z namespaces/openshift-console/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.746625347Z namespaces/openshift-console/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.746823381Z namespaces/openshift-console/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.746882613Z namespaces/openshift-console/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.746911553Z namespaces/openshift-console/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.746990775Z namespaces/openshift-console/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.747028426Z namespaces/openshift-console/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.747099807Z namespaces/openshift-console/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.747137798Z namespaces/openshift-console/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.74722983Z namespaces/openshift-console/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.747333323Z namespaces/openshift-console/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.747400884Z namespaces/openshift-console/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.747435985Z namespaces/openshift-console/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.747497426Z namespaces/openshift-console/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.747527327Z namespaces/openshift-console/monitoring.coreos.com/servicemonitors/console.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.747597438Z namespaces/openshift-console/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.747634899Z namespaces/openshift-console/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.747700411Z namespaces/openshift-console/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.747728161Z namespaces/openshift-console/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.747784742Z namespaces/openshift-console/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.747933906Z namespaces/openshift-console/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.74811384Z namespaces/openshift-console/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.748251453Z namespaces/openshift-console/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.748506548Z namespaces/openshift-console/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.748710283Z namespaces/openshift-console/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.748720403Z namespaces/openshift-console/pods/console-7599f89d75-dfw7d/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.748784684Z namespaces/openshift-console/pods/console-7599f89d75-dfw7d/console-7599f89d75-dfw7d.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.748876966Z namespaces/openshift-console/pods/console-7599f89d75-dfw7d/console/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.748887447Z namespaces/openshift-console/pods/console-7599f89d75-dfw7d/console/console/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.748893427Z namespaces/openshift-console/pods/console-7599f89d75-dfw7d/console/console/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.748917487Z namespaces/openshift-console/pods/console-7599f89d75-dfw7d/console/console/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.74904155Z namespaces/openshift-console/pods/console-7599f89d75-dfw7d/console/console/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.749097342Z namespaces/openshift-console/pods/console-7599f89d75-dfw7d/console/console/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.749128172Z namespaces/openshift-console/pods/downloads-68c9cbb497-f54r7/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.749159793Z namespaces/openshift-console/pods/downloads-68c9cbb497-f54r7/downloads-68c9cbb497-f54r7.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.749276686Z namespaces/openshift-console/pods/downloads-68c9cbb497-f54r7/download-server/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.749288336Z namespaces/openshift-console/pods/downloads-68c9cbb497-f54r7/download-server/download-server/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.749292306Z namespaces/openshift-console/pods/downloads-68c9cbb497-f54r7/download-server/download-server/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.749339477Z namespaces/openshift-console/pods/downloads-68c9cbb497-f54r7/download-server/download-server/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.749664504Z namespaces/openshift-console/pods/downloads-68c9cbb497-f54r7/download-server/download-server/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.749747896Z namespaces/openshift-console/pods/downloads-68c9cbb497-f54r7/download-server/download-server/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.749769276Z namespaces/openshift-console/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.749822518Z namespaces/openshift-console/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.749874659Z namespaces/openshift-console/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.74992903Z namespaces/openshift-console/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.750036352Z namespaces/openshift-controller-manager-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.750073733Z namespaces/openshift-controller-manager-operator/openshift-controller-manager-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.750142205Z namespaces/openshift-controller-manager-operator/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.750169055Z namespaces/openshift-controller-manager-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.750230576Z namespaces/openshift-controller-manager-operator/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.750258707Z namespaces/openshift-controller-manager-operator/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.750432221Z namespaces/openshift-controller-manager-operator/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.750516253Z namespaces/openshift-controller-manager-operator/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.750592114Z namespaces/openshift-controller-manager-operator/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.750633155Z namespaces/openshift-controller-manager-operator/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.750681546Z namespaces/openshift-controller-manager-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.750744508Z namespaces/openshift-controller-manager-operator/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.750796209Z namespaces/openshift-controller-manager-operator/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.75087551Z namespaces/openshift-controller-manager-operator/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.750944712Z namespaces/openshift-controller-manager-operator/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.750992193Z namespaces/openshift-controller-manager-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.751073885Z namespaces/openshift-controller-manager-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.75128491Z namespaces/openshift-controller-manager-operator/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.75133224Z namespaces/openshift-controller-manager-operator/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.751454903Z namespaces/openshift-controller-manager-operator/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.751537135Z namespaces/openshift-controller-manager-operator/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.751621767Z namespaces/openshift-controller-manager-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.751703309Z namespaces/openshift-controller-manager-operator/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.751788091Z namespaces/openshift-controller-manager-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.751913944Z namespaces/openshift-controller-manager-operator/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.752086717Z namespaces/openshift-controller-manager-operator/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.752140669Z namespaces/openshift-controller-manager-operator/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.752180339Z namespaces/openshift-controller-manager-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.752241681Z namespaces/openshift-controller-manager-operator/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.752309802Z namespaces/openshift-controller-manager-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.752397404Z namespaces/openshift-controller-manager-operator/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.752412935Z namespaces/openshift-controller-manager-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.752523067Z namespaces/openshift-controller-manager-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.752599459Z namespaces/openshift-controller-manager-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.752636909Z namespaces/openshift-controller-manager-operator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.75267308Z namespaces/openshift-controller-manager-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.752725021Z namespaces/openshift-controller-manager-operator/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.752755372Z namespaces/openshift-controller-manager-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.752819453Z namespaces/openshift-controller-manager-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.752828774Z namespaces/openshift-controller-manager-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.752843534Z namespaces/openshift-controller-manager-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.753014888Z namespaces/openshift-controller-manager-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.753194872Z namespaces/openshift-controller-manager-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.753354345Z namespaces/openshift-controller-manager-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.75355998Z namespaces/openshift-controller-manager-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.753764814Z namespaces/openshift-controller-manager-operator/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.753786335Z namespaces/openshift-controller-manager-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.753856596Z namespaces/openshift-controller-manager-operator/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.753872527Z namespaces/openshift-controller-manager-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.753981119Z namespaces/openshift-controller-manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.75401896Z namespaces/openshift-controller-manager/openshift-controller-manager.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.754058351Z namespaces/openshift-controller-manager/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.754120122Z namespaces/openshift-controller-manager/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.754162193Z namespaces/openshift-controller-manager/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.754196864Z namespaces/openshift-controller-manager/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.754294426Z namespaces/openshift-controller-manager/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.754398448Z namespaces/openshift-controller-manager/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.75447678Z namespaces/openshift-controller-manager/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.754643424Z namespaces/openshift-controller-manager/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.754664874Z namespaces/openshift-controller-manager/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.754750076Z namespaces/openshift-controller-manager/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.754767486Z namespaces/openshift-controller-manager/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.754876279Z namespaces/openshift-controller-manager/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.754896379Z namespaces/openshift-controller-manager/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.754955871Z namespaces/openshift-controller-manager/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.755038932Z namespaces/openshift-controller-manager/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.755077213Z namespaces/openshift-controller-manager/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.755129204Z namespaces/openshift-controller-manager/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.755168605Z namespaces/openshift-controller-manager/coordination.k8s.io/leases/openshift-master-controllers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.755258377Z namespaces/openshift-controller-manager/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.755309288Z namespaces/openshift-controller-manager/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.755416821Z namespaces/openshift-controller-manager/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.755501712Z namespaces/openshift-controller-manager/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.755591334Z namespaces/openshift-controller-manager/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.755675236Z namespaces/openshift-controller-manager/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.755753628Z namespaces/openshift-controller-manager/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.755889671Z namespaces/openshift-controller-manager/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.756059575Z namespaces/openshift-controller-manager/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.756158167Z namespaces/openshift-controller-manager/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.756195828Z namespaces/openshift-controller-manager/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.756252519Z namespaces/openshift-controller-manager/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.75631413Z namespaces/openshift-controller-manager/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.756364882Z namespaces/openshift-controller-manager/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.756405412Z namespaces/openshift-controller-manager/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.756490444Z namespaces/openshift-controller-manager/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.756574226Z namespaces/openshift-controller-manager/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.756674698Z namespaces/openshift-controller-manager/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.756713579Z namespaces/openshift-controller-manager/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.75675241Z namespaces/openshift-controller-manager/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.756788511Z namespaces/openshift-controller-manager/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.756830082Z namespaces/openshift-controller-manager/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.756837892Z namespaces/openshift-controller-manager/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.756895713Z namespaces/openshift-controller-manager/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.757048647Z namespaces/openshift-controller-manager/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.757239811Z namespaces/openshift-controller-manager/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.757469346Z namespaces/openshift-controller-manager/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.75767297Z namespaces/openshift-controller-manager/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.757891745Z namespaces/openshift-controller-manager/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.757903445Z namespaces/openshift-controller-manager/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.757955206Z namespaces/openshift-controller-manager/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.758004128Z namespaces/openshift-controller-manager/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.758091369Z namespaces/openshift-dns-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.758140481Z namespaces/openshift-dns-operator/openshift-dns-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.758347005Z namespaces/openshift-dns-operator/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.758373296Z namespaces/openshift-dns-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.758459488Z namespaces/openshift-dns-operator/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.758474108Z namespaces/openshift-dns-operator/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.758586911Z namespaces/openshift-dns-operator/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.758661732Z namespaces/openshift-dns-operator/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.758741574Z namespaces/openshift-dns-operator/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.758793755Z namespaces/openshift-dns-operator/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.758829466Z namespaces/openshift-dns-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.758874627Z namespaces/openshift-dns-operator/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.758909288Z namespaces/openshift-dns-operator/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.75900641Z namespaces/openshift-dns-operator/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.759065851Z namespaces/openshift-dns-operator/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.759107612Z namespaces/openshift-dns-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.759194344Z namespaces/openshift-dns-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.759284586Z namespaces/openshift-dns-operator/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.759327347Z namespaces/openshift-dns-operator/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.759435149Z namespaces/openshift-dns-operator/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.759519631Z namespaces/openshift-dns-operator/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.759612723Z namespaces/openshift-dns-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.759694495Z namespaces/openshift-dns-operator/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.759782067Z namespaces/openshift-dns-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.759902169Z namespaces/openshift-dns-operator/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.760075103Z namespaces/openshift-dns-operator/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.760150485Z namespaces/openshift-dns-operator/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.760188046Z namespaces/openshift-dns-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.760292838Z namespaces/openshift-dns-operator/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.760316118Z namespaces/openshift-dns-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.76039444Z namespaces/openshift-dns-operator/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.760412561Z namespaces/openshift-dns-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.760523463Z namespaces/openshift-dns-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.760604995Z namespaces/openshift-dns-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.760656786Z namespaces/openshift-dns-operator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.760696907Z namespaces/openshift-dns-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.760748508Z namespaces/openshift-dns-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.760782799Z namespaces/openshift-dns-operator/monitoring.coreos.com/prometheusrules/dns.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.760857781Z namespaces/openshift-dns-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.760880341Z namespaces/openshift-dns-operator/monitoring.coreos.com/servicemonitors/dns-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.760951892Z namespaces/openshift-dns-operator/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.760969073Z namespaces/openshift-dns-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.761046595Z namespaces/openshift-dns-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.761056455Z namespaces/openshift-dns-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.761068125Z namespaces/openshift-dns-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.761251289Z namespaces/openshift-dns-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.761461614Z namespaces/openshift-dns-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.761600977Z namespaces/openshift-dns-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.761826242Z namespaces/openshift-dns-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.762104748Z namespaces/openshift-dns-operator/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.762140429Z namespaces/openshift-dns-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.76221109Z namespaces/openshift-dns-operator/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.762247211Z namespaces/openshift-dns-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.762364644Z namespaces/openshift-dns/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.762419145Z namespaces/openshift-dns/openshift-dns.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.762480846Z namespaces/openshift-dns/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.762511777Z namespaces/openshift-dns/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.763286934Z namespaces/openshift-dns/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.763367916Z namespaces/openshift-dns/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.763521599Z namespaces/openshift-dns/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.763605301Z namespaces/openshift-dns/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.763688693Z namespaces/openshift-dns/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.763729214Z namespaces/openshift-dns/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.763767234Z namespaces/openshift-dns/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.763828346Z namespaces/openshift-dns/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.763867807Z namespaces/openshift-dns/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.763955499Z namespaces/openshift-dns/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.76401656Z namespaces/openshift-dns/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.764067441Z namespaces/openshift-dns/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.764144083Z namespaces/openshift-dns/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.764214554Z namespaces/openshift-dns/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.764256645Z namespaces/openshift-dns/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.764391118Z namespaces/openshift-dns/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.76447976Z namespaces/openshift-dns/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.764702745Z namespaces/openshift-dns/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.764796267Z namespaces/openshift-dns/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.765061483Z namespaces/openshift-dns/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.765179906Z namespaces/openshift-dns/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.765464752Z namespaces/openshift-dns/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.765536674Z namespaces/openshift-dns/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.765586325Z namespaces/openshift-dns/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.765653496Z namespaces/openshift-dns/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.765693477Z namespaces/openshift-dns/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.765774399Z namespaces/openshift-dns/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.76580545Z namespaces/openshift-dns/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.765900052Z namespaces/openshift-dns/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.765979563Z namespaces/openshift-dns/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.766048185Z namespaces/openshift-dns/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.766103706Z namespaces/openshift-dns/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.766146677Z namespaces/openshift-dns/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.766178738Z namespaces/openshift-dns/monitoring.coreos.com/servicemonitors/dns-default.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.766241039Z namespaces/openshift-dns/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.76629552Z namespaces/openshift-dns/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.766350742Z namespaces/openshift-dns/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.766362742Z namespaces/openshift-dns/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.766374282Z namespaces/openshift-dns/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.766541946Z namespaces/openshift-dns/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.76672225Z namespaces/openshift-dns/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.766861413Z namespaces/openshift-dns/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.767064557Z namespaces/openshift-dns/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.767324773Z namespaces/openshift-dns/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.767337483Z namespaces/openshift-dns/pods/dns-default-b2gwz/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.767396195Z namespaces/openshift-dns/pods/dns-default-b2gwz/dns-default-b2gwz.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.767488097Z namespaces/openshift-dns/pods/dns-default-b2gwz/dns/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.767495937Z namespaces/openshift-dns/pods/dns-default-b2gwz/dns/dns/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.767502937Z namespaces/openshift-dns/pods/dns-default-b2gwz/dns/dns/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.767579079Z namespaces/openshift-dns/pods/dns-default-b2gwz/dns/dns/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.767694621Z namespaces/openshift-dns/pods/dns-default-b2gwz/dns/dns/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.767761603Z namespaces/openshift-dns/pods/dns-default-b2gwz/dns/dns/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.767810484Z namespaces/openshift-dns/pods/dns-default-b2gwz/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.767826074Z namespaces/openshift-dns/pods/dns-default-b2gwz/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.767833034Z namespaces/openshift-dns/pods/dns-default-b2gwz/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.767876405Z namespaces/openshift-dns/pods/dns-default-b2gwz/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.767974827Z namespaces/openshift-dns/pods/dns-default-b2gwz/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.768058079Z namespaces/openshift-dns/pods/dns-default-b2gwz/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.76809048Z namespaces/openshift-dns/pods/dns-default-gc54s/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.768136071Z namespaces/openshift-dns/pods/dns-default-gc54s/dns-default-gc54s.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.768288754Z namespaces/openshift-dns/pods/dns-default-gc54s/dns/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.768302334Z namespaces/openshift-dns/pods/dns-default-gc54s/dns/dns/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.768314045Z namespaces/openshift-dns/pods/dns-default-gc54s/dns/dns/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.768359726Z namespaces/openshift-dns/pods/dns-default-gc54s/dns/dns/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.768451508Z namespaces/openshift-dns/pods/dns-default-gc54s/dns/dns/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.768522299Z namespaces/openshift-dns/pods/dns-default-gc54s/dns/dns/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.76856733Z namespaces/openshift-dns/pods/dns-default-gc54s/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.76857524Z namespaces/openshift-dns/pods/dns-default-gc54s/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.768586181Z namespaces/openshift-dns/pods/dns-default-gc54s/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.768634552Z namespaces/openshift-dns/pods/dns-default-gc54s/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.768724844Z namespaces/openshift-dns/pods/dns-default-gc54s/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.768796325Z namespaces/openshift-dns/pods/dns-default-gc54s/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.768857857Z namespaces/openshift-dns/pods/dns-default-zt2s9/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.768902638Z namespaces/openshift-dns/pods/dns-default-zt2s9/dns-default-zt2s9.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.768988009Z namespaces/openshift-dns/pods/dns-default-zt2s9/dns/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.76899787Z namespaces/openshift-dns/pods/dns-default-zt2s9/dns/dns/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.76900358Z namespaces/openshift-dns/pods/dns-default-zt2s9/dns/dns/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.769046001Z namespaces/openshift-dns/pods/dns-default-zt2s9/dns/dns/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.769146823Z namespaces/openshift-dns/pods/dns-default-zt2s9/dns/dns/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.769216665Z namespaces/openshift-dns/pods/dns-default-zt2s9/dns/dns/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.769247065Z namespaces/openshift-dns/pods/dns-default-zt2s9/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.769251695Z namespaces/openshift-dns/pods/dns-default-zt2s9/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.769285946Z namespaces/openshift-dns/pods/dns-default-zt2s9/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.769355068Z namespaces/openshift-dns/pods/dns-default-zt2s9/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.76943895Z namespaces/openshift-dns/pods/dns-default-zt2s9/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.769511901Z namespaces/openshift-dns/pods/dns-default-zt2s9/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.769552302Z namespaces/openshift-dns/pods/node-resolver-82jsv/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.769591013Z namespaces/openshift-dns/pods/node-resolver-82jsv/node-resolver-82jsv.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.769682935Z namespaces/openshift-dns/pods/node-resolver-82jsv/dns-node-resolver/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.769693605Z namespaces/openshift-dns/pods/node-resolver-82jsv/dns-node-resolver/dns-node-resolver/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.769698935Z namespaces/openshift-dns/pods/node-resolver-82jsv/dns-node-resolver/dns-node-resolver/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.769753366Z namespaces/openshift-dns/pods/node-resolver-82jsv/dns-node-resolver/dns-node-resolver/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.769842068Z namespaces/openshift-dns/pods/node-resolver-82jsv/dns-node-resolver/dns-node-resolver/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.76991272Z namespaces/openshift-dns/pods/node-resolver-82jsv/dns-node-resolver/dns-node-resolver/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.769956101Z namespaces/openshift-dns/pods/node-resolver-8kwh5/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.770009852Z namespaces/openshift-dns/pods/node-resolver-8kwh5/node-resolver-8kwh5.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.770107764Z namespaces/openshift-dns/pods/node-resolver-8kwh5/dns-node-resolver/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.770118354Z namespaces/openshift-dns/pods/node-resolver-8kwh5/dns-node-resolver/dns-node-resolver/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.770125735Z namespaces/openshift-dns/pods/node-resolver-8kwh5/dns-node-resolver/dns-node-resolver/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.770155185Z namespaces/openshift-dns/pods/node-resolver-8kwh5/dns-node-resolver/dns-node-resolver/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.770251357Z namespaces/openshift-dns/pods/node-resolver-8kwh5/dns-node-resolver/dns-node-resolver/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.770335519Z namespaces/openshift-dns/pods/node-resolver-8kwh5/dns-node-resolver/dns-node-resolver/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.7703578Z namespaces/openshift-dns/pods/node-resolver-qpt8z/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.770410531Z namespaces/openshift-dns/pods/node-resolver-qpt8z/node-resolver-qpt8z.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.770492563Z namespaces/openshift-dns/pods/node-resolver-qpt8z/dns-node-resolver/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.770502833Z namespaces/openshift-dns/pods/node-resolver-qpt8z/dns-node-resolver/dns-node-resolver/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.770508133Z namespaces/openshift-dns/pods/node-resolver-qpt8z/dns-node-resolver/dns-node-resolver/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.770531504Z namespaces/openshift-dns/pods/node-resolver-qpt8z/dns-node-resolver/dns-node-resolver/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.770621466Z namespaces/openshift-dns/pods/node-resolver-qpt8z/dns-node-resolver/dns-node-resolver/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.770689477Z namespaces/openshift-dns/pods/node-resolver-qpt8z/dns-node-resolver/dns-node-resolver/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.770718858Z namespaces/openshift-dns/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.770755139Z namespaces/openshift-dns/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.77080938Z namespaces/openshift-dns/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.770853221Z namespaces/openshift-dns/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.770949393Z namespaces/openshift-etcd/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.771011204Z namespaces/openshift-etcd/openshift-etcd.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.771052595Z namespaces/openshift-etcd/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.771103706Z namespaces/openshift-etcd/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.771162068Z namespaces/openshift-etcd/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.771202328Z namespaces/openshift-etcd/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.771312771Z namespaces/openshift-etcd/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.771395563Z namespaces/openshift-etcd/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.771477764Z namespaces/openshift-etcd/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.771516775Z namespaces/openshift-etcd/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.771566057Z namespaces/openshift-etcd/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.771614738Z namespaces/openshift-etcd/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.771656328Z namespaces/openshift-etcd/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.77173892Z namespaces/openshift-etcd/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.771797282Z namespaces/openshift-etcd/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.771838412Z namespaces/openshift-etcd/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.771921414Z namespaces/openshift-etcd/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.771997946Z namespaces/openshift-etcd/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.772036397Z namespaces/openshift-etcd/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.772144829Z namespaces/openshift-etcd/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.772224251Z namespaces/openshift-etcd/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.772327563Z namespaces/openshift-etcd/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.772410055Z namespaces/openshift-etcd/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.772494557Z namespaces/openshift-etcd/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.772614609Z namespaces/openshift-etcd/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.772771223Z namespaces/openshift-etcd/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.772833474Z namespaces/openshift-etcd/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.772882815Z namespaces/openshift-etcd/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.772933287Z namespaces/openshift-etcd/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.772977588Z namespaces/openshift-etcd/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.773028099Z namespaces/openshift-etcd/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.773066999Z namespaces/openshift-etcd/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.773153181Z namespaces/openshift-etcd/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.773233903Z namespaces/openshift-etcd/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.773401167Z namespaces/openshift-etcd/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.773434678Z namespaces/openshift-etcd/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.773499199Z namespaces/openshift-etcd/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.77352809Z namespaces/openshift-etcd/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.773586711Z namespaces/openshift-etcd/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.773611542Z namespaces/openshift-etcd/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.773648252Z namespaces/openshift-etcd/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.773831026Z namespaces/openshift-etcd/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.77402196Z namespaces/openshift-etcd/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.774168544Z namespaces/openshift-etcd/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.774380758Z namespaces/openshift-etcd/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.774586823Z namespaces/openshift-etcd/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.774623194Z namespaces/openshift-etcd/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.774683995Z namespaces/openshift-etcd/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.774729316Z namespaces/openshift-etcd/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.774828638Z namespaces/openshift-host-network/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.774860919Z namespaces/openshift-host-network/openshift-host-network.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.774940611Z namespaces/openshift-host-network/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.774977012Z namespaces/openshift-host-network/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.775051153Z namespaces/openshift-host-network/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.775077124Z namespaces/openshift-host-network/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.775172136Z namespaces/openshift-host-network/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.775280068Z namespaces/openshift-host-network/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.77536479Z namespaces/openshift-host-network/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.775415691Z namespaces/openshift-host-network/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.775469152Z namespaces/openshift-host-network/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.775524954Z namespaces/openshift-host-network/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.775569075Z namespaces/openshift-host-network/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.775653156Z namespaces/openshift-host-network/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.775711518Z namespaces/openshift-host-network/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.775764209Z namespaces/openshift-host-network/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.775861791Z namespaces/openshift-host-network/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.775933033Z namespaces/openshift-host-network/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.775969823Z namespaces/openshift-host-network/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.776076536Z namespaces/openshift-host-network/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.776174518Z namespaces/openshift-host-network/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.77625508Z namespaces/openshift-host-network/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.776361382Z namespaces/openshift-host-network/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.776435984Z namespaces/openshift-host-network/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.776585487Z namespaces/openshift-host-network/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.776688459Z namespaces/openshift-host-network/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.77672731Z namespaces/openshift-host-network/core/resourcequotas/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.776785572Z namespaces/openshift-host-network/core/resourcequotas/host-network-namespace-quotas.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.776845003Z namespaces/openshift-host-network/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.776897154Z namespaces/openshift-host-network/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.776955775Z namespaces/openshift-host-network/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.776999026Z namespaces/openshift-host-network/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.777064708Z namespaces/openshift-host-network/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.777113159Z namespaces/openshift-host-network/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.777194561Z namespaces/openshift-host-network/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.777279882Z namespaces/openshift-host-network/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.777345714Z namespaces/openshift-host-network/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.777391545Z namespaces/openshift-host-network/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.777439196Z namespaces/openshift-host-network/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.777484047Z namespaces/openshift-host-network/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.777530678Z namespaces/openshift-host-network/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.777543628Z namespaces/openshift-host-network/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.777598229Z namespaces/openshift-host-network/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.777763603Z namespaces/openshift-host-network/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.778042119Z namespaces/openshift-host-network/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.778191223Z namespaces/openshift-host-network/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.778411727Z namespaces/openshift-host-network/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.778610492Z namespaces/openshift-host-network/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.778641552Z namespaces/openshift-host-network/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.778706294Z namespaces/openshift-host-network/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.778735224Z namespaces/openshift-host-network/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.778826966Z namespaces/openshift-image-registry/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.778875518Z namespaces/openshift-image-registry/openshift-image-registry.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.778943149Z namespaces/openshift-image-registry/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.77897144Z namespaces/openshift-image-registry/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.779030821Z namespaces/openshift-image-registry/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.779060351Z namespaces/openshift-image-registry/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.779180834Z namespaces/openshift-image-registry/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.779350678Z namespaces/openshift-image-registry/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.779541462Z namespaces/openshift-image-registry/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.779587543Z namespaces/openshift-image-registry/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.779618864Z namespaces/openshift-image-registry/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.779677045Z namespaces/openshift-image-registry/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.779730096Z namespaces/openshift-image-registry/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.779837029Z namespaces/openshift-image-registry/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.77990966Z namespaces/openshift-image-registry/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.779942231Z namespaces/openshift-image-registry/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.780036133Z namespaces/openshift-image-registry/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.780092354Z namespaces/openshift-image-registry/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.780100154Z namespaces/openshift-image-registry/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.780150015Z namespaces/openshift-image-registry/coordination.k8s.io/leases/openshift-master-controllers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.780224687Z namespaces/openshift-image-registry/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.780258998Z namespaces/openshift-image-registry/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.781196489Z namespaces/openshift-image-registry/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.781465155Z namespaces/openshift-image-registry/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.781750681Z namespaces/openshift-image-registry/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.781834373Z namespaces/openshift-image-registry/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.782045367Z namespaces/openshift-image-registry/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.78216982Z namespaces/openshift-image-registry/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.782378725Z namespaces/openshift-image-registry/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.782440756Z namespaces/openshift-image-registry/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.782480087Z namespaces/openshift-image-registry/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.782544878Z namespaces/openshift-image-registry/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.782583959Z namespaces/openshift-image-registry/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.782642961Z namespaces/openshift-image-registry/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.782687131Z namespaces/openshift-image-registry/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.782810454Z namespaces/openshift-image-registry/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.782899296Z namespaces/openshift-image-registry/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.782964477Z namespaces/openshift-image-registry/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.783014489Z namespaces/openshift-image-registry/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.78309044Z namespaces/openshift-image-registry/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.783161322Z namespaces/openshift-image-registry/monitoring.coreos.com/prometheusrules/image-registry-operator-alerts.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.783283204Z namespaces/openshift-image-registry/monitoring.coreos.com/prometheusrules/image-registry-rules.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.783381997Z namespaces/openshift-image-registry/monitoring.coreos.com/prometheusrules/imagestreams-rules.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.783451908Z namespaces/openshift-image-registry/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.783492499Z namespaces/openshift-image-registry/monitoring.coreos.com/servicemonitors/image-registry.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.78355333Z namespaces/openshift-image-registry/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.783582861Z namespaces/openshift-image-registry/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.783644772Z namespaces/openshift-image-registry/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.783656193Z namespaces/openshift-image-registry/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.783713284Z namespaces/openshift-image-registry/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.783877188Z namespaces/openshift-image-registry/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.784069802Z namespaces/openshift-image-registry/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.784217995Z namespaces/openshift-image-registry/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.78444072Z namespaces/openshift-image-registry/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.784635634Z namespaces/openshift-image-registry/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.784642794Z namespaces/openshift-image-registry/pods/image-registry-7775456cb8-9znrq/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.784669315Z namespaces/openshift-image-registry/pods/image-registry-7775456cb8-9znrq/image-registry-7775456cb8-9znrq.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.784794078Z namespaces/openshift-image-registry/pods/image-registry-7775456cb8-9znrq/registry/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.784801008Z namespaces/openshift-image-registry/pods/image-registry-7775456cb8-9znrq/registry/registry/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.784807338Z namespaces/openshift-image-registry/pods/image-registry-7775456cb8-9znrq/registry/registry/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.784859629Z namespaces/openshift-image-registry/pods/image-registry-7775456cb8-9znrq/registry/registry/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.786677689Z namespaces/openshift-image-registry/pods/image-registry-7775456cb8-9znrq/registry/registry/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.786752451Z namespaces/openshift-image-registry/pods/image-registry-7775456cb8-9znrq/registry/registry/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.786772132Z namespaces/openshift-image-registry/pods/node-ca-ft4xk/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.786833253Z namespaces/openshift-image-registry/pods/node-ca-ft4xk/node-ca-ft4xk.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.786909924Z namespaces/openshift-image-registry/pods/node-ca-ft4xk/node-ca/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.786920775Z namespaces/openshift-image-registry/pods/node-ca-ft4xk/node-ca/node-ca/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.786930115Z namespaces/openshift-image-registry/pods/node-ca-ft4xk/node-ca/node-ca/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.786954496Z namespaces/openshift-image-registry/pods/node-ca-ft4xk/node-ca/node-ca/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.787119279Z namespaces/openshift-image-registry/pods/node-ca-ft4xk/node-ca/node-ca/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.787191551Z namespaces/openshift-image-registry/pods/node-ca-ft4xk/node-ca/node-ca/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.787209011Z namespaces/openshift-image-registry/pods/node-ca-jdz76/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.787279153Z namespaces/openshift-image-registry/pods/node-ca-jdz76/node-ca-jdz76.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.787365014Z namespaces/openshift-image-registry/pods/node-ca-jdz76/node-ca/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.787376395Z namespaces/openshift-image-registry/pods/node-ca-jdz76/node-ca/node-ca/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.787386245Z namespaces/openshift-image-registry/pods/node-ca-jdz76/node-ca/node-ca/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.787438556Z namespaces/openshift-image-registry/pods/node-ca-jdz76/node-ca/node-ca/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.78760447Z namespaces/openshift-image-registry/pods/node-ca-jdz76/node-ca/node-ca/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.787669311Z namespaces/openshift-image-registry/pods/node-ca-jdz76/node-ca/node-ca/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.787691062Z namespaces/openshift-image-registry/pods/node-ca-wn8fk/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.787744943Z namespaces/openshift-image-registry/pods/node-ca-wn8fk/node-ca-wn8fk.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.787817715Z namespaces/openshift-image-registry/pods/node-ca-wn8fk/node-ca/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.787826265Z namespaces/openshift-image-registry/pods/node-ca-wn8fk/node-ca/node-ca/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.787837605Z namespaces/openshift-image-registry/pods/node-ca-wn8fk/node-ca/node-ca/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.787899716Z namespaces/openshift-image-registry/pods/node-ca-wn8fk/node-ca/node-ca/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.78805119Z namespaces/openshift-image-registry/pods/node-ca-wn8fk/node-ca/node-ca/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.788119821Z namespaces/openshift-image-registry/pods/node-ca-wn8fk/node-ca/node-ca/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.788149972Z namespaces/openshift-image-registry/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.788184643Z namespaces/openshift-image-registry/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.788257384Z namespaces/openshift-image-registry/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.788302905Z namespaces/openshift-image-registry/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.788368987Z namespaces/openshift-infra/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.788379547Z namespaces/openshift-infra/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.788384647Z namespaces/openshift-infra/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.788395027Z namespaces/openshift-infra/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.788562151Z namespaces/openshift-infra/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.788744875Z namespaces/openshift-infra/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.788907148Z namespaces/openshift-infra/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.789121743Z namespaces/openshift-infra/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.78944299Z namespaces/openshift-ingress-canary/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.789498301Z namespaces/openshift-ingress-canary/openshift-ingress-canary.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.789568593Z namespaces/openshift-ingress-canary/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.789592103Z namespaces/openshift-ingress-canary/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.789682156Z namespaces/openshift-ingress-canary/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.789701566Z namespaces/openshift-ingress-canary/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.789845679Z namespaces/openshift-ingress-canary/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.789924991Z namespaces/openshift-ingress-canary/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.790007453Z namespaces/openshift-ingress-canary/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.790061864Z namespaces/openshift-ingress-canary/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.790094135Z namespaces/openshift-ingress-canary/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.790171336Z namespaces/openshift-ingress-canary/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.790212617Z namespaces/openshift-ingress-canary/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.79031843Z namespaces/openshift-ingress-canary/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.79034296Z namespaces/openshift-ingress-canary/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.790406132Z namespaces/openshift-ingress-canary/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.790486323Z namespaces/openshift-ingress-canary/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.790569515Z namespaces/openshift-ingress-canary/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.790601706Z namespaces/openshift-ingress-canary/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.790727339Z namespaces/openshift-ingress-canary/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.79081411Z namespaces/openshift-ingress-canary/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.790970944Z namespaces/openshift-ingress-canary/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.791051086Z namespaces/openshift-ingress-canary/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.791224339Z namespaces/openshift-ingress-canary/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.791357262Z namespaces/openshift-ingress-canary/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.791553527Z namespaces/openshift-ingress-canary/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.791611718Z namespaces/openshift-ingress-canary/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.791648089Z namespaces/openshift-ingress-canary/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.79171174Z namespaces/openshift-ingress-canary/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.791743041Z namespaces/openshift-ingress-canary/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.791826673Z namespaces/openshift-ingress-canary/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.791877204Z namespaces/openshift-ingress-canary/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.791958036Z namespaces/openshift-ingress-canary/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.792044258Z namespaces/openshift-ingress-canary/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.792081478Z namespaces/openshift-ingress-canary/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.7921345Z namespaces/openshift-ingress-canary/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.792172231Z namespaces/openshift-ingress-canary/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.792208551Z namespaces/openshift-ingress-canary/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.792288893Z namespaces/openshift-ingress-canary/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.792313804Z namespaces/openshift-ingress-canary/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.792350375Z namespaces/openshift-ingress-canary/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.792509808Z namespaces/openshift-ingress-canary/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.792695392Z namespaces/openshift-ingress-canary/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.792827155Z namespaces/openshift-ingress-canary/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.793027509Z namespaces/openshift-ingress-canary/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.793395637Z namespaces/openshift-ingress-canary/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.793410128Z namespaces/openshift-ingress-canary/pods/ingress-canary-4srdt/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.793449968Z namespaces/openshift-ingress-canary/pods/ingress-canary-4srdt/ingress-canary-4srdt.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.793544991Z namespaces/openshift-ingress-canary/pods/ingress-canary-4srdt/serve-healthcheck-canary/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.793555861Z namespaces/openshift-ingress-canary/pods/ingress-canary-4srdt/serve-healthcheck-canary/serve-healthcheck-canary/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.793563491Z namespaces/openshift-ingress-canary/pods/ingress-canary-4srdt/serve-healthcheck-canary/serve-healthcheck-canary/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.793598512Z namespaces/openshift-ingress-canary/pods/ingress-canary-4srdt/serve-healthcheck-canary/serve-healthcheck-canary/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.793705814Z namespaces/openshift-ingress-canary/pods/ingress-canary-4srdt/serve-healthcheck-canary/serve-healthcheck-canary/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.793816437Z namespaces/openshift-ingress-canary/pods/ingress-canary-4srdt/serve-healthcheck-canary/serve-healthcheck-canary/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.793833517Z namespaces/openshift-ingress-canary/pods/ingress-canary-9gflx/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.793886518Z namespaces/openshift-ingress-canary/pods/ingress-canary-9gflx/ingress-canary-9gflx.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.79395824Z namespaces/openshift-ingress-canary/pods/ingress-canary-9gflx/serve-healthcheck-canary/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.7939687Z namespaces/openshift-ingress-canary/pods/ingress-canary-9gflx/serve-healthcheck-canary/serve-healthcheck-canary/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.79397676Z namespaces/openshift-ingress-canary/pods/ingress-canary-9gflx/serve-healthcheck-canary/serve-healthcheck-canary/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.794028221Z namespaces/openshift-ingress-canary/pods/ingress-canary-9gflx/serve-healthcheck-canary/serve-healthcheck-canary/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.794132943Z namespaces/openshift-ingress-canary/pods/ingress-canary-9gflx/serve-healthcheck-canary/serve-healthcheck-canary/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.794212565Z namespaces/openshift-ingress-canary/pods/ingress-canary-9gflx/serve-healthcheck-canary/serve-healthcheck-canary/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.794535132Z namespaces/openshift-ingress-canary/pods/ingress-canary-qgpt5/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.794561253Z namespaces/openshift-ingress-canary/pods/ingress-canary-qgpt5/ingress-canary-qgpt5.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.794666305Z namespaces/openshift-ingress-canary/pods/ingress-canary-qgpt5/serve-healthcheck-canary/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.794681716Z namespaces/openshift-ingress-canary/pods/ingress-canary-qgpt5/serve-healthcheck-canary/serve-healthcheck-canary/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.794687836Z namespaces/openshift-ingress-canary/pods/ingress-canary-qgpt5/serve-healthcheck-canary/serve-healthcheck-canary/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.794723797Z namespaces/openshift-ingress-canary/pods/ingress-canary-qgpt5/serve-healthcheck-canary/serve-healthcheck-canary/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.794832569Z namespaces/openshift-ingress-canary/pods/ingress-canary-qgpt5/serve-healthcheck-canary/serve-healthcheck-canary/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.79490186Z namespaces/openshift-ingress-canary/pods/ingress-canary-qgpt5/serve-healthcheck-canary/serve-healthcheck-canary/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.794953942Z namespaces/openshift-ingress-canary/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.794997703Z namespaces/openshift-ingress-canary/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.795033214Z namespaces/openshift-ingress-canary/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.795068944Z namespaces/openshift-ingress-canary/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.795192737Z namespaces/openshift-ingress-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.795229568Z namespaces/openshift-ingress-operator/openshift-ingress-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.7953256Z namespaces/openshift-ingress-operator/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.795359931Z namespaces/openshift-ingress-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.795439572Z namespaces/openshift-ingress-operator/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.795480873Z namespaces/openshift-ingress-operator/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.795570065Z namespaces/openshift-ingress-operator/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.795653027Z namespaces/openshift-ingress-operator/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.795737109Z namespaces/openshift-ingress-operator/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.79578108Z namespaces/openshift-ingress-operator/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.795819741Z namespaces/openshift-ingress-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.795893642Z namespaces/openshift-ingress-operator/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.795917603Z namespaces/openshift-ingress-operator/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.796016655Z namespaces/openshift-ingress-operator/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.796071956Z namespaces/openshift-ingress-operator/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.796119817Z namespaces/openshift-ingress-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.796200749Z namespaces/openshift-ingress-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.796286331Z namespaces/openshift-ingress-operator/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.796340162Z namespaces/openshift-ingress-operator/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.79714356Z namespaces/openshift-ingress-operator/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.797225882Z namespaces/openshift-ingress-operator/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.797422076Z namespaces/openshift-ingress-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.797522418Z namespaces/openshift-ingress-operator/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.79759908Z namespaces/openshift-ingress-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.797786494Z namespaces/openshift-ingress-operator/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.798026009Z namespaces/openshift-ingress-operator/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.798106201Z namespaces/openshift-ingress-operator/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.798156152Z namespaces/openshift-ingress-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.798227604Z namespaces/openshift-ingress-operator/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.798245544Z namespaces/openshift-ingress-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.798351816Z namespaces/openshift-ingress-operator/ingress.operator.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.798366887Z namespaces/openshift-ingress-operator/ingress.operator.openshift.io/dnsrecords/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.798377327Z namespaces/openshift-ingress-operator/ingress.operator.openshift.io/dnsrecords/default-wildcard.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.798480459Z namespaces/openshift-ingress-operator/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.79850009Z namespaces/openshift-ingress-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.798603862Z namespaces/openshift-ingress-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.798685464Z namespaces/openshift-ingress-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.798725715Z namespaces/openshift-ingress-operator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.798764686Z namespaces/openshift-ingress-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.798840707Z namespaces/openshift-ingress-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.798887588Z namespaces/openshift-ingress-operator/monitoring.coreos.com/prometheusrules/ingress-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.79897901Z namespaces/openshift-ingress-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.798995581Z namespaces/openshift-ingress-operator/monitoring.coreos.com/servicemonitors/ingress-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.799070492Z namespaces/openshift-ingress-operator/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.799114173Z namespaces/openshift-ingress-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.799163785Z namespaces/openshift-ingress-operator/operator.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.799170734Z namespaces/openshift-ingress-operator/operator.openshift.io/ingresscontrollers/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.799216916Z namespaces/openshift-ingress-operator/operator.openshift.io/ingresscontrollers/default.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.799329798Z namespaces/openshift-ingress-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.799344108Z namespaces/openshift-ingress-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.799373449Z namespaces/openshift-ingress-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.799541723Z namespaces/openshift-ingress-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.799719987Z namespaces/openshift-ingress-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.79985887Z namespaces/openshift-ingress-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.800114546Z namespaces/openshift-ingress-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.80033246Z namespaces/openshift-ingress-operator/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.800354631Z namespaces/openshift-ingress-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.800424282Z namespaces/openshift-ingress-operator/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.800448523Z namespaces/openshift-ingress-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.800567665Z namespaces/openshift-ingress/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.800600126Z namespaces/openshift-ingress/openshift-ingress.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.800680468Z namespaces/openshift-ingress/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.800699268Z namespaces/openshift-ingress/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.80079733Z namespaces/openshift-ingress/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.800835801Z namespaces/openshift-ingress/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.800928313Z namespaces/openshift-ingress/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.801155288Z namespaces/openshift-ingress/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.801393083Z namespaces/openshift-ingress/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.801428444Z namespaces/openshift-ingress/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.801477985Z namespaces/openshift-ingress/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.801556317Z namespaces/openshift-ingress/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.801582738Z namespaces/openshift-ingress/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.80167029Z namespaces/openshift-ingress/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.801742521Z namespaces/openshift-ingress/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.801785782Z namespaces/openshift-ingress/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.801871824Z namespaces/openshift-ingress/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.801909045Z namespaces/openshift-ingress/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.801918075Z namespaces/openshift-ingress/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.801987387Z namespaces/openshift-ingress/coordination.k8s.io/leases/istio-gateway-ca-openshift-gateway.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.802071498Z namespaces/openshift-ingress/coordination.k8s.io/leases/istio-gateway-deployment-openshift-gateway.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.80216128Z namespaces/openshift-ingress/coordination.k8s.io/leases/istio-gateway-status-leader-openshift-gateway.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.802292573Z namespaces/openshift-ingress/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.802311144Z namespaces/openshift-ingress/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.802729763Z namespaces/openshift-ingress/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.802832875Z namespaces/openshift-ingress/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.80304835Z namespaces/openshift-ingress/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.803125882Z namespaces/openshift-ingress/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.803388678Z namespaces/openshift-ingress/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.803544711Z namespaces/openshift-ingress/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.803821737Z namespaces/openshift-ingress/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.803933839Z namespaces/openshift-ingress/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.80397061Z namespaces/openshift-ingress/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.804055642Z namespaces/openshift-ingress/gateway.networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.804066562Z namespaces/openshift-ingress/gateway.networking.k8s.io/gateways/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.804102663Z namespaces/openshift-ingress/gateway.networking.k8s.io/gateways/openshift-ai-inference.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.804182035Z namespaces/openshift-ingress/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.804238756Z namespaces/openshift-ingress/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.804319468Z namespaces/openshift-ingress/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.804360789Z namespaces/openshift-ingress/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.804455291Z namespaces/openshift-ingress/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.804573244Z namespaces/openshift-ingress/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.804640855Z namespaces/openshift-ingress/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.804677366Z namespaces/openshift-ingress/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.804752208Z namespaces/openshift-ingress/monitoring.coreos.com/podmonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.804785678Z namespaces/openshift-ingress/monitoring.coreos.com/podmonitors/openshift-ai-inference-metrics.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.80485998Z namespaces/openshift-ingress/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.804893821Z namespaces/openshift-ingress/monitoring.coreos.com/servicemonitors/router-default.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.804959142Z namespaces/openshift-ingress/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.804978483Z namespaces/openshift-ingress/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.805058934Z namespaces/openshift-ingress/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.805069715Z namespaces/openshift-ingress/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.805116216Z namespaces/openshift-ingress/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.805288989Z namespaces/openshift-ingress/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.805551435Z namespaces/openshift-ingress/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.805689988Z namespaces/openshift-ingress/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.805914463Z namespaces/openshift-ingress/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.806110127Z namespaces/openshift-ingress/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.806121408Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.806162369Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/istiod-openshift-gateway-94bb8fbfd-4wpb9.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.806284071Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/discovery/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.806303132Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/discovery/discovery/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.806311662Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/discovery/discovery/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.806362653Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/discovery/discovery/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.818300436Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/discovery/discovery/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.818367818Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-4wpb9/discovery/discovery/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.818426809Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.81845986Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.818813537Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/istio-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.818823808Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/istio-proxy/istio-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.818829238Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/istio-proxy/istio-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.818881339Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/istio-proxy/istio-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.819769959Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-wqvjb/istio-proxy/istio-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.819868201Z namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.819901291Z namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router-default-6fd9c96588-sbl55.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.820026414Z namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.820035664Z namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router/router/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.820040494Z namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router/router/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.820083355Z namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router/router/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.820198048Z namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router/router/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.82028533Z namespaces/openshift-ingress/pods/router-default-6fd9c96588-sbl55/router/router/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.820338631Z namespaces/openshift-ingress/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.820378322Z namespaces/openshift-ingress/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.820443233Z namespaces/openshift-ingress/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.820484554Z namespaces/openshift-ingress/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.820588417Z namespaces/openshift-insights/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.820640698Z namespaces/openshift-insights/openshift-insights.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.820705389Z namespaces/openshift-insights/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.8207496Z namespaces/openshift-insights/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.820819672Z namespaces/openshift-insights/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.820856312Z namespaces/openshift-insights/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.820982945Z namespaces/openshift-insights/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.821097888Z namespaces/openshift-insights/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.82120541Z namespaces/openshift-insights/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.821245361Z namespaces/openshift-insights/apps/deployments/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.821370364Z namespaces/openshift-insights/apps/deployments/insights-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.821454805Z namespaces/openshift-insights/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.821493186Z namespaces/openshift-insights/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.821568638Z namespaces/openshift-insights/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.821597249Z namespaces/openshift-insights/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.821691041Z namespaces/openshift-insights/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.821736372Z namespaces/openshift-insights/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.821791243Z namespaces/openshift-insights/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.821873955Z namespaces/openshift-insights/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.821957657Z namespaces/openshift-insights/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.821995737Z namespaces/openshift-insights/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.822894487Z namespaces/openshift-insights/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.822993139Z namespaces/openshift-insights/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.823286416Z namespaces/openshift-insights/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.823424529Z namespaces/openshift-insights/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.823725146Z namespaces/openshift-insights/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.823811577Z namespaces/openshift-insights/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.823956591Z namespaces/openshift-insights/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.824021792Z namespaces/openshift-insights/core/configmaps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.824056013Z namespaces/openshift-insights/core/configmaps/service-ca-bundle.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.824139615Z namespaces/openshift-insights/core/serviceaccounts/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.824171785Z namespaces/openshift-insights/core/serviceaccounts/gather.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.824286038Z namespaces/openshift-insights/core/serviceaccounts/operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.82435864Z namespaces/openshift-insights/core/services/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.82437788Z namespaces/openshift-insights/core/services/metrics.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.824457622Z namespaces/openshift-insights/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.824476872Z namespaces/openshift-insights/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.824571024Z namespaces/openshift-insights/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.824611645Z namespaces/openshift-insights/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.824690137Z namespaces/openshift-insights/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.824732338Z namespaces/openshift-insights/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.824811459Z namespaces/openshift-insights/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.824898641Z namespaces/openshift-insights/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.824936672Z namespaces/openshift-insights/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.824988394Z namespaces/openshift-insights/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.825060705Z namespaces/openshift-insights/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.825085706Z namespaces/openshift-insights/monitoring.coreos.com/prometheusrules/insights-prometheus-rules.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.825184338Z namespaces/openshift-insights/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.825217559Z namespaces/openshift-insights/monitoring.coreos.com/servicemonitors/insights-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.82527824Z namespaces/openshift-insights/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.825342281Z namespaces/openshift-insights/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.825396192Z namespaces/openshift-insights/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.825411493Z namespaces/openshift-insights/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.825472384Z namespaces/openshift-insights/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.825672698Z namespaces/openshift-insights/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.825896223Z namespaces/openshift-insights/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.826041697Z namespaces/openshift-insights/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.826239981Z namespaces/openshift-insights/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.826510917Z namespaces/openshift-insights/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.826529127Z namespaces/openshift-insights/pods/insights-operator-68d9dd94cf-x6k6c/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.826538928Z namespaces/openshift-insights/pods/insights-operator-68d9dd94cf-x6k6c/insights-operator-68d9dd94cf-x6k6c.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.82665264Z namespaces/openshift-insights/pods/insights-operator-68d9dd94cf-x6k6c/insights-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.82666393Z namespaces/openshift-insights/pods/insights-operator-68d9dd94cf-x6k6c/insights-operator/insights-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.826668251Z namespaces/openshift-insights/pods/insights-operator-68d9dd94cf-x6k6c/insights-operator/insights-operator/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.826717812Z namespaces/openshift-insights/pods/insights-operator-68d9dd94cf-x6k6c/insights-operator/insights-operator/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.82708986Z namespaces/openshift-insights/pods/insights-operator-68d9dd94cf-x6k6c/insights-operator/insights-operator/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.827416287Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.827470988Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/insights-runtime-extractor-f2fxq.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.82756768Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/exporter/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.827580111Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/exporter/exporter/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.827586051Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/exporter/exporter/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.827612951Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/exporter/exporter/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.827701043Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/exporter/exporter/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.827773435Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/exporter/exporter/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.827807485Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/extractor/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.827813656Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/extractor/extractor/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.827817926Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/extractor/extractor/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.827857387Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/extractor/extractor/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.827958329Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/extractor/extractor/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.82803031Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/extractor/extractor/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.828079962Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.828086952Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.828090942Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.828144333Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.828230765Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.828323817Z namespaces/openshift-insights/pods/insights-runtime-extractor-f2fxq/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.828363158Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.828421469Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/insights-runtime-extractor-kmvpf.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.828514711Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/exporter/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.828522941Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/exporter/exporter/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.828530241Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/exporter/exporter/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.828579282Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/exporter/exporter/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.828669624Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/exporter/exporter/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.828742316Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/exporter/exporter/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.828790277Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/extractor/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.828797487Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/extractor/extractor/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.828801467Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/extractor/extractor/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.828847359Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/extractor/extractor/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.828945881Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/extractor/extractor/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.829019362Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/extractor/extractor/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.829046303Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.829189166Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.829196866Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.829248367Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.82935187Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.829438681Z namespaces/openshift-insights/pods/insights-runtime-extractor-kmvpf/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.829478162Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.829537544Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/insights-runtime-extractor-x4475.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.829622076Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/exporter/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.829633286Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/exporter/exporter/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.829639226Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/exporter/exporter/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.829671947Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/exporter/exporter/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.829792449Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/exporter/exporter/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.829845241Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/exporter/exporter/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.829895342Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/extractor/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.829902342Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/extractor/extractor/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.829909232Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/extractor/extractor/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.829959453Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/extractor/extractor/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830058315Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/extractor/extractor/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830128767Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/extractor/extractor/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830164077Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830172448Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830181908Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830254279Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830372162Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830429243Z namespaces/openshift-insights/pods/insights-runtime-extractor-x4475/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830475854Z namespaces/openshift-insights/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830533726Z namespaces/openshift-insights/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830577667Z namespaces/openshift-insights/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830632228Z namespaces/openshift-insights/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830669269Z namespaces/openshift-keda/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830678929Z namespaces/openshift-keda/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830687399Z namespaces/openshift-keda/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830752361Z namespaces/openshift-keda/coordination.k8s.io/leases/olm-operator.keda.sh.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830836552Z namespaces/openshift-keda/coordination.k8s.io/leases/operator.keda.sh.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830883163Z namespaces/openshift-keda/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830892813Z namespaces/openshift-keda/monitoring.coreos.com/podmonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830937254Z namespaces/openshift-keda/monitoring.coreos.com/podmonitors/keda-olm-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.830991636Z namespaces/openshift-keda/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.831033337Z namespaces/openshift-keda/monitoring.coreos.com/servicemonitors/keda-admission-webhooks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.831119969Z namespaces/openshift-keda/monitoring.coreos.com/servicemonitors/keda-metrics-apiserver.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.831212791Z namespaces/openshift-keda/monitoring.coreos.com/servicemonitors/keda-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.831292682Z namespaces/openshift-keda/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.831314423Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.831373934Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.831526007Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.831716842Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/custom-metrics-autoscaler.v2.19.0-1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.831990128Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.832205833Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.832376636Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.83255885Z namespaces/openshift-keda/operators.coreos.com/installplans/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.832575201Z namespaces/openshift-keda/operators.coreos.com/installplans/install-7d6q5.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.832720924Z namespaces/openshift-keda/operators.coreos.com/operatorconditions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.832736434Z namespaces/openshift-keda/operators.coreos.com/operatorconditions/custom-metrics-autoscaler.v2.19.0-1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.832818926Z namespaces/openshift-keda/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.832833876Z namespaces/openshift-keda/operators.coreos.com/operatorgroups/openshift-keda.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.832916778Z namespaces/openshift-keda/operators.coreos.com/subscriptions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.832930778Z namespaces/openshift-keda/operators.coreos.com/subscriptions/openshift-custom-metrics-autoscaler-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.833067692Z namespaces/openshift-kube-apiserver-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.833121603Z namespaces/openshift-kube-apiserver-operator/openshift-kube-apiserver-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.833211225Z namespaces/openshift-kube-apiserver-operator/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.833242575Z namespaces/openshift-kube-apiserver-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.833329187Z namespaces/openshift-kube-apiserver-operator/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.833360828Z namespaces/openshift-kube-apiserver-operator/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.83345141Z namespaces/openshift-kube-apiserver-operator/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.833532892Z namespaces/openshift-kube-apiserver-operator/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.833615064Z namespaces/openshift-kube-apiserver-operator/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.833668715Z namespaces/openshift-kube-apiserver-operator/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.833700275Z namespaces/openshift-kube-apiserver-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.833773547Z namespaces/openshift-kube-apiserver-operator/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.833831088Z namespaces/openshift-kube-apiserver-operator/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.83389378Z namespaces/openshift-kube-apiserver-operator/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.833947171Z namespaces/openshift-kube-apiserver-operator/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.833994862Z namespaces/openshift-kube-apiserver-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.834064954Z namespaces/openshift-kube-apiserver-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.834128035Z namespaces/openshift-kube-apiserver-operator/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.834162756Z namespaces/openshift-kube-apiserver-operator/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.834287318Z namespaces/openshift-kube-apiserver-operator/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.83437369Z namespaces/openshift-kube-apiserver-operator/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.834457252Z namespaces/openshift-kube-apiserver-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.834538644Z namespaces/openshift-kube-apiserver-operator/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.834620066Z namespaces/openshift-kube-apiserver-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.834743118Z namespaces/openshift-kube-apiserver-operator/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.834918382Z namespaces/openshift-kube-apiserver-operator/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.834966393Z namespaces/openshift-kube-apiserver-operator/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.835007024Z namespaces/openshift-kube-apiserver-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.835063396Z namespaces/openshift-kube-apiserver-operator/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.835104586Z namespaces/openshift-kube-apiserver-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.835158567Z namespaces/openshift-kube-apiserver-operator/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.835191928Z namespaces/openshift-kube-apiserver-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.835286901Z namespaces/openshift-kube-apiserver-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.835388843Z namespaces/openshift-kube-apiserver-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.835422663Z namespaces/openshift-kube-apiserver-operator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.835475065Z namespaces/openshift-kube-apiserver-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.835525176Z namespaces/openshift-kube-apiserver-operator/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.835565656Z namespaces/openshift-kube-apiserver-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.835612588Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.835622578Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.835669239Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.835819702Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.835999126Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.836136609Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.836397845Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.836585939Z namespaces/openshift-kube-apiserver-operator/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.83661461Z namespaces/openshift-kube-apiserver-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.836673781Z namespaces/openshift-kube-apiserver-operator/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.836702781Z namespaces/openshift-kube-apiserver-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.836786093Z namespaces/openshift-kube-apiserver/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.836834575Z namespaces/openshift-kube-apiserver/openshift-kube-apiserver.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.836894706Z namespaces/openshift-kube-apiserver/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.836935977Z namespaces/openshift-kube-apiserver/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.836994118Z namespaces/openshift-kube-apiserver/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.837029459Z namespaces/openshift-kube-apiserver/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.837118711Z namespaces/openshift-kube-apiserver/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.837199412Z namespaces/openshift-kube-apiserver/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.837279444Z namespaces/openshift-kube-apiserver/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.837405397Z namespaces/openshift-kube-apiserver/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.837440478Z namespaces/openshift-kube-apiserver/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.837496459Z namespaces/openshift-kube-apiserver/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.83752887Z namespaces/openshift-kube-apiserver/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.837621732Z namespaces/openshift-kube-apiserver/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.837656262Z namespaces/openshift-kube-apiserver/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.837687673Z namespaces/openshift-kube-apiserver/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.837803016Z namespaces/openshift-kube-apiserver/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.837858267Z namespaces/openshift-kube-apiserver/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.837900708Z namespaces/openshift-kube-apiserver/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.838017141Z namespaces/openshift-kube-apiserver/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.838172824Z namespaces/openshift-kube-apiserver/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.838251036Z namespaces/openshift-kube-apiserver/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.838355928Z namespaces/openshift-kube-apiserver/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.83843906Z namespaces/openshift-kube-apiserver/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.838557522Z namespaces/openshift-kube-apiserver/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.838714106Z namespaces/openshift-kube-apiserver/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.838776277Z namespaces/openshift-kube-apiserver/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.838814728Z namespaces/openshift-kube-apiserver/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.83887948Z namespaces/openshift-kube-apiserver/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.838929991Z namespaces/openshift-kube-apiserver/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.838973171Z namespaces/openshift-kube-apiserver/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.839032393Z namespaces/openshift-kube-apiserver/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.839117705Z namespaces/openshift-kube-apiserver/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.839202047Z namespaces/openshift-kube-apiserver/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.839276538Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.839325389Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.83937872Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.839430922Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/prometheusrules/api-usage.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.839544224Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/prometheusrules/podsecurity.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.839622416Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.839658187Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/servicemonitors/openshift-kube-apiserver.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.839722568Z namespaces/openshift-kube-apiserver/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.839754429Z namespaces/openshift-kube-apiserver/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.83980968Z namespaces/openshift-kube-apiserver/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.83981661Z namespaces/openshift-kube-apiserver/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.839870751Z namespaces/openshift-kube-apiserver/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.840023905Z namespaces/openshift-kube-apiserver/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.840205849Z namespaces/openshift-kube-apiserver/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.840363392Z namespaces/openshift-kube-apiserver/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.840585657Z namespaces/openshift-kube-apiserver/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.840771411Z namespaces/openshift-kube-apiserver/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.840787891Z namespaces/openshift-kube-apiserver/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.840869303Z namespaces/openshift-kube-apiserver/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.840885184Z namespaces/openshift-kube-apiserver/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.840970135Z namespaces/openshift-kube-controller-manager-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.840987086Z namespaces/openshift-kube-controller-manager-operator/openshift-kube-controller-manager-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.841077118Z namespaces/openshift-kube-controller-manager-operator/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.841103078Z namespaces/openshift-kube-controller-manager-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.8411757Z namespaces/openshift-kube-controller-manager-operator/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.841194671Z namespaces/openshift-kube-controller-manager-operator/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.841322043Z namespaces/openshift-kube-controller-manager-operator/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.841400745Z namespaces/openshift-kube-controller-manager-operator/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.841486557Z namespaces/openshift-kube-controller-manager-operator/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.841533028Z namespaces/openshift-kube-controller-manager-operator/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.841566499Z namespaces/openshift-kube-controller-manager-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.84162656Z namespaces/openshift-kube-controller-manager-operator/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.841670011Z namespaces/openshift-kube-controller-manager-operator/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.841747983Z namespaces/openshift-kube-controller-manager-operator/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.841806584Z namespaces/openshift-kube-controller-manager-operator/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.841858185Z namespaces/openshift-kube-controller-manager-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.841938437Z namespaces/openshift-kube-controller-manager-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.842000268Z namespaces/openshift-kube-controller-manager-operator/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.842033769Z namespaces/openshift-kube-controller-manager-operator/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.842146952Z namespaces/openshift-kube-controller-manager-operator/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.842230023Z namespaces/openshift-kube-controller-manager-operator/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.842335245Z namespaces/openshift-kube-controller-manager-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.842419567Z namespaces/openshift-kube-controller-manager-operator/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.842503699Z namespaces/openshift-kube-controller-manager-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.842659143Z namespaces/openshift-kube-controller-manager-operator/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.842868747Z namespaces/openshift-kube-controller-manager-operator/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.842927809Z namespaces/openshift-kube-controller-manager-operator/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.84298843Z namespaces/openshift-kube-controller-manager-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.843019571Z namespaces/openshift-kube-controller-manager-operator/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.843066782Z namespaces/openshift-kube-controller-manager-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.843120713Z namespaces/openshift-kube-controller-manager-operator/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.843177324Z namespaces/openshift-kube-controller-manager-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.843247846Z namespaces/openshift-kube-controller-manager-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.843351728Z namespaces/openshift-kube-controller-manager-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.843390589Z namespaces/openshift-kube-controller-manager-operator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.84344699Z namespaces/openshift-kube-controller-manager-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.843500521Z namespaces/openshift-kube-controller-manager-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.843540572Z namespaces/openshift-kube-controller-manager-operator/monitoring.coreos.com/servicemonitors/kube-controller-manager-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.843598824Z namespaces/openshift-kube-controller-manager-operator/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.843629794Z namespaces/openshift-kube-controller-manager-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.843686586Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.843693386Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.843736936Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.84389157Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.844072424Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.844214477Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.844481433Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.844720498Z namespaces/openshift-kube-controller-manager-operator/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.844756649Z namespaces/openshift-kube-controller-manager-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.84480824Z namespaces/openshift-kube-controller-manager-operator/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.844838331Z namespaces/openshift-kube-controller-manager-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.844919613Z namespaces/openshift-kube-controller-manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.844966403Z namespaces/openshift-kube-controller-manager/openshift-kube-controller-manager.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.845029505Z namespaces/openshift-kube-controller-manager/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.845059826Z namespaces/openshift-kube-controller-manager/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.845122587Z namespaces/openshift-kube-controller-manager/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.845157278Z namespaces/openshift-kube-controller-manager/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.84524201Z namespaces/openshift-kube-controller-manager/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.845425314Z namespaces/openshift-kube-controller-manager/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.845506695Z namespaces/openshift-kube-controller-manager/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.845562087Z namespaces/openshift-kube-controller-manager/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.845608428Z namespaces/openshift-kube-controller-manager/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.845643758Z namespaces/openshift-kube-controller-manager/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.84569347Z namespaces/openshift-kube-controller-manager/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.845791172Z namespaces/openshift-kube-controller-manager/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.845843053Z namespaces/openshift-kube-controller-manager/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.845890314Z namespaces/openshift-kube-controller-manager/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.845968436Z namespaces/openshift-kube-controller-manager/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.846016547Z namespaces/openshift-kube-controller-manager/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.846023687Z namespaces/openshift-kube-controller-manager/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.846059038Z namespaces/openshift-kube-controller-manager/coordination.k8s.io/leases/cluster-policy-controller-lock.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.846127829Z namespaces/openshift-kube-controller-manager/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.84616682Z namespaces/openshift-kube-controller-manager/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.846285243Z namespaces/openshift-kube-controller-manager/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.846377975Z namespaces/openshift-kube-controller-manager/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.846668571Z namespaces/openshift-kube-controller-manager/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.846751873Z namespaces/openshift-kube-controller-manager/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.846836355Z namespaces/openshift-kube-controller-manager/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.846956338Z namespaces/openshift-kube-controller-manager/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.847113211Z namespaces/openshift-kube-controller-manager/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.847167392Z namespaces/openshift-kube-controller-manager/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.847222783Z namespaces/openshift-kube-controller-manager/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.847241914Z namespaces/openshift-kube-controller-manager/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.847324795Z namespaces/openshift-kube-controller-manager/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.847381107Z namespaces/openshift-kube-controller-manager/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.847428788Z namespaces/openshift-kube-controller-manager/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.84751028Z namespaces/openshift-kube-controller-manager/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.847595952Z namespaces/openshift-kube-controller-manager/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.847630692Z namespaces/openshift-kube-controller-manager/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.847683723Z namespaces/openshift-kube-controller-manager/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.847723134Z namespaces/openshift-kube-controller-manager/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.847772136Z namespaces/openshift-kube-controller-manager/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.847821786Z namespaces/openshift-kube-controller-manager/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.847829277Z namespaces/openshift-kube-controller-manager/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.847872638Z namespaces/openshift-kube-controller-manager/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.848019951Z namespaces/openshift-kube-controller-manager/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.848201905Z namespaces/openshift-kube-controller-manager/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.848359569Z namespaces/openshift-kube-controller-manager/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.848566633Z namespaces/openshift-kube-controller-manager/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.848761167Z namespaces/openshift-kube-controller-manager/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.848796438Z namespaces/openshift-kube-controller-manager/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.848853349Z namespaces/openshift-kube-controller-manager/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.84889223Z namespaces/openshift-kube-controller-manager/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.848962182Z namespaces/openshift-kube-scheduler-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.849008303Z namespaces/openshift-kube-scheduler-operator/openshift-kube-scheduler-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.849070624Z namespaces/openshift-kube-scheduler-operator/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.849102005Z namespaces/openshift-kube-scheduler-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.849163466Z namespaces/openshift-kube-scheduler-operator/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.849194747Z namespaces/openshift-kube-scheduler-operator/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.849307069Z namespaces/openshift-kube-scheduler-operator/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.849392651Z namespaces/openshift-kube-scheduler-operator/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.849480803Z namespaces/openshift-kube-scheduler-operator/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.849521704Z namespaces/openshift-kube-scheduler-operator/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.849572695Z namespaces/openshift-kube-scheduler-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.849620576Z namespaces/openshift-kube-scheduler-operator/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.849649057Z namespaces/openshift-kube-scheduler-operator/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.849743589Z namespaces/openshift-kube-scheduler-operator/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.84979696Z namespaces/openshift-kube-scheduler-operator/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.849855691Z namespaces/openshift-kube-scheduler-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.849925603Z namespaces/openshift-kube-scheduler-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.849977684Z namespaces/openshift-kube-scheduler-operator/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.850021845Z namespaces/openshift-kube-scheduler-operator/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.850125787Z namespaces/openshift-kube-scheduler-operator/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.850207459Z namespaces/openshift-kube-scheduler-operator/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.850310151Z namespaces/openshift-kube-scheduler-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.850396513Z namespaces/openshift-kube-scheduler-operator/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.850478565Z namespaces/openshift-kube-scheduler-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.850602228Z namespaces/openshift-kube-scheduler-operator/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.850773251Z namespaces/openshift-kube-scheduler-operator/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.850827743Z namespaces/openshift-kube-scheduler-operator/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.850860893Z namespaces/openshift-kube-scheduler-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.850919205Z namespaces/openshift-kube-scheduler-operator/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.850955946Z namespaces/openshift-kube-scheduler-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.851013377Z namespaces/openshift-kube-scheduler-operator/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.851053088Z namespaces/openshift-kube-scheduler-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.851135559Z namespaces/openshift-kube-scheduler-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.851216141Z namespaces/openshift-kube-scheduler-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.851253652Z namespaces/openshift-kube-scheduler-operator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.851327334Z namespaces/openshift-kube-scheduler-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.851364324Z namespaces/openshift-kube-scheduler-operator/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.851414186Z namespaces/openshift-kube-scheduler-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.851463357Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.851473437Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.851530358Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.851725412Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.851906307Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.85205387Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.852257874Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.8525015Z namespaces/openshift-kube-scheduler-operator/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.85253178Z namespaces/openshift-kube-scheduler-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.852594092Z namespaces/openshift-kube-scheduler-operator/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.852622942Z namespaces/openshift-kube-scheduler-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.852710004Z namespaces/openshift-kube-scheduler/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.852745645Z namespaces/openshift-kube-scheduler/openshift-kube-scheduler.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.852810736Z namespaces/openshift-kube-scheduler/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.852854537Z namespaces/openshift-kube-scheduler/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.852905178Z namespaces/openshift-kube-scheduler/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.852934399Z namespaces/openshift-kube-scheduler/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.853028531Z namespaces/openshift-kube-scheduler/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.853111193Z namespaces/openshift-kube-scheduler/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.853194905Z namespaces/openshift-kube-scheduler/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.853252496Z namespaces/openshift-kube-scheduler/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.853363949Z namespaces/openshift-kube-scheduler/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.85342945Z namespaces/openshift-kube-scheduler/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.853472251Z namespaces/openshift-kube-scheduler/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.853562183Z namespaces/openshift-kube-scheduler/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.853596204Z namespaces/openshift-kube-scheduler/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.853646395Z namespaces/openshift-kube-scheduler/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.853736427Z namespaces/openshift-kube-scheduler/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.853818329Z namespaces/openshift-kube-scheduler/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.85385367Z namespaces/openshift-kube-scheduler/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.853962752Z namespaces/openshift-kube-scheduler/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.854045584Z namespaces/openshift-kube-scheduler/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.854129216Z namespaces/openshift-kube-scheduler/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.854211867Z namespaces/openshift-kube-scheduler/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.854316249Z namespaces/openshift-kube-scheduler/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.854445512Z namespaces/openshift-kube-scheduler/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.854645117Z namespaces/openshift-kube-scheduler/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.854698608Z namespaces/openshift-kube-scheduler/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.85477093Z namespaces/openshift-kube-scheduler/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.854834761Z namespaces/openshift-kube-scheduler/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.854875152Z namespaces/openshift-kube-scheduler/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.854927733Z namespaces/openshift-kube-scheduler/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.854956734Z namespaces/openshift-kube-scheduler/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.855046406Z namespaces/openshift-kube-scheduler/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.855131347Z namespaces/openshift-kube-scheduler/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.855166798Z namespaces/openshift-kube-scheduler/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.855218869Z namespaces/openshift-kube-scheduler/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.855279751Z namespaces/openshift-kube-scheduler/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.855322532Z namespaces/openshift-kube-scheduler/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.855378673Z namespaces/openshift-kube-scheduler/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.855388283Z namespaces/openshift-kube-scheduler/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.855459935Z namespaces/openshift-kube-scheduler/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.855593318Z namespaces/openshift-kube-scheduler/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.855791892Z namespaces/openshift-kube-scheduler/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.855931105Z namespaces/openshift-kube-scheduler/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.85612602Z namespaces/openshift-kube-scheduler/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.856339854Z namespaces/openshift-kube-scheduler/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.856387575Z namespaces/openshift-kube-scheduler/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.856456147Z namespaces/openshift-kube-scheduler/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.856492668Z namespaces/openshift-kube-scheduler/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.85659098Z namespaces/openshift-kube-storage-version-migrator-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.856623471Z namespaces/openshift-kube-storage-version-migrator-operator/openshift-kube-storage-version-migrator-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.856709702Z namespaces/openshift-kube-storage-version-migrator-operator/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.856738323Z namespaces/openshift-kube-storage-version-migrator-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.856803374Z namespaces/openshift-kube-storage-version-migrator-operator/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.856855516Z namespaces/openshift-kube-storage-version-migrator-operator/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.856943778Z namespaces/openshift-kube-storage-version-migrator-operator/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.85706304Z namespaces/openshift-kube-storage-version-migrator-operator/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.857167142Z namespaces/openshift-kube-storage-version-migrator-operator/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.857206783Z namespaces/openshift-kube-storage-version-migrator-operator/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.857239484Z namespaces/openshift-kube-storage-version-migrator-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.857326086Z namespaces/openshift-kube-storage-version-migrator-operator/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.857347216Z namespaces/openshift-kube-storage-version-migrator-operator/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.857446118Z namespaces/openshift-kube-storage-version-migrator-operator/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.85750395Z namespaces/openshift-kube-storage-version-migrator-operator/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.857540021Z namespaces/openshift-kube-storage-version-migrator-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.857638133Z namespaces/openshift-kube-storage-version-migrator-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.857662803Z namespaces/openshift-kube-storage-version-migrator-operator/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.857679414Z namespaces/openshift-kube-storage-version-migrator-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.857740355Z namespaces/openshift-kube-storage-version-migrator-operator/coordination.k8s.io/leases/openshift-kube-storage-version-migrator-operator-lock.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.857808146Z namespaces/openshift-kube-storage-version-migrator-operator/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.857837757Z namespaces/openshift-kube-storage-version-migrator-operator/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.85795506Z namespaces/openshift-kube-storage-version-migrator-operator/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.858112243Z namespaces/openshift-kube-storage-version-migrator-operator/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.858295067Z namespaces/openshift-kube-storage-version-migrator-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.858381969Z namespaces/openshift-kube-storage-version-migrator-operator/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.858502322Z namespaces/openshift-kube-storage-version-migrator-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.858630055Z namespaces/openshift-kube-storage-version-migrator-operator/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.858811819Z namespaces/openshift-kube-storage-version-migrator-operator/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.858849329Z namespaces/openshift-kube-storage-version-migrator-operator/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.85888542Z namespaces/openshift-kube-storage-version-migrator-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.858957042Z namespaces/openshift-kube-storage-version-migrator-operator/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.858980372Z namespaces/openshift-kube-storage-version-migrator-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.859055444Z namespaces/openshift-kube-storage-version-migrator-operator/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.859073634Z namespaces/openshift-kube-storage-version-migrator-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.859183087Z namespaces/openshift-kube-storage-version-migrator-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.859258158Z namespaces/openshift-kube-storage-version-migrator-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.85931Z namespaces/openshift-kube-storage-version-migrator-operator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.859356671Z namespaces/openshift-kube-storage-version-migrator-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.859396352Z namespaces/openshift-kube-storage-version-migrator-operator/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.859435032Z namespaces/openshift-kube-storage-version-migrator-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.859509674Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.859519214Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.859549865Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.859719569Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.859902013Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.860038696Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.860284881Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.860486556Z namespaces/openshift-kube-storage-version-migrator-operator/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.860498946Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-799cb7f958-f5qgx/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.860509686Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-799cb7f958-f5qgx/kube-storage-version-migrator-operator-799cb7f958-f5qgx.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.860649319Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-799cb7f958-f5qgx/kube-storage-version-migrator-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.8606693Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-799cb7f958-f5qgx/kube-storage-version-migrator-operator/kube-storage-version-migrator-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.86067534Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-799cb7f958-f5qgx/kube-storage-version-migrator-operator/kube-storage-version-migrator-operator/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.860716001Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-799cb7f958-f5qgx/kube-storage-version-migrator-operator/kube-storage-version-migrator-operator/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.860838213Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-799cb7f958-f5qgx/kube-storage-version-migrator-operator/kube-storage-version-migrator-operator/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.860949226Z namespaces/openshift-kube-storage-version-migrator-operator/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.860996487Z namespaces/openshift-kube-storage-version-migrator-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.861052488Z namespaces/openshift-kube-storage-version-migrator-operator/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.861086599Z namespaces/openshift-kube-storage-version-migrator-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.86114625Z namespaces/openshift-kube-storage-version-migrator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.861175001Z namespaces/openshift-kube-storage-version-migrator/openshift-kube-storage-version-migrator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.861282853Z namespaces/openshift-kube-storage-version-migrator/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.861381435Z namespaces/openshift-kube-storage-version-migrator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.861438786Z namespaces/openshift-kube-storage-version-migrator/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.861489878Z namespaces/openshift-kube-storage-version-migrator/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.861574369Z namespaces/openshift-kube-storage-version-migrator/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.861681582Z namespaces/openshift-kube-storage-version-migrator/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.861803205Z namespaces/openshift-kube-storage-version-migrator/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.861822205Z namespaces/openshift-kube-storage-version-migrator/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.861891176Z namespaces/openshift-kube-storage-version-migrator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.861941778Z namespaces/openshift-kube-storage-version-migrator/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.861978008Z namespaces/openshift-kube-storage-version-migrator/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.86206486Z namespaces/openshift-kube-storage-version-migrator/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.862117172Z namespaces/openshift-kube-storage-version-migrator/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.862156442Z namespaces/openshift-kube-storage-version-migrator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.862240314Z namespaces/openshift-kube-storage-version-migrator/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.862286745Z namespaces/openshift-kube-storage-version-migrator/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.862354397Z namespaces/openshift-kube-storage-version-migrator/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.862451839Z namespaces/openshift-kube-storage-version-migrator/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.86252795Z namespaces/openshift-kube-storage-version-migrator/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.862654383Z namespaces/openshift-kube-storage-version-migrator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.862733055Z namespaces/openshift-kube-storage-version-migrator/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.862831397Z namespaces/openshift-kube-storage-version-migrator/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.86297095Z namespaces/openshift-kube-storage-version-migrator/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.863130424Z namespaces/openshift-kube-storage-version-migrator/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.863167275Z namespaces/openshift-kube-storage-version-migrator/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.863205885Z namespaces/openshift-kube-storage-version-migrator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.863286207Z namespaces/openshift-kube-storage-version-migrator/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.863329568Z namespaces/openshift-kube-storage-version-migrator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.86340864Z namespaces/openshift-kube-storage-version-migrator/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.863428661Z namespaces/openshift-kube-storage-version-migrator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.863536223Z namespaces/openshift-kube-storage-version-migrator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.863613894Z namespaces/openshift-kube-storage-version-migrator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.863681806Z namespaces/openshift-kube-storage-version-migrator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.863729747Z namespaces/openshift-kube-storage-version-migrator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.863774118Z namespaces/openshift-kube-storage-version-migrator/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.863816049Z namespaces/openshift-kube-storage-version-migrator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.86385219Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.86386122Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.863910771Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.864066364Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.864362991Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.864505444Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.864700108Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.864883742Z namespaces/openshift-kube-storage-version-migrator/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.864894593Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-7f59b54f6c-qx52v/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.864910133Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-7f59b54f6c-qx52v/migrator-7f59b54f6c-qx52v.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865018445Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-7f59b54f6c-qx52v/graceful-termination/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865028545Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-7f59b54f6c-qx52v/graceful-termination/graceful-termination/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865034296Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-7f59b54f6c-qx52v/graceful-termination/graceful-termination/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865064086Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-7f59b54f6c-qx52v/graceful-termination/graceful-termination/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865146858Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-7f59b54f6c-qx52v/graceful-termination/graceful-termination/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.8652269Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-7f59b54f6c-qx52v/graceful-termination/graceful-termination/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.8652466Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-7f59b54f6c-qx52v/migrator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865252661Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-7f59b54f6c-qx52v/migrator/migrator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865261391Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-7f59b54f6c-qx52v/migrator/migrator/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865325202Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-7f59b54f6c-qx52v/migrator/migrator/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865436485Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-7f59b54f6c-qx52v/migrator/migrator/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865507446Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-7f59b54f6c-qx52v/migrator/migrator/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865541557Z namespaces/openshift-kube-storage-version-migrator/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865572217Z namespaces/openshift-kube-storage-version-migrator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865627419Z namespaces/openshift-kube-storage-version-migrator/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865661559Z namespaces/openshift-kube-storage-version-migrator/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865739541Z namespaces/openshift-lws-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865773072Z namespaces/openshift-lws-operator/openshift-lws-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865855984Z namespaces/openshift-lws-operator/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865895605Z namespaces/openshift-lws-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865934476Z namespaces/openshift-lws-operator/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.865991377Z namespaces/openshift-lws-operator/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.866077479Z namespaces/openshift-lws-operator/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.866213572Z namespaces/openshift-lws-operator/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.866357645Z namespaces/openshift-lws-operator/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.866405336Z namespaces/openshift-lws-operator/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.866439807Z namespaces/openshift-lws-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.866495258Z namespaces/openshift-lws-operator/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.866525119Z namespaces/openshift-lws-operator/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.86661478Z namespaces/openshift-lws-operator/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.866651361Z namespaces/openshift-lws-operator/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.866701673Z namespaces/openshift-lws-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.866782614Z namespaces/openshift-lws-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.866842025Z namespaces/openshift-lws-operator/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.866849886Z namespaces/openshift-lws-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.866905767Z namespaces/openshift-lws-operator/coordination.k8s.io/leases/b8b2488c.x-k8s.io.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.866990729Z namespaces/openshift-lws-operator/coordination.k8s.io/leases/openshift-lws-operator-lock.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.86703555Z namespaces/openshift-lws-operator/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.867092381Z namespaces/openshift-lws-operator/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.867197483Z namespaces/openshift-lws-operator/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.867290195Z namespaces/openshift-lws-operator/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.867615223Z namespaces/openshift-lws-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.867691284Z namespaces/openshift-lws-operator/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.867869238Z namespaces/openshift-lws-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.868014422Z namespaces/openshift-lws-operator/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.868255427Z namespaces/openshift-lws-operator/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.868332249Z namespaces/openshift-lws-operator/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.868374399Z namespaces/openshift-lws-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.868456401Z namespaces/openshift-lws-operator/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.868470161Z namespaces/openshift-lws-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.868534803Z namespaces/openshift-lws-operator/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.868576664Z namespaces/openshift-lws-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.868665096Z namespaces/openshift-lws-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.868744718Z namespaces/openshift-lws-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.868802559Z namespaces/openshift-lws-operator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.86884143Z namespaces/openshift-lws-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.868906361Z namespaces/openshift-lws-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.868944162Z namespaces/openshift-lws-operator/monitoring.coreos.com/servicemonitors/lws-controller-manager-metrics-monitor.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.869013464Z namespaces/openshift-lws-operator/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.869064365Z namespaces/openshift-lws-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.869126876Z namespaces/openshift-lws-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.869134686Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.869191717Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.869426362Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.869606977Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.86975128Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/leader-worker-set.v1.0.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.870140208Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.870335282Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.870533477Z namespaces/openshift-lws-operator/operators.coreos.com/installplans/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.870578678Z namespaces/openshift-lws-operator/operators.coreos.com/installplans/install-fqxc4.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.87067421Z namespaces/openshift-lws-operator/operators.coreos.com/operatorconditions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.870712461Z namespaces/openshift-lws-operator/operators.coreos.com/operatorconditions/leader-worker-set.v1.0.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.870773802Z namespaces/openshift-lws-operator/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.870801903Z namespaces/openshift-lws-operator/operators.coreos.com/operatorgroups/leader-worker-set.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.870869804Z namespaces/openshift-lws-operator/operators.coreos.com/subscriptions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.870898855Z namespaces/openshift-lws-operator/operators.coreos.com/subscriptions/leader-worker-set.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.870976287Z namespaces/openshift-lws-operator/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.870983487Z namespaces/openshift-lws-operator/pods/lws-controller-manager-7885457d66-b8k5x/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.871032498Z namespaces/openshift-lws-operator/pods/lws-controller-manager-7885457d66-b8k5x/lws-controller-manager-7885457d66-b8k5x.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.87112028Z namespaces/openshift-lws-operator/pods/lws-controller-manager-7885457d66-b8k5x/manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.87113126Z namespaces/openshift-lws-operator/pods/lws-controller-manager-7885457d66-b8k5x/manager/manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.87113978Z namespaces/openshift-lws-operator/pods/lws-controller-manager-7885457d66-b8k5x/manager/manager/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.871185291Z namespaces/openshift-lws-operator/pods/lws-controller-manager-7885457d66-b8k5x/manager/manager/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.871358825Z namespaces/openshift-lws-operator/pods/lws-controller-manager-7885457d66-b8k5x/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.871429607Z namespaces/openshift-lws-operator/pods/lws-controller-manager-7885457d66-b8k5x/manager/manager/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.871474198Z namespaces/openshift-lws-operator/pods/lws-controller-manager-7885457d66-lwd5g/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.871501858Z namespaces/openshift-lws-operator/pods/lws-controller-manager-7885457d66-lwd5g/lws-controller-manager-7885457d66-lwd5g.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.871602361Z namespaces/openshift-lws-operator/pods/lws-controller-manager-7885457d66-lwd5g/manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.871616501Z namespaces/openshift-lws-operator/pods/lws-controller-manager-7885457d66-lwd5g/manager/manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.871620901Z namespaces/openshift-lws-operator/pods/lws-controller-manager-7885457d66-lwd5g/manager/manager/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.871662262Z namespaces/openshift-lws-operator/pods/lws-controller-manager-7885457d66-lwd5g/manager/manager/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.871924168Z namespaces/openshift-lws-operator/pods/lws-controller-manager-7885457d66-lwd5g/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.871987069Z namespaces/openshift-lws-operator/pods/lws-controller-manager-7885457d66-lwd5g/manager/manager/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.87202186Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-fd8ccff4c-rdqn6/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.872072701Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-fd8ccff4c-rdqn6/openshift-lws-operator-fd8ccff4c-rdqn6.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.872164413Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-fd8ccff4c-rdqn6/openshift-lws-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.872174943Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-fd8ccff4c-rdqn6/openshift-lws-operator/openshift-lws-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.872187423Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-fd8ccff4c-rdqn6/openshift-lws-operator/openshift-lws-operator/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.872217604Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-fd8ccff4c-rdqn6/openshift-lws-operator/openshift-lws-operator/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.872424728Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-fd8ccff4c-rdqn6/openshift-lws-operator/openshift-lws-operator/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.8725049Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-fd8ccff4c-rdqn6/openshift-lws-operator/openshift-lws-operator/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.872523491Z namespaces/openshift-lws-operator/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.872582562Z namespaces/openshift-lws-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.872623973Z namespaces/openshift-lws-operator/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.872667804Z namespaces/openshift-lws-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.872709325Z namespaces/openshift-machine-api/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.872718065Z namespaces/openshift-machine-api/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.872728645Z namespaces/openshift-machine-api/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.872773626Z namespaces/openshift-machine-api/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.87292762Z namespaces/openshift-machine-api/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.873125654Z namespaces/openshift-machine-api/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.873258437Z namespaces/openshift-machine-api/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.873490432Z namespaces/openshift-machine-api/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.873691627Z namespaces/openshift-machine-config-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.873704047Z namespaces/openshift-machine-config-operator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.873710097Z namespaces/openshift-machine-config-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.873720187Z namespaces/openshift-machine-config-operator/monitoring.coreos.com/prometheusrules/machine-config-controller.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.87383664Z namespaces/openshift-machine-config-operator/monitoring.coreos.com/prometheusrules/machine-config-daemon.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.873936682Z namespaces/openshift-machine-config-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.873950492Z namespaces/openshift-machine-config-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.873966522Z namespaces/openshift-machine-config-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.874133106Z namespaces/openshift-machine-config-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.874407262Z namespaces/openshift-machine-config-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.874559255Z namespaces/openshift-machine-config-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.87477013Z namespaces/openshift-machine-config-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.874959494Z namespaces/openshift-marketplace/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.874972535Z namespaces/openshift-marketplace/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.874978685Z namespaces/openshift-marketplace/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.874987935Z namespaces/openshift-marketplace/monitoring.coreos.com/prometheusrules/marketplace-alert-rules.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.875072297Z namespaces/openshift-marketplace/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.875082087Z namespaces/openshift-marketplace/operators.coreos.com/catalogsources/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.875094567Z namespaces/openshift-marketplace/operators.coreos.com/catalogsources/certified-operators.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.875184479Z namespaces/openshift-marketplace/operators.coreos.com/catalogsources/community-operators.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.875287682Z namespaces/openshift-marketplace/operators.coreos.com/catalogsources/redhat-marketplace.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.875420114Z namespaces/openshift-marketplace/operators.coreos.com/catalogsources/redhat-operators.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.875475196Z namespaces/openshift-marketplace/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.875519497Z namespaces/openshift-marketplace/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.87567495Z namespaces/openshift-marketplace/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.875858294Z namespaces/openshift-marketplace/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.876005267Z namespaces/openshift-marketplace/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.876238943Z namespaces/openshift-marketplace/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.876467338Z namespaces/openshift-monitoring/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.876499458Z namespaces/openshift-monitoring/openshift-monitoring.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.87657857Z namespaces/openshift-monitoring/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.876623331Z namespaces/openshift-monitoring/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.876680052Z namespaces/openshift-monitoring/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.876712533Z namespaces/openshift-monitoring/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.876854716Z namespaces/openshift-monitoring/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.877308126Z namespaces/openshift-monitoring/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.877736336Z namespaces/openshift-monitoring/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.878006042Z namespaces/openshift-monitoring/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.878041132Z namespaces/openshift-monitoring/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.878115954Z namespaces/openshift-monitoring/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.878183735Z namespaces/openshift-monitoring/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.878291618Z namespaces/openshift-monitoring/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.87837183Z namespaces/openshift-monitoring/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.87841474Z namespaces/openshift-monitoring/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.878505622Z namespaces/openshift-monitoring/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.878538453Z namespaces/openshift-monitoring/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.878583454Z namespaces/openshift-monitoring/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.881783425Z namespaces/openshift-monitoring/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.88201697Z namespaces/openshift-monitoring/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.883121514Z namespaces/openshift-monitoring/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.883199176Z namespaces/openshift-monitoring/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.884106636Z namespaces/openshift-monitoring/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.88428061Z namespaces/openshift-monitoring/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.884833482Z namespaces/openshift-monitoring/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.884999625Z namespaces/openshift-monitoring/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.885031696Z namespaces/openshift-monitoring/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.88519086Z namespaces/openshift-monitoring/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.885222841Z namespaces/openshift-monitoring/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.885278882Z namespaces/openshift-monitoring/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.885340983Z namespaces/openshift-monitoring/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.885428645Z namespaces/openshift-monitoring/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.885510197Z namespaces/openshift-monitoring/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.885562048Z namespaces/openshift-monitoring/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.885590479Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.885737992Z namespaces/openshift-monitoring/monitoring.coreos.com/alertmanagers/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.885776383Z namespaces/openshift-monitoring/monitoring.coreos.com/alertmanagers/main.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.885868385Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheuses/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.885895925Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheuses/k8s.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.886022408Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.886060379Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/alertmanager-main-rules.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.886172462Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/cluster-monitoring-operator-prometheus-rules.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.886443748Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/kube-state-metrics-rules.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.88653645Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/kubernetes-monitoring-rules.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.886809116Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/node-exporter-rules.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.886956109Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/prometheus-k8s-prometheus-rules.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.887088862Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/prometheus-k8s-thanos-sidecar-rules.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.887185334Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/prometheus-operator-rules.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.887314927Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/telemetry.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.887419489Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/thanos-querier.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.88749456Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.887543202Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/alertmanager-main.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.887635154Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/cluster-monitoring-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.887720596Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/kube-state-metrics.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.887809467Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/kubelet.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.88791564Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/metrics-server.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.888001592Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/node-exporter.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.888200116Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/openshift-state-metrics.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.888314289Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/prometheus-k8s.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.888407061Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/prometheus-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.888499123Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/telemeter-client.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.888588205Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/thanos-querier.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.888675717Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/thanos-sidecar.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.888747798Z namespaces/openshift-monitoring/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.888782389Z namespaces/openshift-monitoring/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.88884494Z namespaces/openshift-monitoring/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.888852081Z namespaces/openshift-monitoring/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.888882361Z namespaces/openshift-monitoring/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.889137267Z namespaces/openshift-monitoring/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.889379192Z namespaces/openshift-monitoring/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.889540246Z namespaces/openshift-monitoring/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.88976421Z namespaces/openshift-monitoring/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.889975635Z namespaces/openshift-monitoring/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.890012266Z namespaces/openshift-monitoring/operators.coreos.com/operatorgroups/openshift-cluster-monitoring.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.89019719Z namespaces/openshift-monitoring/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.89020591Z namespaces/openshift-monitoring/pods/alertmanager-main-0/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.890287492Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager-main-0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.890471786Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.890480706Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager/alertmanager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.890485586Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager/alertmanager/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.890510677Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager/alertmanager/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.890613069Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager/alertmanager/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.890687161Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager/alertmanager/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.890728452Z namespaces/openshift-monitoring/pods/alertmanager-main-0/config-reloader/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.890736332Z namespaces/openshift-monitoring/pods/alertmanager-main-0/config-reloader/config-reloader/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.890741082Z namespaces/openshift-monitoring/pods/alertmanager-main-0/config-reloader/config-reloader/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.890764313Z namespaces/openshift-monitoring/pods/alertmanager-main-0/config-reloader/config-reloader/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.890888235Z namespaces/openshift-monitoring/pods/alertmanager-main-0/config-reloader/config-reloader/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.890958997Z namespaces/openshift-monitoring/pods/alertmanager-main-0/config-reloader/config-reloader/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.890984817Z namespaces/openshift-monitoring/pods/alertmanager-main-0/init-config-reloader/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.890999418Z namespaces/openshift-monitoring/pods/alertmanager-main-0/init-config-reloader/init-config-reloader/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.891005148Z namespaces/openshift-monitoring/pods/alertmanager-main-0/init-config-reloader/init-config-reloader/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.891054119Z namespaces/openshift-monitoring/pods/alertmanager-main-0/init-config-reloader/init-config-reloader/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.891152461Z namespaces/openshift-monitoring/pods/alertmanager-main-0/init-config-reloader/init-config-reloader/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.891221953Z namespaces/openshift-monitoring/pods/alertmanager-main-0/init-config-reloader/init-config-reloader/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.891254363Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-metric/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.891262104Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-metric/kube-rbac-proxy-metric/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.891295454Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-metric/kube-rbac-proxy-metric/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.891315065Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-metric/kube-rbac-proxy-metric/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.891431917Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-metric/kube-rbac-proxy-metric/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.891500489Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-metric/kube-rbac-proxy-metric/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.891522569Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-web/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.8915591Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-web/kube-rbac-proxy-web/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.89156553Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.891573741Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.891677823Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.891747174Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.891795465Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.891807506Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.891813376Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.891826566Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.891925768Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.89199663Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.89201505Z namespaces/openshift-monitoring/pods/alertmanager-main-0/prom-label-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.89202732Z namespaces/openshift-monitoring/pods/alertmanager-main-0/prom-label-proxy/prom-label-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.89203282Z namespaces/openshift-monitoring/pods/alertmanager-main-0/prom-label-proxy/prom-label-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.892094822Z namespaces/openshift-monitoring/pods/alertmanager-main-0/prom-label-proxy/prom-label-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.892187964Z namespaces/openshift-monitoring/pods/alertmanager-main-0/prom-label-proxy/prom-label-proxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.892252836Z namespaces/openshift-monitoring/pods/alertmanager-main-0/prom-label-proxy/prom-label-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.892320397Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-5f7f494dd4-v7s7l/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.892345498Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-5f7f494dd4-v7s7l/cluster-monitoring-operator-5f7f494dd4-v7s7l.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.89245279Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-5f7f494dd4-v7s7l/cluster-monitoring-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.89246286Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-5f7f494dd4-v7s7l/cluster-monitoring-operator/cluster-monitoring-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.89247964Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-5f7f494dd4-v7s7l/cluster-monitoring-operator/cluster-monitoring-operator/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.892504261Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-5f7f494dd4-v7s7l/cluster-monitoring-operator/cluster-monitoring-operator/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.893021542Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-5f7f494dd4-v7s7l/cluster-monitoring-operator/cluster-monitoring-operator/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.894772291Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.894806502Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/kube-state-metrics-785778ff74-cmr54.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.894921954Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/kube-rbac-proxy-main/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.894929264Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/kube-rbac-proxy-main/kube-rbac-proxy-main/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.894935804Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.894986766Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.895084918Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.895157039Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.8951902Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/kube-rbac-proxy-self/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.89519833Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/kube-rbac-proxy-self/kube-rbac-proxy-self/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.8952032Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.895228361Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.895356974Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.895426685Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.895440696Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/kube-state-metrics/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.895446666Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/kube-state-metrics/kube-state-metrics/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.895455366Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/kube-state-metrics/kube-state-metrics/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.895518927Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/kube-state-metrics/kube-state-metrics/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.895718872Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/kube-state-metrics/kube-state-metrics/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.895775273Z namespaces/openshift-monitoring/pods/kube-state-metrics-785778ff74-cmr54/kube-state-metrics/kube-state-metrics/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.895813184Z namespaces/openshift-monitoring/pods/metrics-server-6fb696657c-dww2m/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.895855685Z namespaces/openshift-monitoring/pods/metrics-server-6fb696657c-dww2m/metrics-server-6fb696657c-dww2m.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.895950277Z namespaces/openshift-monitoring/pods/metrics-server-6fb696657c-dww2m/metrics-server/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.895959737Z namespaces/openshift-monitoring/pods/metrics-server-6fb696657c-dww2m/metrics-server/metrics-server/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.895965917Z namespaces/openshift-monitoring/pods/metrics-server-6fb696657c-dww2m/metrics-server/metrics-server/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.895981638Z namespaces/openshift-monitoring/pods/metrics-server-6fb696657c-dww2m/metrics-server/metrics-server/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.89608274Z namespaces/openshift-monitoring/pods/metrics-server-6fb696657c-dww2m/metrics-server/metrics-server/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.896152131Z namespaces/openshift-monitoring/pods/metrics-server-6fb696657c-dww2m/metrics-server/metrics-server/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.896188602Z namespaces/openshift-monitoring/pods/monitoring-plugin-5f68df7f58-plj97/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.896217743Z namespaces/openshift-monitoring/pods/monitoring-plugin-5f68df7f58-plj97/monitoring-plugin-5f68df7f58-plj97.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.896329985Z namespaces/openshift-monitoring/pods/monitoring-plugin-5f68df7f58-plj97/monitoring-plugin/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.896340655Z namespaces/openshift-monitoring/pods/monitoring-plugin-5f68df7f58-plj97/monitoring-plugin/monitoring-plugin/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.896344546Z namespaces/openshift-monitoring/pods/monitoring-plugin-5f68df7f58-plj97/monitoring-plugin/monitoring-plugin/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.896381907Z namespaces/openshift-monitoring/pods/monitoring-plugin-5f68df7f58-plj97/monitoring-plugin/monitoring-plugin/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.896479229Z namespaces/openshift-monitoring/pods/monitoring-plugin-5f68df7f58-plj97/monitoring-plugin/monitoring-plugin/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.8965481Z namespaces/openshift-monitoring/pods/monitoring-plugin-5f68df7f58-plj97/monitoring-plugin/monitoring-plugin/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.896580211Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.896627922Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/node-exporter-5bjwn.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.896736484Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/init-textfile/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.896743454Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/init-textfile/init-textfile/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.896749944Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/init-textfile/init-textfile/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.896800406Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/init-textfile/init-textfile/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.896875007Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/init-textfile/init-textfile/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.896950719Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/init-textfile/init-textfile/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.89699808Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.89700486Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.8970117Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.897056081Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.897154853Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.897225015Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.897276426Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/node-exporter/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.897286276Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/node-exporter/node-exporter/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.897299337Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/node-exporter/node-exporter/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.897357628Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/node-exporter/node-exporter/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.89747102Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/node-exporter/node-exporter/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.897541332Z namespaces/openshift-monitoring/pods/node-exporter-5bjwn/node-exporter/node-exporter/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.897600083Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.897628824Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/node-exporter-8tnlx.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.897747106Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/init-textfile/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.897755247Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/init-textfile/init-textfile/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.897759087Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/init-textfile/init-textfile/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.897819428Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/init-textfile/init-textfile/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.897886589Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/init-textfile/init-textfile/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.897963351Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/init-textfile/init-textfile/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.897994192Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898000602Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898018652Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898030903Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898138195Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898208636Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898243807Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/node-exporter/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898250597Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/node-exporter/node-exporter/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898254497Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/node-exporter/node-exporter/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898323429Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/node-exporter/node-exporter/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898438632Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/node-exporter/node-exporter/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898507853Z namespaces/openshift-monitoring/pods/node-exporter-8tnlx/node-exporter/node-exporter/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898540114Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898574405Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/node-exporter-jtb6d.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898681837Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/init-textfile/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898689297Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/init-textfile/init-textfile/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898693137Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/init-textfile/init-textfile/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898734408Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/init-textfile/init-textfile/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.89881076Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/init-textfile/init-textfile/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898879842Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/init-textfile/init-textfile/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898920152Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898927132Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898930992Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.898974013Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.899064786Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.899138497Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.899166218Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/node-exporter/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.899177408Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/node-exporter/node-exporter/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.899187248Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/node-exporter/node-exporter/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.899230109Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/node-exporter/node-exporter/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.899359992Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/node-exporter/node-exporter/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.899431144Z namespaces/openshift-monitoring/pods/node-exporter-jtb6d/node-exporter/node-exporter/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.899460124Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.899504765Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/openshift-state-metrics-84bd68b896-kpdm5.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.899683749Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/kube-rbac-proxy-main/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.899690559Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/kube-rbac-proxy-main/kube-rbac-proxy-main/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.899694469Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.89973833Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.899838343Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.899913774Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.899945335Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/kube-rbac-proxy-self/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.899951655Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/kube-rbac-proxy-self/kube-rbac-proxy-self/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.899957875Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.900016847Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.900104988Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.9001768Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.900215741Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/openshift-state-metrics/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.900222371Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/openshift-state-metrics/openshift-state-metrics/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.900229341Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/openshift-state-metrics/openshift-state-metrics/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.900277612Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/openshift-state-metrics/openshift-state-metrics/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.900403455Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/openshift-state-metrics/openshift-state-metrics/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.900482957Z namespaces/openshift-monitoring/pods/openshift-state-metrics-84bd68b896-kpdm5/openshift-state-metrics/openshift-state-metrics/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.900552358Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.90062224Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus-k8s-0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.900808864Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/config-reloader/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.900816084Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/config-reloader/config-reloader/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.900822284Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/config-reloader/config-reloader/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.900876386Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/config-reloader/config-reloader/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901039039Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/config-reloader/config-reloader/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901108191Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/config-reloader/config-reloader/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901137251Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/init-config-reloader/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901145861Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/init-config-reloader/init-config-reloader/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901149752Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/init-config-reloader/init-config-reloader/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901203913Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/init-config-reloader/init-config-reloader/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901338836Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/init-config-reloader/init-config-reloader/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901413177Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/init-config-reloader/init-config-reloader/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901439698Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-thanos/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901446898Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-thanos/kube-rbac-proxy-thanos/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901450758Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-thanos/kube-rbac-proxy-thanos/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901492179Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-thanos/kube-rbac-proxy-thanos/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901587811Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-thanos/kube-rbac-proxy-thanos/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901666533Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-thanos/kube-rbac-proxy-thanos/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901694293Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-web/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901698984Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-web/kube-rbac-proxy-web/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901704924Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901756815Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901849067Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901918098Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901944739Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.901960559Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.90196889Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.90201766Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.902104173Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.902176774Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.902202835Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.902209345Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus/prometheus/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.902215725Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus/prometheus/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.902279436Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus/prometheus/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.902839009Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus/prometheus/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.90290996Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus/prometheus/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.902942081Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/thanos-sidecar/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.902951431Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/thanos-sidecar/thanos-sidecar/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.902955361Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/thanos-sidecar/thanos-sidecar/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.903014193Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/thanos-sidecar/thanos-sidecar/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.903115395Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/thanos-sidecar/thanos-sidecar/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.903188246Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/thanos-sidecar/thanos-sidecar/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.903225617Z namespaces/openshift-monitoring/pods/prometheus-operator-64785b6675-kmfk8/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.903276508Z namespaces/openshift-monitoring/pods/prometheus-operator-64785b6675-kmfk8/prometheus-operator-64785b6675-kmfk8.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.903390591Z namespaces/openshift-monitoring/pods/prometheus-operator-64785b6675-kmfk8/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.903397811Z namespaces/openshift-monitoring/pods/prometheus-operator-64785b6675-kmfk8/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.903401591Z namespaces/openshift-monitoring/pods/prometheus-operator-64785b6675-kmfk8/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.903442512Z namespaces/openshift-monitoring/pods/prometheus-operator-64785b6675-kmfk8/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.903535214Z namespaces/openshift-monitoring/pods/prometheus-operator-64785b6675-kmfk8/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.903609886Z namespaces/openshift-monitoring/pods/prometheus-operator-64785b6675-kmfk8/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.903644596Z namespaces/openshift-monitoring/pods/prometheus-operator-64785b6675-kmfk8/prometheus-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.903657767Z namespaces/openshift-monitoring/pods/prometheus-operator-64785b6675-kmfk8/prometheus-operator/prometheus-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.903661717Z namespaces/openshift-monitoring/pods/prometheus-operator-64785b6675-kmfk8/prometheus-operator/prometheus-operator/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.903712678Z namespaces/openshift-monitoring/pods/prometheus-operator-64785b6675-kmfk8/prometheus-operator/prometheus-operator/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.903967754Z namespaces/openshift-monitoring/pods/prometheus-operator-64785b6675-kmfk8/prometheus-operator/prometheus-operator/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.904067106Z namespaces/openshift-monitoring/pods/prometheus-operator-64785b6675-kmfk8/prometheus-operator/prometheus-operator/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.904082716Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-77d98bc786-fnqrs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.904147827Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-77d98bc786-fnqrs/prometheus-operator-admission-webhook-77d98bc786-fnqrs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.904289611Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-77d98bc786-fnqrs/prometheus-operator-admission-webhook/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.904306431Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-77d98bc786-fnqrs/prometheus-operator-admission-webhook/prometheus-operator-admission-webhook/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.904315351Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-77d98bc786-fnqrs/prometheus-operator-admission-webhook/prometheus-operator-admission-webhook/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.904358812Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-77d98bc786-fnqrs/prometheus-operator-admission-webhook/prometheus-operator-admission-webhook/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.904461645Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-77d98bc786-fnqrs/prometheus-operator-admission-webhook/prometheus-operator-admission-webhook/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.904537186Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-77d98bc786-fnqrs/prometheus-operator-admission-webhook/prometheus-operator-admission-webhook/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.904565717Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.904647769Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/telemeter-client-7695ff9586-d576f.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.904798312Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.904805432Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.904809242Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.904861563Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.904953345Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.905015026Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.905045507Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/reload/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.905052157Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/reload/reload/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.905058767Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/reload/reload/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.905108999Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/reload/reload/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.905201941Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/reload/reload/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.905276582Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/reload/reload/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.905334224Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/telemeter-client/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.905341674Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/telemeter-client/telemeter-client/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.905345574Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/telemeter-client/telemeter-client/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.905383255Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/telemeter-client/telemeter-client/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.905518128Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/telemeter-client/telemeter-client/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.905589109Z namespaces/openshift-monitoring/pods/telemeter-client-7695ff9586-d576f/telemeter-client/telemeter-client/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.9056159Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.905693932Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/thanos-querier-7cb5558858-grx86.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.905840455Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy-metrics/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.905847705Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy-metrics/kube-rbac-proxy-metrics/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.905851595Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy-metrics/kube-rbac-proxy-metrics/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.905908846Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy-metrics/kube-rbac-proxy-metrics/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.905996968Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy-metrics/kube-rbac-proxy-metrics/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.90605809Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy-metrics/kube-rbac-proxy-metrics/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906171622Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy-rules/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906181622Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy-rules/kube-rbac-proxy-rules/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906187432Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy-rules/kube-rbac-proxy-rules/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906221603Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy-rules/kube-rbac-proxy-rules/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906341136Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy-rules/kube-rbac-proxy-rules/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906408647Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy-rules/kube-rbac-proxy-rules/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906424838Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy-web/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906434178Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy-web/kube-rbac-proxy-web/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906440458Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906504319Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906598952Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906667193Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906724214Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906736084Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906742065Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906758945Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906852407Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906920509Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906950739Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/prom-label-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.906957209Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/prom-label-proxy/prom-label-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.90697667Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/prom-label-proxy/prom-label-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.90698972Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/prom-label-proxy/prom-label-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.907089092Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/prom-label-proxy/prom-label-proxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.907162234Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/prom-label-proxy/prom-label-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.907199705Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/thanos-query/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.907206455Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/thanos-query/thanos-query/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.907210335Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/thanos-query/thanos-query/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.907249716Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/thanos-query/thanos-query/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.907375019Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/thanos-query/thanos-query/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.90744499Z namespaces/openshift-monitoring/pods/thanos-querier-7cb5558858-grx86/thanos-query/thanos-query/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.907478841Z namespaces/openshift-monitoring/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.907512802Z namespaces/openshift-monitoring/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.907576333Z namespaces/openshift-monitoring/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.907605334Z namespaces/openshift-monitoring/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.907711856Z namespaces/openshift-multus/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.907746497Z namespaces/openshift-multus/openshift-multus.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.907817358Z namespaces/openshift-multus/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.907848919Z namespaces/openshift-multus/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.907905Z namespaces/openshift-multus/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.907963782Z namespaces/openshift-multus/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.908215607Z namespaces/openshift-multus/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.908310339Z namespaces/openshift-multus/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.908403061Z namespaces/openshift-multus/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.908422582Z namespaces/openshift-multus/apps/daemonsets/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.908486423Z namespaces/openshift-multus/apps/daemonsets/multus-additional-cni-plugins.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.908640806Z namespaces/openshift-multus/apps/daemonsets/multus.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.908754319Z namespaces/openshift-multus/apps/daemonsets/network-metrics-daemon.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.90880179Z namespaces/openshift-multus/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.908838271Z namespaces/openshift-multus/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.908888782Z namespaces/openshift-multus/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.908934113Z namespaces/openshift-multus/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.909020705Z namespaces/openshift-multus/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.909054226Z namespaces/openshift-multus/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.909104157Z namespaces/openshift-multus/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.909288531Z namespaces/openshift-multus/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.909410003Z namespaces/openshift-multus/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.909426694Z namespaces/openshift-multus/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.909586447Z namespaces/openshift-multus/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.909672639Z namespaces/openshift-multus/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.91015798Z namespaces/openshift-multus/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.910294723Z namespaces/openshift-multus/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.910892586Z namespaces/openshift-multus/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.910972118Z namespaces/openshift-multus/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.911128301Z namespaces/openshift-multus/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.911165672Z namespaces/openshift-multus/core/configmaps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.911226054Z namespaces/openshift-multus/core/configmaps/cni-copy-resources.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.911349856Z namespaces/openshift-multus/core/configmaps/default-cni-sysctl-allowlist.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.911434388Z namespaces/openshift-multus/core/configmaps/multus-daemon-config.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.91151519Z namespaces/openshift-multus/core/configmaps/whereabouts-flatfile-config.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.911618032Z namespaces/openshift-multus/core/serviceaccounts/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.911657463Z namespaces/openshift-multus/core/serviceaccounts/metrics-daemon-sa.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.911751225Z namespaces/openshift-multus/core/serviceaccounts/multus-ac.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.911836987Z namespaces/openshift-multus/core/serviceaccounts/multus-ancillary-tools.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.911921729Z namespaces/openshift-multus/core/serviceaccounts/multus.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.91196053Z namespaces/openshift-multus/core/services/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.912016671Z namespaces/openshift-multus/core/services/network-metrics-service.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.912057362Z namespaces/openshift-multus/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.912096203Z namespaces/openshift-multus/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.912157424Z namespaces/openshift-multus/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.912186965Z namespaces/openshift-multus/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.912249036Z namespaces/openshift-multus/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.912319427Z namespaces/openshift-multus/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.912406269Z namespaces/openshift-multus/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.912479571Z namespaces/openshift-multus/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.912529672Z namespaces/openshift-multus/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.912558783Z namespaces/openshift-multus/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.912622624Z namespaces/openshift-multus/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.912659875Z namespaces/openshift-multus/monitoring.coreos.com/servicemonitors/monitor-network.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.912714826Z namespaces/openshift-multus/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.912748517Z namespaces/openshift-multus/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.912804538Z namespaces/openshift-multus/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.912813908Z namespaces/openshift-multus/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.91290182Z namespaces/openshift-multus/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.913061244Z namespaces/openshift-multus/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.913375671Z namespaces/openshift-multus/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.913541954Z namespaces/openshift-multus/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.91381924Z namespaces/openshift-multus/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.914033785Z namespaces/openshift-multus/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.914044125Z namespaces/openshift-multus/pods/multus-54sxh/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.914085277Z namespaces/openshift-multus/pods/multus-54sxh/multus-54sxh.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.914177219Z namespaces/openshift-multus/pods/multus-54sxh/kube-multus/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.914190829Z namespaces/openshift-multus/pods/multus-54sxh/kube-multus/kube-multus/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.914196809Z namespaces/openshift-multus/pods/multus-54sxh/kube-multus/kube-multus/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.914212559Z namespaces/openshift-multus/pods/multus-54sxh/kube-multus/kube-multus/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.914934215Z namespaces/openshift-multus/pods/multus-54sxh/kube-multus/kube-multus/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.915032557Z namespaces/openshift-multus/pods/multus-54sxh/kube-multus/kube-multus/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.915073248Z namespaces/openshift-multus/pods/multus-8lfv8/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.915107849Z namespaces/openshift-multus/pods/multus-8lfv8/multus-8lfv8.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.915197311Z namespaces/openshift-multus/pods/multus-8lfv8/kube-multus/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.915204881Z namespaces/openshift-multus/pods/multus-8lfv8/kube-multus/kube-multus/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.915208791Z namespaces/openshift-multus/pods/multus-8lfv8/kube-multus/kube-multus/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.915253872Z namespaces/openshift-multus/pods/multus-8lfv8/kube-multus/kube-multus/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.915824035Z namespaces/openshift-multus/pods/multus-8lfv8/kube-multus/kube-multus/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.915895186Z namespaces/openshift-multus/pods/multus-8lfv8/kube-multus/kube-multus/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.915930337Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.915983538Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/multus-additional-cni-plugins-cbckn.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916125711Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/bond-cni-plugin/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916132682Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/bond-cni-plugin/bond-cni-plugin/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916162222Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/bond-cni-plugin/bond-cni-plugin/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916209843Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/bond-cni-plugin/bond-cni-plugin/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916337576Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/bond-cni-plugin/bond-cni-plugin/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916406517Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/bond-cni-plugin/bond-cni-plugin/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916436198Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/cni-plugins/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916440278Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/cni-plugins/cni-plugins/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916447629Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/cni-plugins/cni-plugins/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916488679Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/cni-plugins/cni-plugins/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916582331Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/cni-plugins/cni-plugins/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916655943Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/cni-plugins/cni-plugins/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916694164Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/egress-router-binary-copy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916701064Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/egress-router-binary-copy/egress-router-binary-copy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916706654Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/egress-router-binary-copy/egress-router-binary-copy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916743285Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/egress-router-binary-copy/egress-router-binary-copy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916829317Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/egress-router-binary-copy/egress-router-binary-copy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916905128Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/egress-router-binary-copy/egress-router-binary-copy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916934069Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/kube-multus-additional-cni-plugins/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916940659Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.91694682Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.916995041Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.917077092Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.917147394Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.917177285Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/routeoverride-cni/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.917183565Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/routeoverride-cni/routeoverride-cni/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.917187545Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/routeoverride-cni/routeoverride-cni/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.917230756Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/routeoverride-cni/routeoverride-cni/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.91740856Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/routeoverride-cni/routeoverride-cni/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.917477241Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/routeoverride-cni/routeoverride-cni/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.917506492Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/whereabouts-cni-bincopy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.917513132Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/whereabouts-cni-bincopy/whereabouts-cni-bincopy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.917517332Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.917561043Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.917654115Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.917722666Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.917764407Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/whereabouts-cni/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.917771328Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/whereabouts-cni/whereabouts-cni/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.917775198Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/whereabouts-cni/whereabouts-cni/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.917819069Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/whereabouts-cni/whereabouts-cni/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.917909151Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/whereabouts-cni/whereabouts-cni/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.917979752Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbckn/whereabouts-cni/whereabouts-cni/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918029413Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918050294Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/multus-additional-cni-plugins-cbvg5.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918200597Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/bond-cni-plugin/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918214207Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/bond-cni-plugin/bond-cni-plugin/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918220077Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/bond-cni-plugin/bond-cni-plugin/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918241138Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/bond-cni-plugin/bond-cni-plugin/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.9183517Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/bond-cni-plugin/bond-cni-plugin/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918435052Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/bond-cni-plugin/bond-cni-plugin/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918464273Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/cni-plugins/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918471673Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/cni-plugins/cni-plugins/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918475533Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/cni-plugins/cni-plugins/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918517784Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/cni-plugins/cni-plugins/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918614756Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/cni-plugins/cni-plugins/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918683388Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/cni-plugins/cni-plugins/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918710958Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/egress-router-binary-copy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918717708Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/egress-router-binary-copy/egress-router-binary-copy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918721759Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/egress-router-binary-copy/egress-router-binary-copy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.9187648Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/egress-router-binary-copy/egress-router-binary-copy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918915743Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/egress-router-binary-copy/egress-router-binary-copy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918922363Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/egress-router-binary-copy/egress-router-binary-copy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918976964Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/kube-multus-additional-cni-plugins/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918989754Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.918995455Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919004965Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919085447Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919156018Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919182699Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/routeoverride-cni/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919188909Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/routeoverride-cni/routeoverride-cni/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919195299Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/routeoverride-cni/routeoverride-cni/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919256851Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/routeoverride-cni/routeoverride-cni/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919369973Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/routeoverride-cni/routeoverride-cni/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919443215Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/routeoverride-cni/routeoverride-cni/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919460615Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/whereabouts-cni-bincopy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919465125Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/whereabouts-cni-bincopy/whereabouts-cni-bincopy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919471305Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919518506Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919624479Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.91969133Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.91971032Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/whereabouts-cni/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919718901Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/whereabouts-cni/whereabouts-cni/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919748321Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/whereabouts-cni/whereabouts-cni/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919807043Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/whereabouts-cni/whereabouts-cni/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919893154Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/whereabouts-cni/whereabouts-cni/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919959596Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-cbvg5/whereabouts-cni/whereabouts-cni/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.919998647Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920027937Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/multus-additional-cni-plugins-jpjpd.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920166231Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/bond-cni-plugin/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920176421Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/bond-cni-plugin/bond-cni-plugin/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920182321Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/bond-cni-plugin/bond-cni-plugin/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920201351Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/bond-cni-plugin/bond-cni-plugin/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920310374Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/bond-cni-plugin/bond-cni-plugin/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920390465Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/bond-cni-plugin/bond-cni-plugin/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920405676Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/cni-plugins/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920411956Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/cni-plugins/cni-plugins/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920425596Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/cni-plugins/cni-plugins/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920472347Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/cni-plugins/cni-plugins/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920569569Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/cni-plugins/cni-plugins/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920634951Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/cni-plugins/cni-plugins/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920649011Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/egress-router-binary-copy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920661511Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/egress-router-binary-copy/egress-router-binary-copy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920674942Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/egress-router-binary-copy/egress-router-binary-copy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920720223Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/egress-router-binary-copy/egress-router-binary-copy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920806905Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/egress-router-binary-copy/egress-router-binary-copy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920877756Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/egress-router-binary-copy/egress-router-binary-copy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920895107Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/kube-multus-additional-cni-plugins/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920900907Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920909517Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.920959298Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921035599Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921106591Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921119611Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/routeoverride-cni/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921128332Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/routeoverride-cni/routeoverride-cni/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921145252Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/routeoverride-cni/routeoverride-cni/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921176973Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/routeoverride-cni/routeoverride-cni/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921290255Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/routeoverride-cni/routeoverride-cni/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921366887Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/routeoverride-cni/routeoverride-cni/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921386787Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/whereabouts-cni-bincopy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921392887Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/whereabouts-cni-bincopy/whereabouts-cni-bincopy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921414028Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921424458Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921535001Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921607372Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921626332Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/whereabouts-cni/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921636053Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/whereabouts-cni/whereabouts-cni/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921641733Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/whereabouts-cni/whereabouts-cni/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921686854Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/whereabouts-cni/whereabouts-cni/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921794566Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/whereabouts-cni/whereabouts-cni/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921852228Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-jpjpd/whereabouts-cni/whereabouts-cni/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921884028Z namespaces/openshift-multus/pods/multus-zwftt/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.921929869Z namespaces/openshift-multus/pods/multus-zwftt/multus-zwftt.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.922019791Z namespaces/openshift-multus/pods/multus-zwftt/kube-multus/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.922028452Z namespaces/openshift-multus/pods/multus-zwftt/kube-multus/kube-multus/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.922033281Z namespaces/openshift-multus/pods/multus-zwftt/kube-multus/kube-multus/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.922075462Z namespaces/openshift-multus/pods/multus-zwftt/kube-multus/kube-multus/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.922921391Z namespaces/openshift-multus/pods/multus-zwftt/kube-multus/kube-multus/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.922989763Z namespaces/openshift-multus/pods/multus-zwftt/kube-multus/kube-multus/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.923023233Z namespaces/openshift-multus/pods/network-metrics-daemon-5kshf/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.923057584Z namespaces/openshift-multus/pods/network-metrics-daemon-5kshf/network-metrics-daemon-5kshf.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.923148376Z namespaces/openshift-multus/pods/network-metrics-daemon-5kshf/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.923155796Z namespaces/openshift-multus/pods/network-metrics-daemon-5kshf/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.923159666Z namespaces/openshift-multus/pods/network-metrics-daemon-5kshf/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.923199097Z namespaces/openshift-multus/pods/network-metrics-daemon-5kshf/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.92331784Z namespaces/openshift-multus/pods/network-metrics-daemon-5kshf/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.923395931Z namespaces/openshift-multus/pods/network-metrics-daemon-5kshf/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.923415872Z namespaces/openshift-multus/pods/network-metrics-daemon-5kshf/network-metrics-daemon/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.923421972Z namespaces/openshift-multus/pods/network-metrics-daemon-5kshf/network-metrics-daemon/network-metrics-daemon/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.923433282Z namespaces/openshift-multus/pods/network-metrics-daemon-5kshf/network-metrics-daemon/network-metrics-daemon/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.923490044Z namespaces/openshift-multus/pods/network-metrics-daemon-5kshf/network-metrics-daemon/network-metrics-daemon/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.923678438Z namespaces/openshift-multus/pods/network-metrics-daemon-5kshf/network-metrics-daemon/network-metrics-daemon/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.923742269Z namespaces/openshift-multus/pods/network-metrics-daemon-5kshf/network-metrics-daemon/network-metrics-daemon/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.92376187Z namespaces/openshift-multus/pods/network-metrics-daemon-ghvbn/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.923827291Z namespaces/openshift-multus/pods/network-metrics-daemon-ghvbn/network-metrics-daemon-ghvbn.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.923897983Z namespaces/openshift-multus/pods/network-metrics-daemon-ghvbn/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.923910083Z namespaces/openshift-multus/pods/network-metrics-daemon-ghvbn/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.923916033Z namespaces/openshift-multus/pods/network-metrics-daemon-ghvbn/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.923943274Z namespaces/openshift-multus/pods/network-metrics-daemon-ghvbn/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.924039976Z namespaces/openshift-multus/pods/network-metrics-daemon-ghvbn/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.924105407Z namespaces/openshift-multus/pods/network-metrics-daemon-ghvbn/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.924158159Z namespaces/openshift-multus/pods/network-metrics-daemon-ghvbn/network-metrics-daemon/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.924168139Z namespaces/openshift-multus/pods/network-metrics-daemon-ghvbn/network-metrics-daemon/network-metrics-daemon/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.924173229Z namespaces/openshift-multus/pods/network-metrics-daemon-ghvbn/network-metrics-daemon/network-metrics-daemon/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.924183779Z namespaces/openshift-multus/pods/network-metrics-daemon-ghvbn/network-metrics-daemon/network-metrics-daemon/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.924525687Z namespaces/openshift-multus/pods/network-metrics-daemon-ghvbn/network-metrics-daemon/network-metrics-daemon/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.924597648Z namespaces/openshift-multus/pods/network-metrics-daemon-ghvbn/network-metrics-daemon/network-metrics-daemon/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.924614438Z namespaces/openshift-multus/pods/network-metrics-daemon-hjjkk/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.92467515Z namespaces/openshift-multus/pods/network-metrics-daemon-hjjkk/network-metrics-daemon-hjjkk.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.924748151Z namespaces/openshift-multus/pods/network-metrics-daemon-hjjkk/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.924758272Z namespaces/openshift-multus/pods/network-metrics-daemon-hjjkk/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.924763982Z namespaces/openshift-multus/pods/network-metrics-daemon-hjjkk/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.924803303Z namespaces/openshift-multus/pods/network-metrics-daemon-hjjkk/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.924883104Z namespaces/openshift-multus/pods/network-metrics-daemon-hjjkk/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.924963546Z namespaces/openshift-multus/pods/network-metrics-daemon-hjjkk/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.924993837Z namespaces/openshift-multus/pods/network-metrics-daemon-hjjkk/network-metrics-daemon/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.924999587Z namespaces/openshift-multus/pods/network-metrics-daemon-hjjkk/network-metrics-daemon/network-metrics-daemon/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.925004867Z namespaces/openshift-multus/pods/network-metrics-daemon-hjjkk/network-metrics-daemon/network-metrics-daemon/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.925056458Z namespaces/openshift-multus/pods/network-metrics-daemon-hjjkk/network-metrics-daemon/network-metrics-daemon/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.925230992Z namespaces/openshift-multus/pods/network-metrics-daemon-hjjkk/network-metrics-daemon/network-metrics-daemon/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.925308534Z namespaces/openshift-multus/pods/network-metrics-daemon-hjjkk/network-metrics-daemon/network-metrics-daemon/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.925332484Z namespaces/openshift-multus/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.925383805Z namespaces/openshift-multus/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.925435916Z namespaces/openshift-multus/rbac.authorization.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.925443517Z namespaces/openshift-multus/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.925479997Z namespaces/openshift-multus/rbac.authorization.k8s.io/rolebindings/multus-whereabouts.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.92558065Z namespaces/openshift-multus/rbac.authorization.k8s.io/rolebindings/prometheus-k8s.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.92561826Z namespaces/openshift-multus/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.925664152Z namespaces/openshift-multus/rbac.authorization.k8s.io/roles/prometheus-k8s.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.925767414Z namespaces/openshift-multus/rbac.authorization.k8s.io/roles/whereabouts-cni.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.925810085Z namespaces/openshift-multus/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.925850986Z namespaces/openshift-multus/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.925899977Z namespaces/openshift-must-gather-vv9mp/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.925908727Z namespaces/openshift-must-gather-vv9mp/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.925913757Z namespaces/openshift-must-gather-vv9mp/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.925945518Z namespaces/openshift-must-gather-vv9mp/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.926102061Z namespaces/openshift-must-gather-vv9mp/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.926310526Z namespaces/openshift-must-gather-vv9mp/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.926452579Z namespaces/openshift-must-gather-vv9mp/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.926708415Z namespaces/openshift-must-gather-vv9mp/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.926893809Z namespaces/openshift-network-console/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.926927829Z namespaces/openshift-network-console/openshift-network-console.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.926998581Z namespaces/openshift-network-console/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.927026282Z namespaces/openshift-network-console/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.927085833Z namespaces/openshift-network-console/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.927117793Z namespaces/openshift-network-console/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.927214936Z namespaces/openshift-network-console/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.927357529Z namespaces/openshift-network-console/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.927449461Z namespaces/openshift-network-console/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.927479541Z namespaces/openshift-network-console/apps/deployments/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.927543673Z namespaces/openshift-network-console/apps/deployments/networking-console-plugin.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.927605224Z namespaces/openshift-network-console/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.927659005Z namespaces/openshift-network-console/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.927697396Z namespaces/openshift-network-console/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.927740227Z namespaces/openshift-network-console/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.927823529Z namespaces/openshift-network-console/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.92787195Z namespaces/openshift-network-console/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.927902721Z namespaces/openshift-network-console/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.927996483Z namespaces/openshift-network-console/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.928038964Z namespaces/openshift-network-console/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.928090235Z namespaces/openshift-network-console/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.928212418Z namespaces/openshift-network-console/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.92831476Z namespaces/openshift-network-console/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.928421722Z namespaces/openshift-network-console/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.928508814Z namespaces/openshift-network-console/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.928674408Z namespaces/openshift-network-console/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.928825301Z namespaces/openshift-network-console/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.928944284Z namespaces/openshift-network-console/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.929001285Z namespaces/openshift-network-console/core/configmaps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.929056006Z namespaces/openshift-network-console/core/configmaps/networking-console-plugin.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.929100537Z namespaces/openshift-network-console/core/services/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.929138988Z namespaces/openshift-network-console/core/services/networking-console-plugin.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.929197679Z namespaces/openshift-network-console/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.9292262Z namespaces/openshift-network-console/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.929315472Z namespaces/openshift-network-console/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.929336133Z namespaces/openshift-network-console/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.929395254Z namespaces/openshift-network-console/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.929442935Z namespaces/openshift-network-console/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.929531897Z namespaces/openshift-network-console/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.929608079Z namespaces/openshift-network-console/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.929656189Z namespaces/openshift-network-console/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.92969383Z namespaces/openshift-network-console/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.929758232Z namespaces/openshift-network-console/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.929788103Z namespaces/openshift-network-console/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.929845974Z namespaces/openshift-network-console/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.929865654Z namespaces/openshift-network-console/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.929872884Z namespaces/openshift-network-console/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.930034328Z namespaces/openshift-network-console/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.930220332Z namespaces/openshift-network-console/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.930382036Z namespaces/openshift-network-console/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.930647261Z namespaces/openshift-network-console/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.930840775Z namespaces/openshift-network-console/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.930847866Z namespaces/openshift-network-console/pods/networking-console-plugin-6cf856758c-zml89/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.930881027Z namespaces/openshift-network-console/pods/networking-console-plugin-6cf856758c-zml89/networking-console-plugin-6cf856758c-zml89.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.930952518Z namespaces/openshift-network-console/pods/networking-console-plugin-6cf856758c-zml89/networking-console-plugin/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.930960488Z namespaces/openshift-network-console/pods/networking-console-plugin-6cf856758c-zml89/networking-console-plugin/networking-console-plugin/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.930970258Z namespaces/openshift-network-console/pods/networking-console-plugin-6cf856758c-zml89/networking-console-plugin/networking-console-plugin/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.931022059Z namespaces/openshift-network-console/pods/networking-console-plugin-6cf856758c-zml89/networking-console-plugin/networking-console-plugin/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.931117052Z namespaces/openshift-network-console/pods/networking-console-plugin-6cf856758c-zml89/networking-console-plugin/networking-console-plugin/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.931180193Z namespaces/openshift-network-console/pods/networking-console-plugin-6cf856758c-zml89/networking-console-plugin/networking-console-plugin/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.931214104Z namespaces/openshift-network-console/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.931258645Z namespaces/openshift-network-console/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.931326806Z namespaces/openshift-network-console/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.931375497Z namespaces/openshift-network-console/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.931410338Z namespaces/openshift-network-diagnostics/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.931467729Z namespaces/openshift-network-diagnostics/openshift-network-diagnostics.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.931518941Z namespaces/openshift-network-diagnostics/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.931553201Z namespaces/openshift-network-diagnostics/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.931606972Z namespaces/openshift-network-diagnostics/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.931663094Z namespaces/openshift-network-diagnostics/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.931768006Z namespaces/openshift-network-diagnostics/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.931886719Z namespaces/openshift-network-diagnostics/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.931984261Z namespaces/openshift-network-diagnostics/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.932022032Z namespaces/openshift-network-diagnostics/apps/daemonsets/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.932051362Z namespaces/openshift-network-diagnostics/apps/daemonsets/network-check-target.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.932131504Z namespaces/openshift-network-diagnostics/apps/deployments/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.932179305Z namespaces/openshift-network-diagnostics/apps/deployments/network-check-source.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.932245397Z namespaces/openshift-network-diagnostics/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.932285807Z namespaces/openshift-network-diagnostics/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.932356329Z namespaces/openshift-network-diagnostics/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.932373929Z namespaces/openshift-network-diagnostics/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.932473911Z namespaces/openshift-network-diagnostics/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.932526503Z namespaces/openshift-network-diagnostics/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.932539943Z namespaces/openshift-network-diagnostics/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.932636675Z namespaces/openshift-network-diagnostics/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.932676316Z namespaces/openshift-network-diagnostics/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.932719807Z namespaces/openshift-network-diagnostics/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.932824109Z namespaces/openshift-network-diagnostics/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.932935682Z namespaces/openshift-network-diagnostics/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.933126036Z namespaces/openshift-network-diagnostics/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.933215848Z namespaces/openshift-network-diagnostics/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.933506554Z namespaces/openshift-network-diagnostics/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.933595196Z namespaces/openshift-network-diagnostics/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.933703309Z namespaces/openshift-network-diagnostics/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.9337724Z namespaces/openshift-network-diagnostics/core/serviceaccounts/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.933803531Z namespaces/openshift-network-diagnostics/core/serviceaccounts/network-diagnostics.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.933864762Z namespaces/openshift-network-diagnostics/core/services/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.933893463Z namespaces/openshift-network-diagnostics/core/services/network-check-source.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.933991125Z namespaces/openshift-network-diagnostics/core/services/network-check-target.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.934042956Z namespaces/openshift-network-diagnostics/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.934069817Z namespaces/openshift-network-diagnostics/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.934143739Z namespaces/openshift-network-diagnostics/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.934171739Z namespaces/openshift-network-diagnostics/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.93422897Z namespaces/openshift-network-diagnostics/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.934257831Z namespaces/openshift-network-diagnostics/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.934366033Z namespaces/openshift-network-diagnostics/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.934452335Z namespaces/openshift-network-diagnostics/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.934501326Z namespaces/openshift-network-diagnostics/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.934545437Z namespaces/openshift-network-diagnostics/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.934599949Z namespaces/openshift-network-diagnostics/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.934628299Z namespaces/openshift-network-diagnostics/monitoring.coreos.com/servicemonitors/network-check-source.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.93468962Z namespaces/openshift-network-diagnostics/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.934745542Z namespaces/openshift-network-diagnostics/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.934763082Z namespaces/openshift-network-diagnostics/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.934776122Z namespaces/openshift-network-diagnostics/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.934834204Z namespaces/openshift-network-diagnostics/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.934984377Z namespaces/openshift-network-diagnostics/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.935164121Z namespaces/openshift-network-diagnostics/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.935321054Z namespaces/openshift-network-diagnostics/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.935539769Z namespaces/openshift-network-diagnostics/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.935737294Z namespaces/openshift-network-diagnostics/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.935747484Z namespaces/openshift-network-diagnostics/pods/network-check-source-869dcfcdcd-7dm27/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.935766094Z namespaces/openshift-network-diagnostics/pods/network-check-source-869dcfcdcd-7dm27/network-check-source-869dcfcdcd-7dm27.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.935857356Z namespaces/openshift-network-diagnostics/pods/network-check-source-869dcfcdcd-7dm27/check-endpoints/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.935867326Z namespaces/openshift-network-diagnostics/pods/network-check-source-869dcfcdcd-7dm27/check-endpoints/check-endpoints/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.935873017Z namespaces/openshift-network-diagnostics/pods/network-check-source-869dcfcdcd-7dm27/check-endpoints/check-endpoints/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.935886657Z namespaces/openshift-network-diagnostics/pods/network-check-source-869dcfcdcd-7dm27/check-endpoints/check-endpoints/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.935998999Z namespaces/openshift-network-diagnostics/pods/network-check-source-869dcfcdcd-7dm27/check-endpoints/check-endpoints/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.936070701Z namespaces/openshift-network-diagnostics/pods/network-check-source-869dcfcdcd-7dm27/check-endpoints/check-endpoints/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.936108472Z namespaces/openshift-network-diagnostics/pods/network-check-target-m42st/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.936134692Z namespaces/openshift-network-diagnostics/pods/network-check-target-m42st/network-check-target-m42st.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.936220524Z namespaces/openshift-network-diagnostics/pods/network-check-target-m42st/network-check-target-container/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.936237354Z namespaces/openshift-network-diagnostics/pods/network-check-target-m42st/network-check-target-container/network-check-target-container/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.936241494Z namespaces/openshift-network-diagnostics/pods/network-check-target-m42st/network-check-target-container/network-check-target-container/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.936252875Z namespaces/openshift-network-diagnostics/pods/network-check-target-m42st/network-check-target-container/network-check-target-container/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.936376277Z namespaces/openshift-network-diagnostics/pods/network-check-target-m42st/network-check-target-container/network-check-target-container/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.936443449Z namespaces/openshift-network-diagnostics/pods/network-check-target-m42st/network-check-target-container/network-check-target-container/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.93649434Z namespaces/openshift-network-diagnostics/pods/network-check-target-njgpn/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.936643623Z namespaces/openshift-network-diagnostics/pods/network-check-target-njgpn/network-check-target-njgpn.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.936662454Z namespaces/openshift-network-diagnostics/pods/network-check-target-njgpn/network-check-target-container/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.936672604Z namespaces/openshift-network-diagnostics/pods/network-check-target-njgpn/network-check-target-container/network-check-target-container/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.936678494Z namespaces/openshift-network-diagnostics/pods/network-check-target-njgpn/network-check-target-container/network-check-target-container/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.936684124Z namespaces/openshift-network-diagnostics/pods/network-check-target-njgpn/network-check-target-container/network-check-target-container/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.936729265Z namespaces/openshift-network-diagnostics/pods/network-check-target-njgpn/network-check-target-container/network-check-target-container/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.936807277Z namespaces/openshift-network-diagnostics/pods/network-check-target-njgpn/network-check-target-container/network-check-target-container/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.936826538Z namespaces/openshift-network-diagnostics/pods/network-check-target-tsz48/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.936888879Z namespaces/openshift-network-diagnostics/pods/network-check-target-tsz48/network-check-target-tsz48.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.93694311Z namespaces/openshift-network-diagnostics/pods/network-check-target-tsz48/network-check-target-container/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.93695323Z namespaces/openshift-network-diagnostics/pods/network-check-target-tsz48/network-check-target-container/network-check-target-container/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.93695957Z namespaces/openshift-network-diagnostics/pods/network-check-target-tsz48/network-check-target-container/network-check-target-container/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.937004691Z namespaces/openshift-network-diagnostics/pods/network-check-target-tsz48/network-check-target-container/network-check-target-container/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.937085593Z namespaces/openshift-network-diagnostics/pods/network-check-target-tsz48/network-check-target-container/network-check-target-container/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.937155885Z namespaces/openshift-network-diagnostics/pods/network-check-target-tsz48/network-check-target-container/network-check-target-container/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.937191495Z namespaces/openshift-network-diagnostics/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.937219516Z namespaces/openshift-network-diagnostics/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.937281888Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.937294158Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.937351089Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/rolebindings/network-diagnostics.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.937440371Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/rolebindings/prometheus-k8s.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.937476702Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.937531903Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/roles/network-diagnostics.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.937616005Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/roles/prometheus-k8s.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.937663656Z namespaces/openshift-network-diagnostics/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.937710007Z namespaces/openshift-network-diagnostics/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.937774548Z namespaces/openshift-network-node-identity/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.93782268Z namespaces/openshift-network-node-identity/openshift-network-node-identity.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.937879711Z namespaces/openshift-network-node-identity/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.937897621Z namespaces/openshift-network-node-identity/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.937958002Z namespaces/openshift-network-node-identity/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.937991173Z namespaces/openshift-network-node-identity/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.938084595Z namespaces/openshift-network-node-identity/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.938162037Z namespaces/openshift-network-node-identity/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.938240899Z namespaces/openshift-network-node-identity/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.93831521Z namespaces/openshift-network-node-identity/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.938355611Z namespaces/openshift-network-node-identity/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.938416262Z namespaces/openshift-network-node-identity/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.938432773Z namespaces/openshift-network-node-identity/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.938525205Z namespaces/openshift-network-node-identity/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.938580986Z namespaces/openshift-network-node-identity/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.938601586Z namespaces/openshift-network-node-identity/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.938700729Z namespaces/openshift-network-node-identity/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.938716669Z namespaces/openshift-network-node-identity/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.938726399Z namespaces/openshift-network-node-identity/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.938788121Z namespaces/openshift-network-node-identity/coordination.k8s.io/leases/ovnkube-identity.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.938841012Z namespaces/openshift-network-node-identity/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.938889483Z namespaces/openshift-network-node-identity/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.938990025Z namespaces/openshift-network-node-identity/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.939068717Z namespaces/openshift-network-node-identity/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.939159859Z namespaces/openshift-network-node-identity/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.939239621Z namespaces/openshift-network-node-identity/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.939347793Z namespaces/openshift-network-node-identity/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.939530427Z namespaces/openshift-network-node-identity/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.939628289Z namespaces/openshift-network-node-identity/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.93967405Z namespaces/openshift-network-node-identity/core/serviceaccounts/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.939731782Z namespaces/openshift-network-node-identity/core/serviceaccounts/network-node-identity.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.939775783Z namespaces/openshift-network-node-identity/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.939818213Z namespaces/openshift-network-node-identity/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.939864674Z namespaces/openshift-network-node-identity/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.939917216Z namespaces/openshift-network-node-identity/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.939956756Z namespaces/openshift-network-node-identity/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.940012008Z namespaces/openshift-network-node-identity/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.940093419Z namespaces/openshift-network-node-identity/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.940173631Z namespaces/openshift-network-node-identity/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.940214802Z namespaces/openshift-network-node-identity/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.940276063Z namespaces/openshift-network-node-identity/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.940342575Z namespaces/openshift-network-node-identity/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.940387726Z namespaces/openshift-network-node-identity/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.940442417Z namespaces/openshift-network-node-identity/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.940449247Z namespaces/openshift-network-node-identity/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.940482088Z namespaces/openshift-network-node-identity/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.940642022Z namespaces/openshift-network-node-identity/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.940819855Z namespaces/openshift-network-node-identity/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.940959989Z namespaces/openshift-network-node-identity/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.941160453Z namespaces/openshift-network-node-identity/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.941441529Z namespaces/openshift-network-node-identity/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.94148553Z namespaces/openshift-network-node-identity/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.941526571Z namespaces/openshift-network-node-identity/rbac.authorization.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.941534361Z namespaces/openshift-network-node-identity/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.941583432Z namespaces/openshift-network-node-identity/rbac.authorization.k8s.io/rolebindings/network-node-identity-leases.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.941631843Z namespaces/openshift-network-node-identity/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.941657694Z namespaces/openshift-network-node-identity/rbac.authorization.k8s.io/roles/network-node-identity-leases.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.941717375Z namespaces/openshift-network-node-identity/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.941762016Z namespaces/openshift-network-node-identity/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.941828288Z namespaces/openshift-network-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.941856078Z namespaces/openshift-network-operator/openshift-network-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.94192711Z namespaces/openshift-network-operator/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.941953551Z namespaces/openshift-network-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.942019192Z namespaces/openshift-network-operator/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.942050842Z namespaces/openshift-network-operator/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.942162505Z namespaces/openshift-network-operator/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.942255847Z namespaces/openshift-network-operator/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.942362889Z namespaces/openshift-network-operator/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.94239775Z namespaces/openshift-network-operator/apps/daemonsets/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.942442251Z namespaces/openshift-network-operator/apps/daemonsets/iptables-alerter.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.942519243Z namespaces/openshift-network-operator/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.942536403Z namespaces/openshift-network-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.942591745Z namespaces/openshift-network-operator/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.942641626Z namespaces/openshift-network-operator/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.942713717Z namespaces/openshift-network-operator/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.942755508Z namespaces/openshift-network-operator/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.942786309Z namespaces/openshift-network-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.942881771Z namespaces/openshift-network-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.942917082Z namespaces/openshift-network-operator/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.942923872Z namespaces/openshift-network-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.942959142Z namespaces/openshift-network-operator/coordination.k8s.io/leases/network-operator-lock.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.943030994Z namespaces/openshift-network-operator/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.943047735Z namespaces/openshift-network-operator/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.943180358Z namespaces/openshift-network-operator/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.94329195Z namespaces/openshift-network-operator/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.943451633Z namespaces/openshift-network-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.943523935Z namespaces/openshift-network-operator/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.943710209Z namespaces/openshift-network-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.943802281Z namespaces/openshift-network-operator/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.943954544Z namespaces/openshift-network-operator/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.944003386Z namespaces/openshift-network-operator/core/configmaps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.944040097Z namespaces/openshift-network-operator/core/configmaps/applied-cluster.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.944135099Z namespaces/openshift-network-operator/core/configmaps/iptables-alerter-script.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.94419422Z namespaces/openshift-network-operator/core/serviceaccounts/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.944237971Z namespaces/openshift-network-operator/core/serviceaccounts/iptables-alerter.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.944316212Z namespaces/openshift-network-operator/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.944341903Z namespaces/openshift-network-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.944419815Z namespaces/openshift-network-operator/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.944433615Z namespaces/openshift-network-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.944498007Z namespaces/openshift-network-operator/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.944530617Z namespaces/openshift-network-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.944622479Z namespaces/openshift-network-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.944827904Z namespaces/openshift-network-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.944864095Z namespaces/openshift-network-operator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.944916316Z namespaces/openshift-network-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.944952537Z namespaces/openshift-network-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.945011148Z namespaces/openshift-network-operator/monitoring.coreos.com/prometheusrules/openshift-network-operator-ipsec-rules.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.945061679Z namespaces/openshift-network-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.9450949Z namespaces/openshift-network-operator/monitoring.coreos.com/servicemonitors/network-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.945153021Z namespaces/openshift-network-operator/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.945185802Z namespaces/openshift-network-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.945239923Z namespaces/openshift-network-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.945246923Z namespaces/openshift-network-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.945296294Z namespaces/openshift-network-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.945458918Z namespaces/openshift-network-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.945659082Z namespaces/openshift-network-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.945814545Z namespaces/openshift-network-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.946071451Z namespaces/openshift-network-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.946255905Z namespaces/openshift-network-operator/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.946282006Z namespaces/openshift-network-operator/pods/iptables-alerter-b2dms/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.946318427Z namespaces/openshift-network-operator/pods/iptables-alerter-b2dms/iptables-alerter-b2dms.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.946395358Z namespaces/openshift-network-operator/pods/iptables-alerter-b2dms/iptables-alerter/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.946405158Z namespaces/openshift-network-operator/pods/iptables-alerter-b2dms/iptables-alerter/iptables-alerter/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.946421619Z namespaces/openshift-network-operator/pods/iptables-alerter-b2dms/iptables-alerter/iptables-alerter/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.94646952Z namespaces/openshift-network-operator/pods/iptables-alerter-b2dms/iptables-alerter/iptables-alerter/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.946552822Z namespaces/openshift-network-operator/pods/iptables-alerter-b2dms/iptables-alerter/iptables-alerter/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.946633154Z namespaces/openshift-network-operator/pods/iptables-alerter-b2dms/iptables-alerter/iptables-alerter/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.946650344Z namespaces/openshift-network-operator/pods/iptables-alerter-h7vxc/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.946712715Z namespaces/openshift-network-operator/pods/iptables-alerter-h7vxc/iptables-alerter-h7vxc.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.946778977Z namespaces/openshift-network-operator/pods/iptables-alerter-h7vxc/iptables-alerter/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.946790537Z namespaces/openshift-network-operator/pods/iptables-alerter-h7vxc/iptables-alerter/iptables-alerter/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.946796147Z namespaces/openshift-network-operator/pods/iptables-alerter-h7vxc/iptables-alerter/iptables-alerter/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.946809847Z namespaces/openshift-network-operator/pods/iptables-alerter-h7vxc/iptables-alerter/iptables-alerter/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.94691771Z namespaces/openshift-network-operator/pods/iptables-alerter-h7vxc/iptables-alerter/iptables-alerter/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.946983571Z namespaces/openshift-network-operator/pods/iptables-alerter-h7vxc/iptables-alerter/iptables-alerter/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.947003682Z namespaces/openshift-network-operator/pods/iptables-alerter-hh2wt/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.947055973Z namespaces/openshift-network-operator/pods/iptables-alerter-hh2wt/iptables-alerter-hh2wt.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.947118524Z namespaces/openshift-network-operator/pods/iptables-alerter-hh2wt/iptables-alerter/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.947126494Z namespaces/openshift-network-operator/pods/iptables-alerter-hh2wt/iptables-alerter/iptables-alerter/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.947130534Z namespaces/openshift-network-operator/pods/iptables-alerter-hh2wt/iptables-alerter/iptables-alerter/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.947168135Z namespaces/openshift-network-operator/pods/iptables-alerter-hh2wt/iptables-alerter/iptables-alerter/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.947259557Z namespaces/openshift-network-operator/pods/iptables-alerter-hh2wt/iptables-alerter/iptables-alerter/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.94736202Z namespaces/openshift-network-operator/pods/iptables-alerter-hh2wt/iptables-alerter/iptables-alerter/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.9473881Z namespaces/openshift-network-operator/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.947432181Z namespaces/openshift-network-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.947474222Z namespaces/openshift-network-operator/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.947510323Z namespaces/openshift-network-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.947567934Z namespaces/openshift-node/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.947593675Z namespaces/openshift-node/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.947597725Z namespaces/openshift-node/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.947604975Z namespaces/openshift-node/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.947768928Z namespaces/openshift-node/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.947958883Z namespaces/openshift-node/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.948088446Z namespaces/openshift-node/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.948317271Z namespaces/openshift-node/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.948506785Z namespaces/openshift-operator-lifecycle-manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.948539036Z namespaces/openshift-operator-lifecycle-manager/openshift-operator-lifecycle-manager.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.948618887Z namespaces/openshift-operator-lifecycle-manager/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.948653038Z namespaces/openshift-operator-lifecycle-manager/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.948703059Z namespaces/openshift-operator-lifecycle-manager/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.94874729Z namespaces/openshift-operator-lifecycle-manager/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.948833622Z namespaces/openshift-operator-lifecycle-manager/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.948920454Z namespaces/openshift-operator-lifecycle-manager/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.949002266Z namespaces/openshift-operator-lifecycle-manager/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.949047347Z namespaces/openshift-operator-lifecycle-manager/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.949068237Z namespaces/openshift-operator-lifecycle-manager/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.949125298Z namespaces/openshift-operator-lifecycle-manager/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.949163279Z namespaces/openshift-operator-lifecycle-manager/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.949257391Z namespaces/openshift-operator-lifecycle-manager/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.949396374Z namespaces/openshift-operator-lifecycle-manager/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.949418545Z namespaces/openshift-operator-lifecycle-manager/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.949519707Z namespaces/openshift-operator-lifecycle-manager/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.949555598Z namespaces/openshift-operator-lifecycle-manager/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.949601039Z namespaces/openshift-operator-lifecycle-manager/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.949713461Z namespaces/openshift-operator-lifecycle-manager/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.949806333Z namespaces/openshift-operator-lifecycle-manager/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.949911766Z namespaces/openshift-operator-lifecycle-manager/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.949989197Z namespaces/openshift-operator-lifecycle-manager/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.950071129Z namespaces/openshift-operator-lifecycle-manager/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.950201172Z namespaces/openshift-operator-lifecycle-manager/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.950420157Z namespaces/openshift-operator-lifecycle-manager/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.95055062Z namespaces/openshift-operator-lifecycle-manager/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.950581821Z namespaces/openshift-operator-lifecycle-manager/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.950647492Z namespaces/openshift-operator-lifecycle-manager/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.950674952Z namespaces/openshift-operator-lifecycle-manager/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.950747864Z namespaces/openshift-operator-lifecycle-manager/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.950764934Z namespaces/openshift-operator-lifecycle-manager/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.950856607Z namespaces/openshift-operator-lifecycle-manager/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.950944138Z namespaces/openshift-operator-lifecycle-manager/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.950974879Z namespaces/openshift-operator-lifecycle-manager/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.95101152Z namespaces/openshift-operator-lifecycle-manager/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.951058931Z namespaces/openshift-operator-lifecycle-manager/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.951117042Z namespaces/openshift-operator-lifecycle-manager/monitoring.coreos.com/prometheusrules/olm-alert-rules.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.951173963Z namespaces/openshift-operator-lifecycle-manager/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.951207094Z namespaces/openshift-operator-lifecycle-manager/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.951293356Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.951318017Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.951331837Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.951512101Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.951693325Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.951824958Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.952018592Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.952212517Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.952238007Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/operatorgroups/olm-operators.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.952337069Z namespaces/openshift-operator-lifecycle-manager/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.95235567Z namespaces/openshift-operator-lifecycle-manager/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.952421391Z namespaces/openshift-operator-lifecycle-manager/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.952473032Z namespaces/openshift-operator-lifecycle-manager/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.952511273Z namespaces/openshift-operators/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.952521273Z namespaces/openshift-operators/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.952526193Z namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.952540424Z namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.952705137Z namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.952889321Z namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.953026904Z namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.953232769Z namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.953452544Z namespaces/openshift-operators/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.953504415Z namespaces/openshift-operators/operators.coreos.com/operatorgroups/global-operators.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.953540256Z namespaces/openshift-ovn-kubernetes/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.953601427Z namespaces/openshift-ovn-kubernetes/openshift-ovn-kubernetes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.953665878Z namespaces/openshift-ovn-kubernetes/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.953681419Z namespaces/openshift-ovn-kubernetes/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.953770281Z namespaces/openshift-ovn-kubernetes/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.953784641Z namespaces/openshift-ovn-kubernetes/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.953978095Z namespaces/openshift-ovn-kubernetes/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.954058557Z namespaces/openshift-ovn-kubernetes/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.954140399Z namespaces/openshift-ovn-kubernetes/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.95419187Z namespaces/openshift-ovn-kubernetes/apps/daemonsets/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.95421757Z namespaces/openshift-ovn-kubernetes/apps/daemonsets/ovnkube-node.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.954377624Z namespaces/openshift-ovn-kubernetes/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.954423805Z namespaces/openshift-ovn-kubernetes/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.954453656Z namespaces/openshift-ovn-kubernetes/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.954506977Z namespaces/openshift-ovn-kubernetes/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.954591499Z namespaces/openshift-ovn-kubernetes/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.95462615Z namespaces/openshift-ovn-kubernetes/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.954684981Z namespaces/openshift-ovn-kubernetes/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.954768553Z namespaces/openshift-ovn-kubernetes/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.954805574Z namespaces/openshift-ovn-kubernetes/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.954812424Z namespaces/openshift-ovn-kubernetes/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.954860175Z namespaces/openshift-ovn-kubernetes/coordination.k8s.io/leases/ovn-kubernetes-master.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.954971287Z namespaces/openshift-ovn-kubernetes/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.955005948Z namespaces/openshift-ovn-kubernetes/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.955235103Z namespaces/openshift-ovn-kubernetes/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.955342766Z namespaces/openshift-ovn-kubernetes/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.955669823Z namespaces/openshift-ovn-kubernetes/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.955800065Z namespaces/openshift-ovn-kubernetes/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.956294066Z namespaces/openshift-ovn-kubernetes/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.956410749Z namespaces/openshift-ovn-kubernetes/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.956563542Z namespaces/openshift-ovn-kubernetes/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.956618914Z namespaces/openshift-ovn-kubernetes/core/configmaps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.956668255Z namespaces/openshift-ovn-kubernetes/core/configmaps/ovnkube-config.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.956770277Z namespaces/openshift-ovn-kubernetes/core/configmaps/ovnkube-script-lib.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.9568882Z namespaces/openshift-ovn-kubernetes/core/serviceaccounts/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.95691641Z namespaces/openshift-ovn-kubernetes/core/serviceaccounts/ovn-kubernetes-control-plane.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.957030173Z namespaces/openshift-ovn-kubernetes/core/serviceaccounts/ovn-kubernetes-node.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.957075794Z namespaces/openshift-ovn-kubernetes/core/services/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.957109544Z namespaces/openshift-ovn-kubernetes/core/services/ovn-kubernetes-node.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.957166516Z namespaces/openshift-ovn-kubernetes/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.957219897Z namespaces/openshift-ovn-kubernetes/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.957290668Z namespaces/openshift-ovn-kubernetes/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.957327109Z namespaces/openshift-ovn-kubernetes/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.957395681Z namespaces/openshift-ovn-kubernetes/k8s.cni.cncf.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.957405661Z namespaces/openshift-ovn-kubernetes/k8s.cni.cncf.io/network-attachment-definitions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.957437772Z namespaces/openshift-ovn-kubernetes/k8s.cni.cncf.io/network-attachment-definitions/default.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.957495863Z namespaces/openshift-ovn-kubernetes/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.957530564Z namespaces/openshift-ovn-kubernetes/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.957616505Z namespaces/openshift-ovn-kubernetes/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.957695347Z namespaces/openshift-ovn-kubernetes/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.957756219Z namespaces/openshift-ovn-kubernetes/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.95779224Z namespaces/openshift-ovn-kubernetes/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.957849871Z namespaces/openshift-ovn-kubernetes/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.957886122Z namespaces/openshift-ovn-kubernetes/monitoring.coreos.com/prometheusrules/networking-rules.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.957965913Z namespaces/openshift-ovn-kubernetes/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.958003294Z namespaces/openshift-ovn-kubernetes/monitoring.coreos.com/servicemonitors/monitor-ovn-node.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.958061715Z namespaces/openshift-ovn-kubernetes/network.operator.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.958068586Z namespaces/openshift-ovn-kubernetes/network.operator.openshift.io/operatorpkis/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.958094726Z namespaces/openshift-ovn-kubernetes/network.operator.openshift.io/operatorpkis/ovn.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.958190848Z namespaces/openshift-ovn-kubernetes/network.operator.openshift.io/operatorpkis/signer.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.958230079Z namespaces/openshift-ovn-kubernetes/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.95827884Z namespaces/openshift-ovn-kubernetes/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.958425593Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.958437334Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.958472014Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.958622348Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.958802132Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.958939935Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.959156439Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.959360204Z namespaces/openshift-ovn-kubernetes/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.959370334Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.959457536Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/ovnkube-node-5s8lz.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.959661541Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/kube-rbac-proxy-node/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.959672461Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/kube-rbac-proxy-node/kube-rbac-proxy-node/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.959677911Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.959710522Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.959821124Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.959888106Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.959922006Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/kube-rbac-proxy-ovn-metrics/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.959934336Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.959939267Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.959959357Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.96007119Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960143651Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960182222Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/nbdb/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960192112Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/nbdb/nbdb/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960197372Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/nbdb/nbdb/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960228603Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/nbdb/nbdb/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960356056Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/nbdb/nbdb/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960413587Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/nbdb/nbdb/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960446878Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/northd/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960456008Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/northd/northd/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960459898Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/northd/northd/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960491039Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/northd/northd/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960599571Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/northd/northd/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960675023Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/northd/northd/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960701184Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/ovn-acl-logging/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960714204Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/ovn-acl-logging/ovn-acl-logging/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960723954Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/ovn-acl-logging/ovn-acl-logging/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960754915Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/ovn-acl-logging/ovn-acl-logging/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960846097Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/ovn-acl-logging/ovn-acl-logging/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960897938Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/ovn-controller/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960904948Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/ovn-controller/ovn-controller/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960908968Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/ovn-controller/ovn-controller/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.960952459Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/ovn-controller/ovn-controller/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.961227765Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/ovn-controller/ovn-controller/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.961284436Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/ovn-controller/ovn-controller/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.961332687Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/ovnkube-controller/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.961345738Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/ovnkube-controller/ovnkube-controller/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.961352498Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/ovnkube-controller/ovnkube-controller/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.961382368Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/ovnkube-controller/ovnkube-controller/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963002074Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/ovnkube-controller/ovnkube-controller/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963070076Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/ovnkube-controller/ovnkube-controller/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963148718Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/sbdb/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963158688Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/sbdb/sbdb/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963164698Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/sbdb/sbdb/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963176468Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/sbdb/sbdb/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963313751Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/sbdb/sbdb/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963383883Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-5s8lz/sbdb/sbdb/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963428744Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963498165Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/ovnkube-node-hvbkx.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963653469Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/kube-rbac-proxy-node/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963663919Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/kube-rbac-proxy-node/kube-rbac-proxy-node/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963681369Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963694559Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963802352Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963870013Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963914364Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/kube-rbac-proxy-ovn-metrics/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963924224Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963941845Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.963951855Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.964068608Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.964133319Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.96417556Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/nbdb/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.96418542Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/nbdb/nbdb/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.96419136Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/nbdb/nbdb/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.96420023Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/nbdb/nbdb/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.964349674Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/nbdb/nbdb/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.964396965Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/nbdb/nbdb/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.964439146Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/northd/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.964447856Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/northd/northd/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.964455876Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/northd/northd/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.964464756Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/northd/northd/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.964585279Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/northd/northd/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.96465264Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/northd/northd/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.964672751Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/ovn-acl-logging/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.964682031Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/ovn-acl-logging/ovn-acl-logging/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.964689451Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/ovn-acl-logging/ovn-acl-logging/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.964729742Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/ovn-acl-logging/ovn-acl-logging/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.964829075Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/ovn-acl-logging/ovn-acl-logging/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.964870265Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/ovn-controller/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.964880225Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/ovn-controller/ovn-controller/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.964885456Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/ovn-controller/ovn-controller/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.964931467Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/ovn-controller/ovn-controller/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.965183942Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/ovn-controller/ovn-controller/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.965254204Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/ovn-controller/ovn-controller/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.965376876Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/ovnkube-controller/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.965391297Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/ovnkube-controller/ovnkube-controller/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.965396327Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/ovnkube-controller/ovnkube-controller/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.965419668Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/ovnkube-controller/ovnkube-controller/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.96688728Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/ovnkube-controller/ovnkube-controller/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.966955551Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/ovnkube-controller/ovnkube-controller/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.967001262Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/sbdb/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.967009212Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/sbdb/sbdb/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.967013973Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/sbdb/sbdb/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.967025463Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/sbdb/sbdb/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.967134535Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/sbdb/sbdb/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.967202407Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-hvbkx/sbdb/sbdb/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.967309349Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.968063166Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/ovnkube-node-zqxhn.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.968227599Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/kube-rbac-proxy-node/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.96824346Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/kube-rbac-proxy-node/kube-rbac-proxy-node/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.96825062Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.96828372Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.968422974Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.968488115Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.968526086Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/kube-rbac-proxy-ovn-metrics/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.968535046Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.968540856Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.968575057Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.96870403Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.968774281Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.968819822Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/nbdb/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.968829492Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/nbdb/nbdb/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.968834273Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/nbdb/nbdb/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.968865403Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/nbdb/nbdb/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.968967335Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/nbdb/nbdb/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.969036347Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/nbdb/nbdb/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.969076698Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/northd/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.969084248Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/northd/northd/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.969088148Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/northd/northd/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.969125219Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/northd/northd/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.969228401Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/northd/northd/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.969319473Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/northd/northd/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.969361444Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/ovn-acl-logging/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.969368394Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/ovn-acl-logging/ovn-acl-logging/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.969372164Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/ovn-acl-logging/ovn-acl-logging/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.969407895Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/ovn-acl-logging/ovn-acl-logging/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.969496057Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/ovn-acl-logging/ovn-acl-logging/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.969587159Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/ovn-controller/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.969597929Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/ovn-controller/ovn-controller/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.96960391Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/ovn-controller/ovn-controller/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.96961374Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/ovn-controller/ovn-controller/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.969985988Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/ovn-controller/ovn-controller/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.9700853Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/ovn-controller/ovn-controller/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.970110651Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/ovnkube-controller/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.970118011Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/ovnkube-controller/ovnkube-controller/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.970123981Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/ovnkube-controller/ovnkube-controller/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.970196073Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/ovnkube-controller/ovnkube-controller/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.972192357Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/ovnkube-controller/ovnkube-controller/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.972238918Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/ovnkube-controller/ovnkube-controller/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.972296009Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/sbdb/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.972307289Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/sbdb/sbdb/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.972313309Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/sbdb/sbdb/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.97235763Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/sbdb/sbdb/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.972463443Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/sbdb/sbdb/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.972555005Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-zqxhn/sbdb/sbdb/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.972615256Z namespaces/openshift-ovn-kubernetes/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.972654927Z namespaces/openshift-ovn-kubernetes/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.972733599Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.972743799Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.97279893Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/rolebindings/openshift-ovn-kubernetes-control-plane-limited.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.972900572Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/rolebindings/openshift-ovn-kubernetes-nodes-identity-limited.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.973046125Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/rolebindings/prometheus-k8s.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.973103877Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.973163508Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/roles/openshift-ovn-kubernetes-control-plane-limited.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.973287611Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/roles/openshift-ovn-kubernetes-node-limited.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.973475155Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/roles/prometheus-k8s.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.973514256Z namespaces/openshift-ovn-kubernetes/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.973568867Z namespaces/openshift-ovn-kubernetes/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.973617168Z namespaces/openshift-route-controller-manager/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.973624548Z namespaces/openshift-route-controller-manager/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.973628688Z namespaces/openshift-route-controller-manager/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.973669749Z namespaces/openshift-route-controller-manager/coordination.k8s.io/leases/openshift-route-controllers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.97372079Z namespaces/openshift-route-controller-manager/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.973737501Z namespaces/openshift-route-controller-manager/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.973789762Z namespaces/openshift-route-controller-manager/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.974014937Z namespaces/openshift-route-controller-manager/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.974285343Z namespaces/openshift-route-controller-manager/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.974459507Z namespaces/openshift-route-controller-manager/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.974736073Z namespaces/openshift-route-controller-manager/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.974945717Z namespaces/openshift-service-ca-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.974981448Z namespaces/openshift-service-ca-operator/openshift-service-ca-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.9750617Z namespaces/openshift-service-ca-operator/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.975093951Z namespaces/openshift-service-ca-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.975166542Z namespaces/openshift-service-ca-operator/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.975200403Z namespaces/openshift-service-ca-operator/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.975337796Z namespaces/openshift-service-ca-operator/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.975464749Z namespaces/openshift-service-ca-operator/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.975569411Z namespaces/openshift-service-ca-operator/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.975764145Z namespaces/openshift-service-ca-operator/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.975781566Z namespaces/openshift-service-ca-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.975845097Z namespaces/openshift-service-ca-operator/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.975879198Z namespaces/openshift-service-ca-operator/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.97596421Z namespaces/openshift-service-ca-operator/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.976050322Z namespaces/openshift-service-ca-operator/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.976113263Z namespaces/openshift-service-ca-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.976175414Z namespaces/openshift-service-ca-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.976230186Z namespaces/openshift-service-ca-operator/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.976244846Z namespaces/openshift-service-ca-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.976283417Z namespaces/openshift-service-ca-operator/coordination.k8s.io/leases/service-ca-operator-lock.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.976374279Z namespaces/openshift-service-ca-operator/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.9764146Z namespaces/openshift-service-ca-operator/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.976545102Z namespaces/openshift-service-ca-operator/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.976630955Z namespaces/openshift-service-ca-operator/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.976822899Z namespaces/openshift-service-ca-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.976902641Z namespaces/openshift-service-ca-operator/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.977032313Z namespaces/openshift-service-ca-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.977155876Z namespaces/openshift-service-ca-operator/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.977384141Z namespaces/openshift-service-ca-operator/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.977436812Z namespaces/openshift-service-ca-operator/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.977483033Z namespaces/openshift-service-ca-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.977536884Z namespaces/openshift-service-ca-operator/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.977598066Z namespaces/openshift-service-ca-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.977654947Z namespaces/openshift-service-ca-operator/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.977702718Z namespaces/openshift-service-ca-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.977819971Z namespaces/openshift-service-ca-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.977900612Z namespaces/openshift-service-ca-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.977941003Z namespaces/openshift-service-ca-operator/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.978000375Z namespaces/openshift-service-ca-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.978035025Z namespaces/openshift-service-ca-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.978084387Z namespaces/openshift-service-ca-operator/monitoring.coreos.com/servicemonitors/service-ca-operator.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.978148238Z namespaces/openshift-service-ca-operator/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.978178598Z namespaces/openshift-service-ca-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.978220619Z namespaces/openshift-service-ca-operator/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.97822958Z namespaces/openshift-service-ca-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.978281581Z namespaces/openshift-service-ca-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.978447195Z namespaces/openshift-service-ca-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.978627479Z namespaces/openshift-service-ca-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.978764311Z namespaces/openshift-service-ca-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.978992067Z namespaces/openshift-service-ca-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.9791813Z namespaces/openshift-service-ca-operator/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.979188751Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-7695fc6c8c-jt9jc/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.979239962Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-7695fc6c8c-jt9jc/service-ca-operator-7695fc6c8c-jt9jc.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.979359604Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-7695fc6c8c-jt9jc/service-ca-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.979387165Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-7695fc6c8c-jt9jc/service-ca-operator/service-ca-operator/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.979393915Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-7695fc6c8c-jt9jc/service-ca-operator/service-ca-operator/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.979401096Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-7695fc6c8c-jt9jc/service-ca-operator/service-ca-operator/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.979570319Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-7695fc6c8c-jt9jc/service-ca-operator/service-ca-operator/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.979726993Z namespaces/openshift-service-ca-operator/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.979765673Z namespaces/openshift-service-ca-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.979818435Z namespaces/openshift-service-ca-operator/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.979850505Z namespaces/openshift-service-ca-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.979899487Z namespaces/openshift-service-ca/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.979947977Z namespaces/openshift-service-ca/openshift-service-ca.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.980004859Z namespaces/openshift-service-ca/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.980035939Z namespaces/openshift-service-ca/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.980099451Z namespaces/openshift-service-ca/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.980141782Z namespaces/openshift-service-ca/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.980250334Z namespaces/openshift-service-ca/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.980395147Z namespaces/openshift-service-ca/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.98050984Z namespaces/openshift-service-ca/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.980562311Z namespaces/openshift-service-ca/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.980616212Z namespaces/openshift-service-ca/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.980670053Z namespaces/openshift-service-ca/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.980724675Z namespaces/openshift-service-ca/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.980821977Z namespaces/openshift-service-ca/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.980874568Z namespaces/openshift-service-ca/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.980928939Z namespaces/openshift-service-ca/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.981020661Z namespaces/openshift-service-ca/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.981091413Z namespaces/openshift-service-ca/coordination.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.981103783Z namespaces/openshift-service-ca/coordination.k8s.io/leases/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.981135124Z namespaces/openshift-service-ca/coordination.k8s.io/leases/service-ca-controller-lock.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.981198375Z namespaces/openshift-service-ca/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.981245606Z namespaces/openshift-service-ca/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.98139654Z namespaces/openshift-service-ca/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.981487411Z namespaces/openshift-service-ca/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.981616734Z namespaces/openshift-service-ca/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.981713076Z namespaces/openshift-service-ca/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.98185449Z namespaces/openshift-service-ca/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.982005643Z namespaces/openshift-service-ca/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.982205417Z namespaces/openshift-service-ca/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.982280159Z namespaces/openshift-service-ca/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.982349401Z namespaces/openshift-service-ca/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.982401482Z namespaces/openshift-service-ca/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.982456473Z namespaces/openshift-service-ca/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.982496214Z namespaces/openshift-service-ca/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.982537735Z namespaces/openshift-service-ca/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.982639177Z namespaces/openshift-service-ca/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.982729729Z namespaces/openshift-service-ca/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.9827659Z namespaces/openshift-service-ca/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.982829261Z namespaces/openshift-service-ca/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.982864912Z namespaces/openshift-service-ca/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.982930103Z namespaces/openshift-service-ca/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.982964944Z namespaces/openshift-service-ca/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.982973684Z namespaces/openshift-service-ca/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.983027575Z namespaces/openshift-service-ca/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.983200299Z namespaces/openshift-service-ca/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.983429634Z namespaces/openshift-service-ca/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.983576068Z namespaces/openshift-service-ca/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.983771392Z namespaces/openshift-service-ca/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.983942565Z namespaces/openshift-service-ca/pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.983950836Z namespaces/openshift-service-ca/pods/service-ca-79f68b9f4f-b8vj2/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.983987977Z namespaces/openshift-service-ca/pods/service-ca-79f68b9f4f-b8vj2/service-ca-79f68b9f4f-b8vj2.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.984067948Z namespaces/openshift-service-ca/pods/service-ca-79f68b9f4f-b8vj2/service-ca-controller/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.984074999Z namespaces/openshift-service-ca/pods/service-ca-79f68b9f4f-b8vj2/service-ca-controller/service-ca-controller/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.984078999Z namespaces/openshift-service-ca/pods/service-ca-79f68b9f4f-b8vj2/service-ca-controller/service-ca-controller/logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.984116229Z namespaces/openshift-service-ca/pods/service-ca-79f68b9f4f-b8vj2/service-ca-controller/service-ca-controller/logs/current.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.984368105Z namespaces/openshift-service-ca/pods/service-ca-79f68b9f4f-b8vj2/service-ca-controller/service-ca-controller/logs/previous.insecure.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.984459397Z namespaces/openshift-service-ca/pods/service-ca-79f68b9f4f-b8vj2/service-ca-controller/service-ca-controller/logs/previous.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.984506778Z namespaces/openshift-service-ca/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.984553549Z namespaces/openshift-service-ca/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.98460151Z namespaces/openshift-service-ca/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.984644761Z namespaces/openshift-service-ca/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.984691782Z namespaces/openshift-user-workload-monitoring/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.984750403Z namespaces/openshift-user-workload-monitoring/openshift-user-workload-monitoring.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.984801024Z namespaces/openshift-user-workload-monitoring/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.984852846Z namespaces/openshift-user-workload-monitoring/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.984902767Z namespaces/openshift-user-workload-monitoring/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.984946638Z namespaces/openshift-user-workload-monitoring/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.985027129Z namespaces/openshift-user-workload-monitoring/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.985105161Z namespaces/openshift-user-workload-monitoring/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.985186123Z namespaces/openshift-user-workload-monitoring/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.985233704Z namespaces/openshift-user-workload-monitoring/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.985300086Z namespaces/openshift-user-workload-monitoring/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.985372017Z namespaces/openshift-user-workload-monitoring/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.985418848Z namespaces/openshift-user-workload-monitoring/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.98549656Z namespaces/openshift-user-workload-monitoring/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.985548581Z namespaces/openshift-user-workload-monitoring/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.985589992Z namespaces/openshift-user-workload-monitoring/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.985672194Z namespaces/openshift-user-workload-monitoring/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.985717585Z namespaces/openshift-user-workload-monitoring/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.985777466Z namespaces/openshift-user-workload-monitoring/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.985879618Z namespaces/openshift-user-workload-monitoring/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.98595988Z namespaces/openshift-user-workload-monitoring/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.986033222Z namespaces/openshift-user-workload-monitoring/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.986114533Z namespaces/openshift-user-workload-monitoring/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.986196935Z namespaces/openshift-user-workload-monitoring/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.986344818Z namespaces/openshift-user-workload-monitoring/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.986508052Z namespaces/openshift-user-workload-monitoring/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.986564403Z namespaces/openshift-user-workload-monitoring/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.986602774Z namespaces/openshift-user-workload-monitoring/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.986653315Z namespaces/openshift-user-workload-monitoring/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.986687556Z namespaces/openshift-user-workload-monitoring/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.986741017Z namespaces/openshift-user-workload-monitoring/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.986776108Z namespaces/openshift-user-workload-monitoring/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.98686147Z namespaces/openshift-user-workload-monitoring/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.986962262Z namespaces/openshift-user-workload-monitoring/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.986976292Z namespaces/openshift-user-workload-monitoring/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.987033053Z namespaces/openshift-user-workload-monitoring/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.987064894Z namespaces/openshift-user-workload-monitoring/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.987105995Z namespaces/openshift-user-workload-monitoring/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.987157196Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.987164307Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.987202317Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.987379301Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.987559345Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.987696758Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.987904883Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.988192929Z namespaces/openshift-user-workload-monitoring/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.9882212Z namespaces/openshift-user-workload-monitoring/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.988284581Z namespaces/openshift-user-workload-monitoring/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.988352673Z namespaces/openshift-user-workload-monitoring/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.988391823Z namespaces/openshift/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.988442275Z namespaces/openshift/openshift.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.988488496Z namespaces/openshift/apps.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.988523326Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.988584578Z namespaces/openshift/apps/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.988611538Z namespaces/openshift/apps/daemonsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.98870301Z namespaces/openshift/apps/deployments.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.988781542Z namespaces/openshift/apps/replicasets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.988870624Z namespaces/openshift/apps/statefulsets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.988952026Z namespaces/openshift/autoscaling/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.988990957Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.989030258Z namespaces/openshift/batch/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.989068558Z namespaces/openshift/batch/cronjobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.9891542Z namespaces/openshift/batch/jobs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.989189921Z namespaces/openshift/build.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.989240002Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.989354865Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.989387125Z namespaces/openshift/core/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.989428016Z namespaces/openshift/core/configmaps.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.989530679Z namespaces/openshift/core/endpoints.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.98960914Z namespaces/openshift/core/events.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.989689132Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.989788124Z namespaces/openshift/core/pods.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.989863986Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.989987459Z namespaces/openshift/core/secrets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.990156433Z namespaces/openshift/core/services.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.990194113Z namespaces/openshift/discovery.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.990247175Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.990319646Z namespaces/openshift/image.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.990352607Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.991607014Z namespaces/openshift/image.openshift.io/imagestreams/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.991638985Z namespaces/openshift/image.openshift.io/imagestreams/cli-artifacts.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.991742507Z namespaces/openshift/image.openshift.io/imagestreams/cli.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.991831439Z namespaces/openshift/image.openshift.io/imagestreams/dotnet-runtime.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.991935312Z namespaces/openshift/image.openshift.io/imagestreams/dotnet.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.992041784Z namespaces/openshift/image.openshift.io/imagestreams/driver-toolkit.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.992126486Z namespaces/openshift/image.openshift.io/imagestreams/fuse7-eap-openshift-java11.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.99230057Z namespaces/openshift/image.openshift.io/imagestreams/fuse7-eap-openshift.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.992481684Z namespaces/openshift/image.openshift.io/imagestreams/fuse7-java-openshift.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.992618527Z namespaces/openshift/image.openshift.io/imagestreams/fuse7-java11-openshift.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.992714849Z namespaces/openshift/image.openshift.io/imagestreams/fuse7-karaf-openshift-jdk11.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.992807151Z namespaces/openshift/image.openshift.io/imagestreams/fuse7-karaf-openshift.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.992934424Z namespaces/openshift/image.openshift.io/imagestreams/golang.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.993042106Z namespaces/openshift/image.openshift.io/imagestreams/httpd.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.993169529Z namespaces/openshift/image.openshift.io/imagestreams/installer-artifacts.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.993279921Z namespaces/openshift/image.openshift.io/imagestreams/installer.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.993414184Z namespaces/openshift/image.openshift.io/imagestreams/java-runtime.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.993522737Z namespaces/openshift/image.openshift.io/imagestreams/java.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.993640339Z namespaces/openshift/image.openshift.io/imagestreams/jboss-datagrid73-openshift.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.993770672Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap-xp3-openjdk11-openshift.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.993863494Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap-xp3-openjdk11-runtime-openshift.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.993964796Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap-xp4-openjdk11-openshift.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.994067219Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap-xp4-openjdk11-runtime-openshift.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.994165491Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap74-openjdk11-openshift.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.994279663Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap74-openjdk11-runtime-openshift.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.994393716Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap74-openjdk8-openshift.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.994481238Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap74-openjdk8-runtime-openshift.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.99457304Z namespaces/openshift/image.openshift.io/imagestreams/jboss-webserver57-openjdk11-tomcat9-openshift-ubi8.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.994697273Z namespaces/openshift/image.openshift.io/imagestreams/jboss-webserver57-openjdk8-tomcat9-openshift-ubi8.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.994799745Z namespaces/openshift/image.openshift.io/imagestreams/jenkins-agent-base.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.994896337Z namespaces/openshift/image.openshift.io/imagestreams/jenkins.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.9950337Z namespaces/openshift/image.openshift.io/imagestreams/mariadb.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.995139162Z namespaces/openshift/image.openshift.io/imagestreams/must-gather.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.995228014Z namespaces/openshift/image.openshift.io/imagestreams/mysql.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.995364557Z namespaces/openshift/image.openshift.io/imagestreams/network-tools.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.995466599Z namespaces/openshift/image.openshift.io/imagestreams/nginx.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.995589802Z namespaces/openshift/image.openshift.io/imagestreams/nodejs.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.995735775Z namespaces/openshift/image.openshift.io/imagestreams/oauth-proxy.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.995826527Z namespaces/openshift/image.openshift.io/imagestreams/openjdk-11-rhel7.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.99594762Z namespaces/openshift/image.openshift.io/imagestreams/perl.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.996051252Z namespaces/openshift/image.openshift.io/imagestreams/php.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.996163775Z namespaces/openshift/image.openshift.io/imagestreams/postgresql.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.996329978Z namespaces/openshift/image.openshift.io/imagestreams/postgresql13-for-sso75-openshift-rhel8.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.99641792Z namespaces/openshift/image.openshift.io/imagestreams/postgresql13-for-sso76-openshift-rhel8.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.996514162Z namespaces/openshift/image.openshift.io/imagestreams/python.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.996635185Z namespaces/openshift/image.openshift.io/imagestreams/redhat-openjdk18-openshift.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.996770198Z namespaces/openshift/image.openshift.io/imagestreams/redis.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.99686736Z namespaces/openshift/image.openshift.io/imagestreams/ruby.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.996981083Z namespaces/openshift/image.openshift.io/imagestreams/sso75-openshift-rhel8.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.997078315Z namespaces/openshift/image.openshift.io/imagestreams/sso76-openshift-rhel8.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.997173687Z namespaces/openshift/image.openshift.io/imagestreams/tests.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.997277959Z namespaces/openshift/image.openshift.io/imagestreams/tools.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.997419182Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-11-runtime.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.997540235Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-11.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.997651098Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-17-runtime.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.99777605Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-17.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.997893233Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-21-runtime.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.997997465Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-21.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.998091707Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-8-runtime.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.998332033Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-8.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.998420715Z namespaces/openshift/k8s.ovn.org/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.998449175Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.998539667Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.998621149Z namespaces/openshift/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.99866964Z namespaces/openshift/monitoring.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.998712901Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.998747862Z namespaces/openshift/networking.k8s.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.998798383Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.998838664Z namespaces/openshift/operators.coreos.com/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.998845214Z namespaces/openshift/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.998894215Z namespaces/openshift/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.999045648Z namespaces/openshift/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.999217952Z namespaces/openshift/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.999384946Z namespaces/openshift/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.99959459Z namespaces/openshift/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.999795805Z namespaces/openshift/policy/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.999812195Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.999883617Z namespaces/openshift/route.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.999927638Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.999961569Z namespaces/openshift/template.openshift.io/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:00.999970479Z namespaces/openshift/template.openshift.io/templates/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.00000305Z namespaces/openshift/template.openshift.io/templates/cache-service.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.000129012Z namespaces/openshift/template.openshift.io/templates/cakephp-mysql-example.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.000254165Z namespaces/openshift/template.openshift.io/templates/cakephp-mysql-persistent.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.000389298Z namespaces/openshift/template.openshift.io/templates/dancer-mysql-example.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.000507561Z namespaces/openshift/template.openshift.io/templates/dancer-mysql-persistent.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.000678154Z namespaces/openshift/template.openshift.io/templates/datagrid-service.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.000783247Z namespaces/openshift/template.openshift.io/templates/django-psql-example.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.000897559Z namespaces/openshift/template.openshift.io/templates/django-psql-persistent.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.001006012Z namespaces/openshift/template.openshift.io/templates/eap-xp3-basic-s2i.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.001123214Z namespaces/openshift/template.openshift.io/templates/eap-xp4-basic-s2i.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.001240667Z namespaces/openshift/template.openshift.io/templates/eap74-basic-s2i.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.001455111Z namespaces/openshift/template.openshift.io/templates/eap74-https-s2i.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.001586124Z namespaces/openshift/template.openshift.io/templates/eap74-sso-s2i.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.001726757Z namespaces/openshift/template.openshift.io/templates/httpd-example.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.00184163Z namespaces/openshift/template.openshift.io/templates/jenkins-ephemeral-monitored.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.001962653Z namespaces/openshift/template.openshift.io/templates/jenkins-ephemeral.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.002069025Z namespaces/openshift/template.openshift.io/templates/jenkins-persistent-monitored.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.002192618Z namespaces/openshift/template.openshift.io/templates/jenkins-persistent.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.002323881Z namespaces/openshift/template.openshift.io/templates/jws57-openjdk11-tomcat9-ubi8-basic-s2i.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.002441853Z namespaces/openshift/template.openshift.io/templates/jws57-openjdk11-tomcat9-ubi8-https-s2i.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.002551066Z namespaces/openshift/template.openshift.io/templates/jws57-openjdk8-tomcat9-ubi8-basic-s2i.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.002653838Z namespaces/openshift/template.openshift.io/templates/jws57-openjdk8-tomcat9-ubi8-https-s2i.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.00274946Z namespaces/openshift/template.openshift.io/templates/mariadb-ephemeral.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.002882773Z namespaces/openshift/template.openshift.io/templates/mariadb-persistent.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.002984945Z namespaces/openshift/template.openshift.io/templates/mysql-ephemeral.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.003090038Z namespaces/openshift/template.openshift.io/templates/mysql-persistent.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.00318784Z namespaces/openshift/template.openshift.io/templates/nginx-example.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.003321852Z namespaces/openshift/template.openshift.io/templates/nodejs-postgresql-example.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.003437035Z namespaces/openshift/template.openshift.io/templates/nodejs-postgresql-persistent.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.003548668Z namespaces/openshift/template.openshift.io/templates/openjdk-web-basic-s2i.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.00364988Z namespaces/openshift/template.openshift.io/templates/postgresql-ephemeral.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.003749562Z namespaces/openshift/template.openshift.io/templates/postgresql-persistent.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.003852914Z namespaces/openshift/template.openshift.io/templates/rails-pgsql-persistent.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.003977547Z namespaces/openshift/template.openshift.io/templates/rails-postgresql-example.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.00409702Z namespaces/openshift/template.openshift.io/templates/react-web-app-example.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.004199652Z namespaces/openshift/template.openshift.io/templates/redis-ephemeral.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.004327345Z namespaces/openshift/template.openshift.io/templates/redis-persistent.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.004437477Z namespaces/openshift/template.openshift.io/templates/s2i-fuse712-spring-boot-2-camel-rest-3scale.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.00455349Z namespaces/openshift/template.openshift.io/templates/s2i-fuse712-spring-boot-2-camel-xml.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.004660302Z namespaces/openshift/template.openshift.io/templates/s2i-fuse712-spring-boot-2-camel.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.004751794Z namespaces/openshift/template.openshift.io/templates/sso75-https.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.004885667Z namespaces/openshift/template.openshift.io/templates/sso75-ocp4-x509-https.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.004999049Z namespaces/openshift/template.openshift.io/templates/sso75-ocp4-x509-postgresql-persistent.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.005125912Z namespaces/openshift/template.openshift.io/templates/sso75-postgresql-persistent.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.005253375Z namespaces/openshift/template.openshift.io/templates/sso75-postgresql.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.005401058Z namespaces/openshift/template.openshift.io/templates/sso76-ocp4-https.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.005554122Z namespaces/openshift/template.openshift.io/templates/sso76-ocp4-postgresql-persistent.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.005672134Z namespaces/openshift/template.openshift.io/templates/sso76-ocp4-postgresql.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.005811867Z namespaces/openshift/template.openshift.io/templates/sso76-ocp4-x509-https.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.00592606Z namespaces/openshift/template.openshift.io/templates/sso76-ocp4-x509-postgresql-persistent.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.006011202Z network_logs/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.006043083Z network_logs/cluster_scale [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.006138365Z network_logs/ippools.whereabouts.cni.cncf.io [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.006214996Z network_logs/multi-networkpolicy [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.006316338Z network_logs/net-attach-def [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.006414371Z network_logs/overlappingrangeipreservations.whereabouts.cni.cncf.io [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.006551114Z network_logs/ovn_kubernetes_top_pods [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.006644096Z network_logs/ovnk_database_store.tar.gz [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.009082169Z nodes/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.0091026Z nodes/debug [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.009196612Z nodes/ip-10-0-140-224.ec2.internal/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.009249443Z nodes/ip-10-0-140-224.ec2.internal/cpu_affinities.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.0095702Z nodes/ip-10-0-140-224.ec2.internal/dmesg [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.009868317Z nodes/ip-10-0-140-224.ec2.internal/ethtool_channels [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.009944969Z nodes/ip-10-0-140-224.ec2.internal/ethtool_features [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.010035751Z nodes/ip-10-0-140-224.ec2.internal/ip-10-0-140-224.ec2.internal_logs_kubelet.gz [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.010521181Z nodes/ip-10-0-140-224.ec2.internal/irq_affinities.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.010666564Z nodes/ip-10-0-140-224.ec2.internal/lscpu [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.010797747Z nodes/ip-10-0-140-224.ec2.internal/lspci [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.010888369Z nodes/ip-10-0-140-224.ec2.internal/podresources.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.010995552Z nodes/ip-10-0-140-224.ec2.internal/pods_info.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.011108704Z nodes/ip-10-0-140-224.ec2.internal/proc_cmdline [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.011190116Z nodes/ip-10-0-140-224.ec2.internal/sysinfo.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.012971805Z nodes/ip-10-0-140-224.ec2.internal/sysinfo.tgz [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.013161879Z nodes/ip-10-0-141-82.ec2.internal/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.01319757Z nodes/ip-10-0-141-82.ec2.internal/cpu_affinities.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.013513207Z nodes/ip-10-0-141-82.ec2.internal/dmesg [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.013794653Z nodes/ip-10-0-141-82.ec2.internal/ethtool_channels [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.013877805Z nodes/ip-10-0-141-82.ec2.internal/ethtool_features [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.013965357Z nodes/ip-10-0-141-82.ec2.internal/ip-10-0-141-82.ec2.internal_logs_kubelet.gz [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.014445457Z nodes/ip-10-0-141-82.ec2.internal/irq_affinities.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.014602821Z nodes/ip-10-0-141-82.ec2.internal/lscpu [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.014727434Z nodes/ip-10-0-141-82.ec2.internal/lspci [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.014814276Z nodes/ip-10-0-141-82.ec2.internal/podresources.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.014922488Z nodes/ip-10-0-141-82.ec2.internal/pods_info.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.015044141Z nodes/ip-10-0-141-82.ec2.internal/proc_cmdline [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.015126363Z nodes/ip-10-0-141-82.ec2.internal/sysinfo.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.01683072Z nodes/ip-10-0-141-82.ec2.internal/sysinfo.tgz [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.016988753Z nodes/ip-10-0-143-79.ec2.internal/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.017005294Z nodes/ip-10-0-143-79.ec2.internal/cpu_affinities.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.017451704Z nodes/ip-10-0-143-79.ec2.internal/dmesg [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.017682459Z nodes/ip-10-0-143-79.ec2.internal/ethtool_channels [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.017773231Z nodes/ip-10-0-143-79.ec2.internal/ethtool_features [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.017855413Z nodes/ip-10-0-143-79.ec2.internal/ip-10-0-143-79.ec2.internal_logs_kubelet.gz [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.018279522Z nodes/ip-10-0-143-79.ec2.internal/irq_affinities.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.018420305Z nodes/ip-10-0-143-79.ec2.internal/lscpu [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.018548728Z nodes/ip-10-0-143-79.ec2.internal/lspci [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.01862583Z nodes/ip-10-0-143-79.ec2.internal/podresources.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.018738202Z nodes/ip-10-0-143-79.ec2.internal/pods_info.json [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.018861695Z nodes/ip-10-0-143-79.ec2.internal/proc_cmdline [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.018945977Z nodes/ip-10-0-143-79.ec2.internal/sysinfo.log [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.020748907Z nodes/ip-10-0-143-79.ec2.internal/sysinfo.tgz [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.02090875Z pod_network_connectivity_check/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.020960071Z pod_network_connectivity_check/podnetworkconnectivitychecks.yaml [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.021059743Z static-pods/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.021069063Z static-pods/kube-apiserver/ [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.030117253Z [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.030134633Z sent 71,389 bytes received 8,224,602 bytes 5,530,660.67 bytes/sec [must-gather] [must-gather-t6bfs] OUT 2026-07-09T19:24:01.030140153Z total size is 94,118,398 speedup is 11.35 [must-gather] [must-gather ] OUT 2026-07-09T19:24:01.359568351Z namespace/openshift-must-gather-vv9mp deleted [must-gather] [must-gather] [must-gather] Reprinting Cluster State: [must-gather] When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: [must-gather] ClusterID: d780227f-8ab6-4179-a738-9e6ca489c19d [must-gather] ClientVersion: 4.21.10 [must-gather] ClusterVersion: Stable at "4.21.24" [must-gather] ClusterOperators: [must-gather] clusteroperator/authentication is missing [must-gather] clusteroperator/cloud-credential is missing [must-gather] clusteroperator/cluster-autoscaler is missing [must-gather] clusteroperator/config-operator is missing [must-gather] clusteroperator/etcd is missing [must-gather] clusteroperator/machine-api is missing [must-gather] clusteroperator/machine-approver is missing [must-gather] clusteroperator/machine-config is missing [must-gather] clusteroperator/marketplace is missing [must-gather] [must-gather] [git-push-artifacts] WORK_DIR: /workspace/odh-ci-artifacts [git-push-artifacts] REPO_PATH: opendatahub-io/odh-build-metadata [git-push-artifacts] REPO_BRANCH: ci-artifacts [git-push-artifacts] SPARSE_FILE_PATH: test-artifacts/docs [git-push-artifacts] SOURCE_PATH: /workspace/artifacts-dir [git-push-artifacts] DEST_PATH: test-artifacts/kserve-group-test-bk8jh [git-push-artifacts] ALWAYS_PASS: false [git-push-artifacts] configuring gh token [git-push-artifacts] taking github token from Konflux bot [git-push-artifacts] Initialized empty Git repository in /workspace/odh-ci-artifacts/.git/ [git-push-artifacts] Using partial fetch with sparse checkout for: test-artifacts/docs [git-push-artifacts] From https://github.com/opendatahub-io/odh-build-metadata [git-push-artifacts] * branch ci-artifacts -> FETCH_HEAD [git-push-artifacts] * [new branch] ci-artifacts -> origin/ci-artifacts [git-push-artifacts] Already on 'ci-artifacts' [git-push-artifacts] branch 'ci-artifacts' set up to track 'origin/ci-artifacts'. [git-push-artifacts] TASK_NAME=kserve-group-test-bk8jh-e2e-llm-inference-service [git-push-artifacts] PIPELINERUN_NAME=kserve-group-test-bk8jh [git-push-artifacts] From https://github.com/opendatahub-io/odh-build-metadata [git-push-artifacts] * branch ci-artifacts -> FETCH_HEAD [git-push-artifacts] Already up to date. [git-push-artifacts] -rw-r--r--. 1 root 1001540000 15655026 Jul 9 19:25 /workspace/odh-ci-artifacts/test-artifacts/kserve-group-test-bk8jh/e2e-llm-inference-service.tar.gz [git-push-artifacts] [ci-artifacts 337250a] Updating CI Artifacts in e2e-llm-inference-service [git-push-artifacts] 1 file changed, 0 insertions(+), 0 deletions(-) [git-push-artifacts] create mode 100644 test-artifacts/kserve-group-test-bk8jh/e2e-llm-inference-service.tar.gz [git-push-artifacts] From https://github.com/opendatahub-io/odh-build-metadata [git-push-artifacts] * branch ci-artifacts -> FETCH_HEAD [git-push-artifacts] Already up to date. [git-push-artifacts] To https://github.com/opendatahub-io/odh-build-metadata.git [git-push-artifacts] 92c5ba6..337250a ci-artifacts -> ci-artifacts [fail-if-needed] Failing pipeline because deploy-and-e2e step failed container step-fail-if-needed has failed : [{"key":"StartedAt","value":"2026-07-09T19:25:35.223Z","type":3}]