task e2e-llm-inference-service has failed: "step-fail-if-needed" exited with code 1: Error [get-kubeconfig] Found kubeconfig secret: cluster-mhdwj-admin-kubeconfig [get-kubeconfig] Wrote kubeconfig to /credentials/cluster-mhdwj-kubeconfig [get-kubeconfig] Found admin password secret: cluster-mhdwj-admin-password [get-kubeconfig] Retrieved username [get-kubeconfig] Wrote password to /credentials/cluster-mhdwj-password [get-kubeconfig] API Server URL: https://aa419ce991be54aee901e5aa7e5ab1f5-21a7125f3e1aac29.elb.us-east-1.amazonaws.com:6443 [get-kubeconfig] Console URL: https://console-openshift-console.apps.ca20abe1-5548-4ad5-9c4c-15adf1b57b25.prod.konfluxeaas.com [clone-repo] feat/rhoaieng-73454-upstream-version-image-params [clone-repo] https://github.com/KillianGolds/kserve-fork [clone-repo] Cloning into '/workspace/source'... [clone-repo] Updating files: 86% (2673/3107) Updating files: 87% (2704/3107) Updating files: 88% (2735/3107) Updating files: 89% (2766/3107) Updating files: 90% (2797/3107) Updating files: 91% (2828/3107) Updating files: 92% (2859/3107) Updating files: 93% (2890/3107) Updating files: 94% (2921/3107) Updating files: 95% (2952/3107) Updating files: 96% (2983/3107) Updating files: 97% (3014/3107) Updating files: 98% (3045/3107) Updating files: 99% (3076/3107) Updating files: 100% (3107/3107) Updating files: 100% (3107/3107), done. [e2e-llm-inference-service] + bash [e2e-llm-inference-service] + STATUS_FILE=/test-status/deploy-and-e2e-status [e2e-llm-inference-service] + echo failed [e2e-llm-inference-service] + COMPONENT_NAME=kserve-agent-ci [e2e-llm-inference-service] ++ jq -r --arg component_name kserve-agent-ci '.[$component_name].image' [e2e-llm-inference-service] + export KSERVE_AGENT_IMAGE=quay.io/opendatahub/kserve-agent@sha256:7cf57df6438fd0be0182caf8c665267f434f07d282f75228157fde800aa58082 [e2e-llm-inference-service] + KSERVE_AGENT_IMAGE=quay.io/opendatahub/kserve-agent@sha256:7cf57df6438fd0be0182caf8c665267f434f07d282f75228157fde800aa58082 [e2e-llm-inference-service] + COMPONENT_NAME=kserve-controller-ci [e2e-llm-inference-service] ++ jq -r --arg component_name kserve-controller-ci '.[$component_name].image' [e2e-llm-inference-service] + export KSERVE_CONTROLLER_IMAGE=quay.io/opendatahub/kserve-controller@sha256:3af8f6b209a44c87a21ce2e0ec553929bba8086d258c434ac18056b800f65b55 [e2e-llm-inference-service] + KSERVE_CONTROLLER_IMAGE=quay.io/opendatahub/kserve-controller@sha256:3af8f6b209a44c87a21ce2e0ec553929bba8086d258c434ac18056b800f65b55 [e2e-llm-inference-service] + COMPONENT_NAME=kserve-router-ci [e2e-llm-inference-service] ++ jq -r --arg component_name kserve-router-ci '.[$component_name].image' [e2e-llm-inference-service] + export KSERVE_ROUTER_IMAGE=quay.io/opendatahub/kserve-router@sha256:86bfaabcc176433317a84dc02e835b9657d32290b963c2e4ae8312aa72bd9d64 [e2e-llm-inference-service] + KSERVE_ROUTER_IMAGE=quay.io/opendatahub/kserve-router@sha256:86bfaabcc176433317a84dc02e835b9657d32290b963c2e4ae8312aa72bd9d64 [e2e-llm-inference-service] + COMPONENT_NAME=kserve-storage-initializer-ci [e2e-llm-inference-service] ++ jq -r --arg component_name kserve-storage-initializer-ci '.[$component_name].image' [e2e-llm-inference-service] + export STORAGE_INITIALIZER_IMAGE=quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8 [e2e-llm-inference-service] + STORAGE_INITIALIZER_IMAGE=quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8 [e2e-llm-inference-service] + COMPONENT_NAME=odh-kserve-llmisvc-controller-ci [e2e-llm-inference-service] ++ jq -r --arg component_name odh-kserve-llmisvc-controller-ci '.[$component_name].image' [e2e-llm-inference-service] + export LLMISVC_CONTROLLER_IMAGE=quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:b6b293f866f662bd87aa23880c0bbf72defe55ad9d4d937d4b8699f9b082159a [e2e-llm-inference-service] + LLMISVC_CONTROLLER_IMAGE=quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:b6b293f866f662bd87aa23880c0bbf72defe55ad9d4d937d4b8699f9b082159a [e2e-llm-inference-service] + ./test/scripts/openshift-ci/run-e2e-tests.sh 'llminferenceservice and cluster_cpu and not autoscaling and not tracing' 2 llm-d [e2e-llm-inference-service] INFERENCE_POOL_GROUP=inference.networking.k8s.io (detected from OCP 4.21.23) [e2e-llm-inference-service] Installing on cluster [e2e-llm-inference-service] Using namespace: kserve for KServe components [e2e-llm-inference-service] SKLEARN_IMAGE=quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1707 [e2e-llm-inference-service] OPT_125M_MODEL_URI=s3://example-models/facebook/opt-125m [e2e-llm-inference-service] ERROR_404_ISVC_IMAGE=quay.io/opendatahub/error-404-isvc:odh-pr-1707 [e2e-llm-inference-service] SUCCESS_200_ISVC_IMAGE=quay.io/opendatahub/success-200-isvc:odh-pr-1707 [e2e-llm-inference-service] [INFO] Installing Kustomize v5.8.1 for linux/amd64... [e2e-llm-inference-service] [SUCCESS] Successfully installed Kustomize v5.8.1 to /workspace/source/bin/kustomize [e2e-llm-inference-service] v5.8.1 [e2e-llm-inference-service] make: Entering directory '/workspace/source' [e2e-llm-inference-service] [INFO] Installing yq v4.52.1 for linux/amd64... [e2e-llm-inference-service] [SUCCESS] Successfully installed yq v4.52.1 to /workspace/source/bin/yq [e2e-llm-inference-service] yq (https://github.com/mikefarah/yq/) version v4.52.1 [e2e-llm-inference-service] make: Leaving directory '/workspace/source' [e2e-llm-inference-service] Installing KServe Python SDK ... [e2e-llm-inference-service] [INFO] Installing uv 0.7.8 for linux/amd64... [e2e-llm-inference-service] [SUCCESS] Successfully installed uv 0.7.8 to /workspace/source/bin/uv [e2e-llm-inference-service] warning: Failed to read project metadata (No `pyproject.toml` found in current directory or any parent directory). Running `uv self version` for compatibility. This fallback will be removed in the future; pass `--preview` to force an error. [e2e-llm-inference-service] uv 0.7.8 [e2e-llm-inference-service] Creating virtual environment... [e2e-llm-inference-service] warning: virtualenv's `--clear` has no effect (uv always clears the virtual environment) [e2e-llm-inference-service] Using CPython 3.9.25 interpreter at: /usr/bin/python3 [e2e-llm-inference-service] Creating virtual environment at: .venv [e2e-llm-inference-service] /workspace/source [e2e-llm-inference-service] Using CPython 3.11.13 interpreter at: /usr/bin/python3.11 [e2e-llm-inference-service] Creating virtual environment at: .venv [e2e-llm-inference-service] Resolved 266 packages in 1ms [e2e-llm-inference-service] Building kserve @ file:///workspace/source/python/kserve [e2e-llm-inference-service] Downloading kubernetes (1.9MiB) [e2e-llm-inference-service] Downloading cryptography (4.3MiB) [e2e-llm-inference-service] Downloading botocore (12.9MiB) [e2e-llm-inference-service] Downloading pydantic-core (2.0MiB) [e2e-llm-inference-service] Downloading aiohttp (1.7MiB) [e2e-llm-inference-service] Downloading grpcio (6.4MiB) [e2e-llm-inference-service] Downloading portforward (3.9MiB) [e2e-llm-inference-service] Downloading black (1.6MiB) [e2e-llm-inference-service] Downloading setuptools (1.2MiB) [e2e-llm-inference-service] Downloading pandas (12.5MiB) [e2e-llm-inference-service] Downloading uvloop (3.8MiB) [e2e-llm-inference-service] Downloading pyarrow (40.1MiB) [e2e-llm-inference-service] Downloading grpcio-tools (2.5MiB) [e2e-llm-inference-service] Downloading mypy (17.2MiB) [e2e-llm-inference-service] Downloading numpy (15.7MiB) [e2e-llm-inference-service] Building timeout-sampler==1.0.3 [e2e-llm-inference-service] Building python-simple-logger==2.0.19 [e2e-llm-inference-service] Downloading aiohttp [e2e-llm-inference-service] Downloading black [e2e-llm-inference-service] Downloading pydantic-core [e2e-llm-inference-service] Downloading grpcio-tools [e2e-llm-inference-service] Downloading setuptools [e2e-llm-inference-service] Built python-simple-logger==2.0.19 [e2e-llm-inference-service] Downloading portforward [e2e-llm-inference-service] Downloading uvloop [e2e-llm-inference-service] Downloading cryptography [e2e-llm-inference-service] Downloading grpcio [e2e-llm-inference-service] Downloading kubernetes [e2e-llm-inference-service] Built timeout-sampler==1.0.3 [e2e-llm-inference-service] Downloading numpy [e2e-llm-inference-service] Built kserve @ file:///workspace/source/python/kserve [e2e-llm-inference-service] Downloading pandas [e2e-llm-inference-service] Downloading botocore [e2e-llm-inference-service] Downloading pyarrow [e2e-llm-inference-service] Downloading mypy [e2e-llm-inference-service] Prepared 101 packages in 1.85s [e2e-llm-inference-service] warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance. [e2e-llm-inference-service] If the cache and target directories are on different filesystems, hardlinking may not be supported. [e2e-llm-inference-service] If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning. [e2e-llm-inference-service] Installed 101 packages in 313ms [e2e-llm-inference-service] + aiohappyeyeballs==2.6.1 [e2e-llm-inference-service] + aiohttp==3.13.3 [e2e-llm-inference-service] + aiosignal==1.4.0 [e2e-llm-inference-service] + annotated-doc==0.0.4 [e2e-llm-inference-service] + annotated-types==0.7.0 [e2e-llm-inference-service] + anyio==4.9.0 [e2e-llm-inference-service] + attrs==25.3.0 [e2e-llm-inference-service] + avro==1.12.0 [e2e-llm-inference-service] + black==24.3.0 [e2e-llm-inference-service] + boto3==1.37.35 [e2e-llm-inference-service] + botocore==1.37.35 [e2e-llm-inference-service] + cachetools==5.5.2 [e2e-llm-inference-service] + certifi==2025.1.31 [e2e-llm-inference-service] + cffi==2.0.0 [e2e-llm-inference-service] + charset-normalizer==3.4.1 [e2e-llm-inference-service] + click==8.1.8 [e2e-llm-inference-service] + cloudevents==1.11.0 [e2e-llm-inference-service] + colorama==0.4.6 [e2e-llm-inference-service] + colorlog==6.10.1 [e2e-llm-inference-service] + coverage==7.8.0 [e2e-llm-inference-service] + cryptography==46.0.5 [e2e-llm-inference-service] + deprecation==2.1.0 [e2e-llm-inference-service] + durationpy==0.9 [e2e-llm-inference-service] + execnet==2.1.1 [e2e-llm-inference-service] + fastapi==0.136.3 [e2e-llm-inference-service] + frozenlist==1.5.0 [e2e-llm-inference-service] + google-auth==2.39.0 [e2e-llm-inference-service] + grpc-interceptor==0.15.4 [e2e-llm-inference-service] + grpcio==1.78.1 [e2e-llm-inference-service] + grpcio-testing==1.78.1 [e2e-llm-inference-service] + grpcio-tools==1.78.1 [e2e-llm-inference-service] + h11==0.16.0 [e2e-llm-inference-service] + httpcore==1.0.9 [e2e-llm-inference-service] + httptools==0.6.4 [e2e-llm-inference-service] + httpx==0.27.2 [e2e-llm-inference-service] + httpx-retries==0.4.5 [e2e-llm-inference-service] + idna==3.10 [e2e-llm-inference-service] + iniconfig==2.1.0 [e2e-llm-inference-service] + jinja2==3.1.6 [e2e-llm-inference-service] + jmespath==1.0.1 [e2e-llm-inference-service] + kserve==0.19.0 (from file:///workspace/source/python/kserve) [e2e-llm-inference-service] + kubernetes==32.0.1 [e2e-llm-inference-service] + markupsafe==3.0.2 [e2e-llm-inference-service] + multidict==6.4.3 [e2e-llm-inference-service] + mypy==0.991 [e2e-llm-inference-service] + mypy-extensions==1.0.0 [e2e-llm-inference-service] + numpy==2.2.4 [e2e-llm-inference-service] + oauthlib==3.2.2 [e2e-llm-inference-service] + orjson==3.10.16 [e2e-llm-inference-service] + packaging==24.2 [e2e-llm-inference-service] + pandas==2.2.3 [e2e-llm-inference-service] + pathspec==0.12.1 [e2e-llm-inference-service] + platformdirs==4.3.7 [e2e-llm-inference-service] + pluggy==1.5.0 [e2e-llm-inference-service] + portforward==0.7.1 [e2e-llm-inference-service] + prometheus-client==0.21.1 [e2e-llm-inference-service] + propcache==0.3.1 [e2e-llm-inference-service] + protobuf==6.33.5 [e2e-llm-inference-service] + psutil==5.9.8 [e2e-llm-inference-service] + pyarrow==19.0.1 [e2e-llm-inference-service] + pyasn1==0.6.3 [e2e-llm-inference-service] + pyasn1-modules==0.4.2 [e2e-llm-inference-service] + pycparser==2.22 [e2e-llm-inference-service] + pydantic==2.12.4 [e2e-llm-inference-service] + pydantic-core==2.41.5 [e2e-llm-inference-service] + pyjwt==2.12.1 [e2e-llm-inference-service] + pytest==7.4.4 [e2e-llm-inference-service] + pytest-asyncio==0.23.8 [e2e-llm-inference-service] + pytest-cov==5.0.0 [e2e-llm-inference-service] + pytest-httpx==0.30.0 [e2e-llm-inference-service] + pytest-json-report==1.5.0 [e2e-llm-inference-service] + pytest-metadata==3.1.1 [e2e-llm-inference-service] + pytest-xdist==3.6.1 [e2e-llm-inference-service] + python-dateutil==2.9.0.post0 [e2e-llm-inference-service] + python-dotenv==1.1.0 [e2e-llm-inference-service] + python-multipart==0.0.22 [e2e-llm-inference-service] + python-simple-logger==2.0.19 [e2e-llm-inference-service] + pytz==2025.2 [e2e-llm-inference-service] + pyyaml==6.0.2 [e2e-llm-inference-service] + requests==2.32.3 [e2e-llm-inference-service] + requests-oauthlib==2.0.0 [e2e-llm-inference-service] + rsa==4.9.1 [e2e-llm-inference-service] + s3transfer==0.11.4 [e2e-llm-inference-service] + setuptools==78.1.0 [e2e-llm-inference-service] + six==1.17.0 [e2e-llm-inference-service] + sniffio==1.3.1 [e2e-llm-inference-service] + starlette==1.2.1 [e2e-llm-inference-service] + tabulate==0.9.0 [e2e-llm-inference-service] + timeout-sampler==1.0.3 [e2e-llm-inference-service] + timing-asgi==0.3.1 [e2e-llm-inference-service] + tomlkit==0.13.2 [e2e-llm-inference-service] + typing-extensions==4.15.0 [e2e-llm-inference-service] + typing-inspection==0.4.2 [e2e-llm-inference-service] + tzdata==2025.2 [e2e-llm-inference-service] + urllib3==2.6.2 [e2e-llm-inference-service] + uvicorn==0.34.1 [e2e-llm-inference-service] + uvloop==0.21.0 [e2e-llm-inference-service] + watchfiles==1.0.5 [e2e-llm-inference-service] + websocket-client==1.8.0 [e2e-llm-inference-service] + websockets==15.0.1 [e2e-llm-inference-service] + yarl==1.20.0 [e2e-llm-inference-service] Audited 1 package in 47ms [e2e-llm-inference-service] /workspace/source [e2e-llm-inference-service] [INFO] Installing Kustomize v5.8.1 for linux/amd64... [e2e-llm-inference-service] [INFO] Kustomize v5.8.1 is already installed in /workspace/source/bin (>= v5.8.1) [e2e-llm-inference-service] make: Entering directory '/workspace/source' [e2e-llm-inference-service] make: Leaving directory '/workspace/source' [e2e-llm-inference-service] Now using project "kserve" on server "https://aa419ce991be54aee901e5aa7e5ab1f5-21a7125f3e1aac29.elb.us-east-1.amazonaws.com:6443". [e2e-llm-inference-service] [e2e-llm-inference-service] You can add applications to this project with the 'new-app' command. For example, try: [e2e-llm-inference-service] [e2e-llm-inference-service] oc new-app rails-postgresql-example [e2e-llm-inference-service] [e2e-llm-inference-service] to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: [e2e-llm-inference-service] [e2e-llm-inference-service] kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname [e2e-llm-inference-service] [e2e-llm-inference-service] [INFO] Installing Kustomize v5.8.1 for linux/amd64... [e2e-llm-inference-service] [INFO] Kustomize v5.8.1 is already installed in /workspace/source/bin (>= v5.8.1) [e2e-llm-inference-service] make: Entering directory '/workspace/source' [e2e-llm-inference-service] make: Leaving directory '/workspace/source' [e2e-llm-inference-service] Creating namespace openshift-keda... [e2e-llm-inference-service] namespace/openshift-keda created [e2e-llm-inference-service] Namespace openshift-keda created/ensured. [e2e-llm-inference-service] --- [e2e-llm-inference-service] Creating OperatorGroup openshift-keda... [e2e-llm-inference-service] operatorgroup.operators.coreos.com/openshift-keda created [e2e-llm-inference-service] OperatorGroup openshift-keda created/ensured. [e2e-llm-inference-service] --- [e2e-llm-inference-service] Creating Subscription for openshift-custom-metrics-autoscaler-operator... [e2e-llm-inference-service] subscription.operators.coreos.com/openshift-custom-metrics-autoscaler-operator created [e2e-llm-inference-service] Subscription openshift-custom-metrics-autoscaler-operator created/ensured. [e2e-llm-inference-service] --- [e2e-llm-inference-service] Waiting for openshift-custom-metrics-autoscaler-operator CSV to become ready... [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-custom-metrics-autoscaler-operator... (0/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-custom-metrics-autoscaler-operator... (5/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-custom-metrics-autoscaler-operator... (10/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-custom-metrics-autoscaler-operator... (15/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-custom-metrics-autoscaler-operator... (20/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-custom-metrics-autoscaler-operator... (25/600) [e2e-llm-inference-service] CSV custom-metrics-autoscaler.v2.19.0-1 found, but not yet Succeeded (Phase: Installing). Waiting... (30/600) [e2e-llm-inference-service] CSV custom-metrics-autoscaler.v2.19.0-1 found, but not yet Succeeded (Phase: Installing). Waiting... (35/600) [e2e-llm-inference-service] CSV custom-metrics-autoscaler.v2.19.0-1 found, but not yet Succeeded (Phase: Installing). Waiting... (40/600) [e2e-llm-inference-service] CSV custom-metrics-autoscaler.v2.19.0-1 found, but not yet Succeeded (Phase: Installing). Waiting... (45/600) [e2e-llm-inference-service] CSV custom-metrics-autoscaler.v2.19.0-1 found, but not yet Succeeded (Phase: Installing). Waiting... (50/600) [e2e-llm-inference-service] CSV custom-metrics-autoscaler.v2.19.0-1 found, but not yet Succeeded (Phase: Installing). Waiting... (55/600) [e2e-llm-inference-service] CSV custom-metrics-autoscaler.v2.19.0-1 is ready (Phase: Succeeded). [e2e-llm-inference-service] --- [e2e-llm-inference-service] Applying KedaController custom resource... [e2e-llm-inference-service] Warning: resource kedacontrollers/keda is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically. [e2e-llm-inference-service] kedacontroller.keda.sh/keda configured [e2e-llm-inference-service] KedaController custom resource applied. [e2e-llm-inference-service] --- [e2e-llm-inference-service] Allowing time for KEDA components to be provisioned by the operator ... [e2e-llm-inference-service] Waiting for KEDA Operator pod (selector: "app=keda-operator") to be ready in namespace openshift-keda... [e2e-llm-inference-service] Waiting for pod -l "app=keda-operator" in namespace "openshift-keda" to be created... [e2e-llm-inference-service] Pod -l "app=keda-operator" in namespace "openshift-keda" found. [e2e-llm-inference-service] Current pods for -l "app=keda-operator" in namespace "openshift-keda": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] keda-operator-68bff59c-tm5sf 1/1 Running 0 43s [e2e-llm-inference-service] Waiting up to 120s for pod(s) -l "app=keda-operator" in namespace "openshift-keda" to become ready... [e2e-llm-inference-service] pod/keda-operator-68bff59c-tm5sf condition met [e2e-llm-inference-service] Pod(s) -l "app=keda-operator" in namespace "openshift-keda" are ready. [e2e-llm-inference-service] KEDA Operator pod is ready. [e2e-llm-inference-service] Waiting for KEDA Metrics API Server pod (selector: "app=keda-metrics-apiserver") to be ready in namespace openshift-keda... [e2e-llm-inference-service] Waiting for pod -l "app=keda-metrics-apiserver" in namespace "openshift-keda" to be created... [e2e-llm-inference-service] Pod -l "app=keda-metrics-apiserver" in namespace "openshift-keda" found. [e2e-llm-inference-service] Current pods for -l "app=keda-metrics-apiserver" in namespace "openshift-keda": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] keda-metrics-apiserver-559f75f947-hm5b6 1/1 Running 0 49s [e2e-llm-inference-service] Waiting up to 120s for pod(s) -l "app=keda-metrics-apiserver" in namespace "openshift-keda" to become ready... [e2e-llm-inference-service] pod/keda-metrics-apiserver-559f75f947-hm5b6 condition met [e2e-llm-inference-service] Pod(s) -l "app=keda-metrics-apiserver" in namespace "openshift-keda" are ready. [e2e-llm-inference-service] KEDA Metrics API Server pod is ready. [e2e-llm-inference-service] Waiting for KEDA Webhook pod (selector: "app=keda-admission-webhooks") to be ready in namespace openshift-keda... [e2e-llm-inference-service] Waiting for pod -l "app=keda-admission-webhooks" in namespace "openshift-keda" to be created... [e2e-llm-inference-service] Pod -l "app=keda-admission-webhooks" in namespace "openshift-keda" found. [e2e-llm-inference-service] Current pods for -l "app=keda-admission-webhooks" in namespace "openshift-keda": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] keda-admission-5fbd5c4644-vxzfp 1/1 Running 0 54s [e2e-llm-inference-service] Waiting up to 120s for pod(s) -l "app=keda-admission-webhooks" in namespace "openshift-keda" to become ready... [e2e-llm-inference-service] pod/keda-admission-5fbd5c4644-vxzfp condition met [e2e-llm-inference-service] Pod(s) -l "app=keda-admission-webhooks" in namespace "openshift-keda" are ready. [e2e-llm-inference-service] KEDA Webhook pod is ready. [e2e-llm-inference-service] --- [e2e-llm-inference-service] ✅ KEDA deployment script finished successfully. [e2e-llm-inference-service] KSERVE_CONTROLLER_IMAGE=quay.io/opendatahub/kserve-controller@sha256:3af8f6b209a44c87a21ce2e0ec553929bba8086d258c434ac18056b800f65b55 [e2e-llm-inference-service] LLMISVC_CONTROLLER_IMAGE=quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:b6b293f866f662bd87aa23880c0bbf72defe55ad9d4d937d4b8699f9b082159a [e2e-llm-inference-service] KSERVE_AGENT_IMAGE=quay.io/opendatahub/kserve-agent@sha256:7cf57df6438fd0be0182caf8c665267f434f07d282f75228157fde800aa58082 [e2e-llm-inference-service] KSERVE_ROUTER_IMAGE=quay.io/opendatahub/kserve-router@sha256:86bfaabcc176433317a84dc02e835b9657d32290b963c2e4ae8312aa72bd9d64 [e2e-llm-inference-service] STORAGE_INITIALIZER_IMAGE=quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8 [e2e-llm-inference-service] Installing KServe via kustomize... [e2e-llm-inference-service] # Warning: 'commonLabels' is deprecated. Please use 'labels' instead. Run 'kustomize edit fix' to update your Kustomization automatically. [e2e-llm-inference-service] # Warning: 'commonLabels' is deprecated. Please use 'labels' instead. Run 'kustomize edit fix' to update your Kustomization automatically. [e2e-llm-inference-service] # Warning: 'commonLabels' is deprecated. Please use 'labels' instead. Run 'kustomize edit fix' to update your Kustomization automatically. [e2e-llm-inference-service] # Warning: 'commonLabels' is deprecated. Please use 'labels' instead. Run 'kustomize edit fix' to update your Kustomization automatically. [e2e-llm-inference-service] # Warning: 'commonLabels' is deprecated. Please use 'labels' instead. Run 'kustomize edit fix' to update your Kustomization automatically. [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/clusterstoragecontainers.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/datascienceclusters.datasciencecluster.opendatahub.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/dscinitializations.dscinitialization.opendatahub.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencegraphs.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencemodelrewrites.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferenceobjectives.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencepoolimports.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencepools.inference.networking.k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencepools.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferenceservices.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/llminferenceserviceconfigs.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/llminferenceservices.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/servingruntimes.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/trainedmodels.serving.kserve.io serverside-applied [e2e-llm-inference-service] Waiting for CRDs to be established... [e2e-llm-inference-service] Waiting for CRD inferenceservices.serving.kserve.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD inferenceservices.serving.kserve.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferenceservices.serving.kserve.io condition met [e2e-llm-inference-service] Waiting for CRD llminferenceserviceconfigs.serving.kserve.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD llminferenceserviceconfigs.serving.kserve.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/llminferenceserviceconfigs.serving.kserve.io condition met [e2e-llm-inference-service] Waiting for CRD clusterstoragecontainers.serving.kserve.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD clusterstoragecontainers.serving.kserve.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/clusterstoragecontainers.serving.kserve.io condition met [e2e-llm-inference-service] Waiting for CRD datascienceclusters.datasciencecluster.opendatahub.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD datascienceclusters.datasciencecluster.opendatahub.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/datascienceclusters.datasciencecluster.opendatahub.io condition met [e2e-llm-inference-service] Applying all resources... [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/clusterstoragecontainers.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/datascienceclusters.datasciencecluster.opendatahub.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/dscinitializations.dscinitialization.opendatahub.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencegraphs.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencemodelrewrites.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferenceobjectives.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencepoolimports.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencepools.inference.networking.k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferencepools.inference.networking.x-k8s.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/inferenceservices.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/llminferenceserviceconfigs.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/llminferenceservices.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/servingruntimes.serving.kserve.io serverside-applied [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/trainedmodels.serving.kserve.io serverside-applied [e2e-llm-inference-service] serviceaccount/kserve-controller-manager serverside-applied [e2e-llm-inference-service] serviceaccount/llmisvc-controller-manager serverside-applied [e2e-llm-inference-service] role.rbac.authorization.k8s.io/kserve-leader-election-role serverside-applied [e2e-llm-inference-service] role.rbac.authorization.k8s.io/kserve-llmisvcconfig-read-access serverside-applied [e2e-llm-inference-service] role.rbac.authorization.k8s.io/llmisvc-leader-election-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-admin serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-edit serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-inferenceservice-distro-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-llmisvc-distro-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-llmisvc-manager-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-manager-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-metrics-reader-cluster-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-proxy-role serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-view serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/openshift-ai-inferenceservice-image-volume-scc serverside-applied [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/openshift-ai-llminferenceservice-scc serverside-applied [e2e-llm-inference-service] rolebinding.rbac.authorization.k8s.io/kserve-leader-election-rolebinding serverside-applied [e2e-llm-inference-service] rolebinding.rbac.authorization.k8s.io/kserve-llmisvcconfig-read-access serverside-applied [e2e-llm-inference-service] rolebinding.rbac.authorization.k8s.io/llmisvc-leader-election-rolebinding serverside-applied [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/kserve-inferenceservice-distro-rolebinding serverside-applied [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/kserve-llmisvc-distro-rolebinding serverside-applied [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/kserve-manager-rolebinding serverside-applied [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/kserve-proxy-rolebinding serverside-applied [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/llmisvc-manager-rolebinding serverside-applied [e2e-llm-inference-service] configmap/inferenceservice-config serverside-applied [e2e-llm-inference-service] configmap/kserve-parameters serverside-applied [e2e-llm-inference-service] secret/kserve-webhook-server-secret serverside-applied [e2e-llm-inference-service] secret/mlpipeline-s3-artifact serverside-applied [e2e-llm-inference-service] service/kserve-controller-manager-metrics-service serverside-applied [e2e-llm-inference-service] service/kserve-controller-manager-service serverside-applied [e2e-llm-inference-service] service/kserve-webhook-server-service serverside-applied [e2e-llm-inference-service] service/llmisvc-controller-manager-service serverside-applied [e2e-llm-inference-service] service/llmisvc-webhook-server-service serverside-applied [e2e-llm-inference-service] service/s3-service serverside-applied [e2e-llm-inference-service] deployment.apps/kserve-controller-manager serverside-applied [e2e-llm-inference-service] deployment.apps/llmisvc-controller-manager serverside-applied [e2e-llm-inference-service] deployment.apps/seaweedfs serverside-applied [e2e-llm-inference-service] networkpolicy.networking.k8s.io/kserve-controller-manager serverside-applied [e2e-llm-inference-service] securitycontextconstraints.security.openshift.io/openshift-ai-inferenceservice-image-volume-scc serverside-applied [e2e-llm-inference-service] securitycontextconstraints.security.openshift.io/openshift-ai-llminferenceservice-scc serverside-applied [e2e-llm-inference-service] clusterstoragecontainer.serving.kserve.io/default serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-decode-template serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-decode-worker-data-parallel serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-multi-node-pd-template-nvidia-cuda serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-multi-node-pd-template-nvidia-cuda-fast-1 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-multi-node-pd-template-nvidia-cuda-fast-2 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-multi-node-template-nvidia-cuda serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-multi-node-template-nvidia-cuda-fast-1 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-multi-node-template-nvidia-cuda-fast-2 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-prefill-template serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-prefill-worker-data-parallel serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-router-route serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-scheduler serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-single-node-pd-template-nvidia-cuda serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-single-node-pd-template-nvidia-cuda-fast-1 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-single-node-pd-template-nvidia-cuda-fast-2 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-single-node-template-nvidia-cuda serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-single-node-template-nvidia-cuda-fast-1 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-single-node-template-nvidia-cuda-fast-2 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-amd-rocm serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-amd-rocm-fast-1 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-amd-rocm-fast-2 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-ppc64le serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-ppc64le-fast-1 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-ppc64le-fast-2 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-s390x serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-s390x-fast-1 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-s390x-fast-2 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-x86 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-x86-fast-1 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-ibm-spyre-x86-fast-2 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-intel-gaudi serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-intel-gaudi-fast-1 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template-intel-gaudi-fast-2 serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-tracing serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-worker-data-parallel serverside-applied [e2e-llm-inference-service] mutatingwebhookconfiguration.admissionregistration.k8s.io/inferenceservice.serving.kserve.io serverside-applied [e2e-llm-inference-service] mutatingwebhookconfiguration.admissionregistration.k8s.io/llminferenceservice.serving.kserve.io serverside-applied [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/inferencegraph.serving.kserve.io serverside-applied [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/inferenceservice.serving.kserve.io serverside-applied [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/llminferenceservice.serving.kserve.io serverside-applied [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/llminferenceserviceconfig.serving.kserve.io serverside-applied [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/servingruntime.serving.kserve.io serverside-applied [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/trainedmodel.serving.kserve.io serverside-applied [e2e-llm-inference-service] Waiting for llmisvc-controller-manager to be ready... [e2e-llm-inference-service] Waiting for pod -l "control-plane=llmisvc-controller-manager" in namespace "kserve" to be created... [e2e-llm-inference-service] Pod -l "control-plane=llmisvc-controller-manager" in namespace "kserve" found. [e2e-llm-inference-service] Current pods for -l "control-plane=llmisvc-controller-manager" in namespace "kserve": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] llmisvc-controller-manager-868c8c7759-p6tmd 0/1 Running 0 7s [e2e-llm-inference-service] Waiting up to 600s for pod(s) -l "control-plane=llmisvc-controller-manager" in namespace "kserve" to become ready... [e2e-llm-inference-service] pod/llmisvc-controller-manager-868c8c7759-p6tmd condition met [e2e-llm-inference-service] Pod(s) -l "control-plane=llmisvc-controller-manager" in namespace "kserve" are ready. [e2e-llm-inference-service] Re-applying LLMInferenceServiceConfig resources with webhook validation... [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-decode-template is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-decode-template serverside-applied [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-decode-worker-data-parallel is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-decode-worker-data-parallel serverside-applied [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-prefill-template is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-prefill-template serverside-applied [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-prefill-worker-data-parallel is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-prefill-worker-data-parallel serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-router-route serverside-applied [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-scheduler is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-scheduler serverside-applied [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-template is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-template serverside-applied [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-tracing serverside-applied [e2e-llm-inference-service] Warning: modifying well-known config kserve/kserve-config-llm-worker-data-parallel is not recommended. Consider creating a custom config instead [e2e-llm-inference-service] llminferenceserviceconfig.serving.kserve.io/kserve-config-llm-worker-data-parallel serverside-applied [e2e-llm-inference-service] Applying DSC/DSCI resources... [e2e-llm-inference-service] dscinitialization.dscinitialization.opendatahub.io/test-dsci created [e2e-llm-inference-service] datasciencecluster.datasciencecluster.opendatahub.io/test-dsc created [e2e-llm-inference-service] KServe manual installation complete [e2e-llm-inference-service] 🔧 Configuration: [e2e-llm-inference-service] KServe deployment: ❌ disabled [e2e-llm-inference-service] Kuadrant deployment: ✅ enabled [e2e-llm-inference-service] [e2e-llm-inference-service] Checking OpenShift server version...(4.21.23) [e2e-llm-inference-service] 🎯 Server version (4.21.23) is 4.19.9 or higher - continue with the script [e2e-llm-inference-service] ⏳ Installing cert-manager [e2e-llm-inference-service] namespace/cert-manager-operator created [e2e-llm-inference-service] operatorgroup.operators.coreos.com/openshift-cert-manager-operator created [e2e-llm-inference-service] subscription.operators.coreos.com/openshift-cert-manager-operator created [e2e-llm-inference-service] Waiting for openshift-cert-manager-operator CSV to become ready... [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-cert-manager-operator... (0/300) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-cert-manager-operator... (5/300) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription openshift-cert-manager-operator... (10/300) [e2e-llm-inference-service] CSV cert-manager-operator.v1.20.0 found, but not yet Succeeded (Phase: Installing). Waiting... (15/300) [e2e-llm-inference-service] CSV cert-manager-operator.v1.20.0 is ready (Phase: Succeeded). [e2e-llm-inference-service] Waiting for CRD certificates.cert-manager.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD certificates.cert-manager.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/certificates.cert-manager.io condition met [e2e-llm-inference-service] ✅ Cert-manager installed [e2e-llm-inference-service] ⏳ Installing openshift-lws-operator [e2e-llm-inference-service] namespace/openshift-lws-operator created [e2e-llm-inference-service] operatorgroup.operators.coreos.com/leader-worker-set created [e2e-llm-inference-service] subscription.operators.coreos.com/leader-worker-set created [e2e-llm-inference-service] Waiting for leader-worker-set CSV to become ready... [e2e-llm-inference-service] Waiting for CSV to be installed for subscription leader-worker-set... (0/300) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription leader-worker-set... (5/300) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription leader-worker-set... (10/300) [e2e-llm-inference-service] CSV leader-worker-set.v1.0.0 is ready (Phase: Succeeded). [e2e-llm-inference-service] Waiting for CRD leaderworkersetoperators.operator.openshift.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD leaderworkersetoperators.operator.openshift.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/leaderworkersetoperators.operator.openshift.io condition met [e2e-llm-inference-service] leaderworkersetoperator.operator.openshift.io/cluster created [e2e-llm-inference-service] ⏳ waiting for openshift-lws-operator to be ready.… [e2e-llm-inference-service] Waiting for pod -l "name=openshift-lws-operator" in namespace "openshift-lws-operator" to be created... [e2e-llm-inference-service] Pod -l "name=openshift-lws-operator" in namespace "openshift-lws-operator" found. [e2e-llm-inference-service] Current pods for -l "name=openshift-lws-operator" in namespace "openshift-lws-operator": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] openshift-lws-operator-fd8ccff4c-58g4c 1/1 Running 0 11s [e2e-llm-inference-service] Waiting up to 600s for pod(s) -l "name=openshift-lws-operator" in namespace "openshift-lws-operator" to become ready... [e2e-llm-inference-service] pod/openshift-lws-operator-fd8ccff4c-58g4c condition met [e2e-llm-inference-service] Pod(s) -l "name=openshift-lws-operator" in namespace "openshift-lws-operator" are ready. [e2e-llm-inference-service] ✅ openshift-lws-operator installed [e2e-llm-inference-service] gatewayclass.gateway.networking.k8s.io/openshift-default created [e2e-llm-inference-service] Waiting for pod -l "app=istiod" in namespace "openshift-ingress" to be created... [e2e-llm-inference-service] Pod -l "app=istiod" in namespace "openshift-ingress" found. [e2e-llm-inference-service] Current pods for -l "app=istiod" in namespace "openshift-ingress": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] istiod-openshift-gateway-94bb8fbfd-5kc7r 0/1 Running 0 5s [e2e-llm-inference-service] Waiting up to 600s for pod(s) -l "app=istiod" in namespace "openshift-ingress" to become ready... [e2e-llm-inference-service] pod/istiod-openshift-gateway-94bb8fbfd-5kc7r condition met [e2e-llm-inference-service] Pod(s) -l "app=istiod" in namespace "openshift-ingress" are ready. [e2e-llm-inference-service] ⏳ Creating a Gateway [e2e-llm-inference-service] Error from server (AlreadyExists): namespaces "openshift-ingress" already exists [e2e-llm-inference-service] ⏳ Creating gateway memory ConfigMap for parametersRef (2Gi) [e2e-llm-inference-service] configmap/gateway-proxy-config created [e2e-llm-inference-service] gateway.gateway.networking.k8s.io/openshift-ai-inference created [e2e-llm-inference-service] Waiting for pod -l "serving.kserve.io/gateway=kserve-ingress-gateway" in namespace "openshift-ingress" to be created... [e2e-llm-inference-service] Pod -l "serving.kserve.io/gateway=kserve-ingress-gateway" in namespace "openshift-ingress" found. [e2e-llm-inference-service] Current pods for -l "serving.kserve.io/gateway=kserve-ingress-gateway" in namespace "openshift-ingress": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] openshift-ai-inference-openshift-default-655f7c58b4-mbx7z 0/1 Running 0 5s [e2e-llm-inference-service] Waiting up to 600s for pod(s) -l "serving.kserve.io/gateway=kserve-ingress-gateway" in namespace "openshift-ingress" to become ready... [e2e-llm-inference-service] pod/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z condition met [e2e-llm-inference-service] Pod(s) -l "serving.kserve.io/gateway=kserve-ingress-gateway" in namespace "openshift-ingress" are ready. [e2e-llm-inference-service] ⏳ Installing RHCL(Kuadrant) operator [e2e-llm-inference-service] namespace/kuadrant-system created [e2e-llm-inference-service] subscription.operators.coreos.com/rhcl-operator created [e2e-llm-inference-service] operatorgroup.operators.coreos.com/kuadrant created [e2e-llm-inference-service] Waiting for rhcl-operator CSV to become ready... [e2e-llm-inference-service] Waiting for CSV to be installed for subscription rhcl-operator... (0/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription rhcl-operator... (5/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription rhcl-operator... (10/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription rhcl-operator... (15/600) [e2e-llm-inference-service] Waiting for CSV to be installed for subscription rhcl-operator... (20/600) [e2e-llm-inference-service] CSV rhcl-operator.v1.4.1 found, but not yet Succeeded (Phase: Installing). Waiting... (25/600) [e2e-llm-inference-service] CSV rhcl-operator.v1.4.1 found, but not yet Succeeded (Phase: Installing). Waiting... (30/600) [e2e-llm-inference-service] CSV rhcl-operator.v1.4.1 found, but not yet Succeeded (Phase: Installing). Waiting... (35/600) [e2e-llm-inference-service] CSV rhcl-operator.v1.4.1 is ready (Phase: Succeeded). [e2e-llm-inference-service] Waiting for CRD kuadrants.kuadrant.io to appear (timeout: 90s)… [e2e-llm-inference-service] CRD kuadrants.kuadrant.io detected — waiting for it to become Established (timeout: 90s)… [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/kuadrants.kuadrant.io condition met [e2e-llm-inference-service] Waiting for apiserver discovery /apis/kuadrant.io/v1beta1 to list kuadrants (timeout: 120s)… [e2e-llm-inference-service] Discovery for kuadrant.io/v1beta1 includes kuadrants. [e2e-llm-inference-service] ⏳ sleeping 30s after discovery (RESTMapper can trail discovery)… [e2e-llm-inference-service] kuadrant.kuadrant.io/kuadrant created [e2e-llm-inference-service] ⏳ waiting for Kuadrant Ready (attempt 1/2, timeout 5m)… [e2e-llm-inference-service] kuadrant.kuadrant.io/kuadrant condition met [e2e-llm-inference-service] Waiting for pod -l "control-plane=authorino-operator" in namespace "kuadrant-system" to be created... [e2e-llm-inference-service] Pod -l "control-plane=authorino-operator" in namespace "kuadrant-system" found. [e2e-llm-inference-service] Current pods for -l "control-plane=authorino-operator" in namespace "kuadrant-system": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] authorino-operator-6d85f6564-hp27q 1/1 Running 0 73s [e2e-llm-inference-service] Waiting up to 600s for pod(s) -l "control-plane=authorino-operator" in namespace "kuadrant-system" to become ready... [e2e-llm-inference-service] pod/authorino-operator-6d85f6564-hp27q condition met [e2e-llm-inference-service] Pod(s) -l "control-plane=authorino-operator" in namespace "kuadrant-system" are ready. [e2e-llm-inference-service] ⏳ waiting for authorino service to be created... [e2e-llm-inference-service] service/authorino-authorino-authorization condition met [e2e-llm-inference-service] service/authorino-authorino-authorization annotated [e2e-llm-inference-service] Warning: resource authorinos/authorino is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically. [e2e-llm-inference-service] authorino.operator.authorino.kuadrant.io/authorino configured [e2e-llm-inference-service] Waiting for pod -l "control-plane=authorino-operator" in namespace "kuadrant-system" to be created... [e2e-llm-inference-service] Pod -l "control-plane=authorino-operator" in namespace "kuadrant-system" found. [e2e-llm-inference-service] Current pods for -l "control-plane=authorino-operator" in namespace "kuadrant-system": [e2e-llm-inference-service] NAME READY STATUS RESTARTS AGE [e2e-llm-inference-service] authorino-operator-6d85f6564-hp27q 1/1 Running 0 83s [e2e-llm-inference-service] Waiting up to 600s for pod(s) -l "control-plane=authorino-operator" in namespace "kuadrant-system" to become ready... [e2e-llm-inference-service] pod/authorino-operator-6d85f6564-hp27q condition met [e2e-llm-inference-service] Pod(s) -l "control-plane=authorino-operator" in namespace "kuadrant-system" are ready. [e2e-llm-inference-service] ✅ kuadrant(authorino) installed [e2e-llm-inference-service] Patching ingress domain... [e2e-llm-inference-service] configmap/inferenceservice-config patched [e2e-llm-inference-service] pod "kserve-controller-manager-687b7449bc-5hzqb" deleted [e2e-llm-inference-service] Waiting for kserve-controller-manager to be ready... [e2e-llm-inference-service] pod/kserve-controller-manager-687b7449bc-w4q6g condition met [e2e-llm-inference-service] Installing ODH Model Controller manually... [e2e-llm-inference-service] customresourcedefinition.apiextensions.k8s.io/accounts.nim.opendatahub.io created [e2e-llm-inference-service] serviceaccount/model-serving-api created [e2e-llm-inference-service] serviceaccount/odh-model-controller created [e2e-llm-inference-service] role.rbac.authorization.k8s.io/leader-election-role created [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/account-editor-role created [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/account-viewer-role created [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/kserve-prometheus-k8s created [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/metrics-reader created [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/model-serving-api created [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/odh-model-controller-role created [e2e-llm-inference-service] clusterrole.rbac.authorization.k8s.io/proxy-role created [e2e-llm-inference-service] rolebinding.rbac.authorization.k8s.io/leader-election-rolebinding created [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/model-serving-api created [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/odh-model-controller-rolebinding-opendatahub created [e2e-llm-inference-service] clusterrolebinding.rbac.authorization.k8s.io/proxy-rolebinding created [e2e-llm-inference-service] configmap/odh-model-controller-parameters created [e2e-llm-inference-service] service/model-serving-api created [e2e-llm-inference-service] service/odh-model-controller-metrics-service created [e2e-llm-inference-service] service/odh-model-controller-webhook-service created [e2e-llm-inference-service] deployment.apps/model-serving-api created [e2e-llm-inference-service] deployment.apps/odh-model-controller created [e2e-llm-inference-service] servicemonitor.monitoring.coreos.com/model-serving-api-metrics created [e2e-llm-inference-service] servicemonitor.monitoring.coreos.com/odh-model-controller-metrics-monitor created [e2e-llm-inference-service] template.template.openshift.io/autogluon-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/guardrails-detector-huggingface-serving-template created [e2e-llm-inference-service] template.template.openshift.io/kserve-ovms created [e2e-llm-inference-service] template.template.openshift.io/mlserver-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-cpu-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-cpu-runtime-template-fast-1 created [e2e-llm-inference-service] template.template.openshift.io/vllm-cpu-runtime-template-fast-2 created [e2e-llm-inference-service] template.template.openshift.io/vllm-cpu-x86-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-cpu-x86-runtime-template-fast-1 created [e2e-llm-inference-service] template.template.openshift.io/vllm-cpu-x86-runtime-template-fast-2 created [e2e-llm-inference-service] template.template.openshift.io/vllm-cuda-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-cuda-runtime-template-fast-1 created [e2e-llm-inference-service] template.template.openshift.io/vllm-cuda-runtime-template-fast-2 created [e2e-llm-inference-service] template.template.openshift.io/vllm-gaudi-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-gaudi-runtime-template-fast-1 created [e2e-llm-inference-service] template.template.openshift.io/vllm-gaudi-runtime-template-fast-2 created [e2e-llm-inference-service] template.template.openshift.io/vllm-multinode-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-multinode-runtime-template-fast-1 created [e2e-llm-inference-service] template.template.openshift.io/vllm-multinode-runtime-template-fast-2 created [e2e-llm-inference-service] template.template.openshift.io/vllm-rocm-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-rocm-runtime-template-fast-1 created [e2e-llm-inference-service] template.template.openshift.io/vllm-rocm-runtime-template-fast-2 created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-ppc64le-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-ppc64le-runtime-template-fast-1 created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-ppc64le-runtime-template-fast-2 created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-s390x-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-s390x-runtime-template-fast-1 created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-s390x-runtime-template-fast-2 created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-x86-runtime-template created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-x86-runtime-template-fast-1 created [e2e-llm-inference-service] template.template.openshift.io/vllm-spyre-x86-runtime-template-fast-2 created [e2e-llm-inference-service] mutatingwebhookconfiguration.admissionregistration.k8s.io/mutating.odh-model-controller.opendatahub.io created [e2e-llm-inference-service] validatingwebhookconfiguration.admissionregistration.k8s.io/validating.odh-model-controller.opendatahub.io created [e2e-llm-inference-service] Waiting for deployment "odh-model-controller" rollout to finish: 0 of 1 updated replicas are available... [e2e-llm-inference-service] deployment "odh-model-controller" successfully rolled out [e2e-llm-inference-service] networkpolicy.networking.k8s.io/allow-all created [e2e-llm-inference-service] KServe setup complete (namespace: kserve) [e2e-llm-inference-service] Add testing models to SeaweedFS S3 storage ... [e2e-llm-inference-service] Waiting for SeaweedFS deployment to be ready... [e2e-llm-inference-service] deployment "seaweedfs" successfully rolled out [e2e-llm-inference-service] S3 init job not completed, re-creating... [e2e-llm-inference-service] job.batch/s3-init replaced [e2e-llm-inference-service] Waiting for S3 init job to complete... [e2e-llm-inference-service] job.batch/s3-init condition met [e2e-llm-inference-service] Prepare CI namespace and install ServingRuntimes [e2e-llm-inference-service] Setting up CI namespace: kserve-ci-e2e-test [e2e-llm-inference-service] Tearing down CI namespace: kserve-ci-e2e-test [e2e-llm-inference-service] Namespace kserve-ci-e2e-test does not exist, skipping deletion [e2e-llm-inference-service] CI namespace teardown complete [e2e-llm-inference-service] Creating namespace kserve-ci-e2e-test [e2e-llm-inference-service] namespace/kserve-ci-e2e-test created [e2e-llm-inference-service] Applying S3 artifact secret [e2e-llm-inference-service] secret/mlpipeline-s3-artifact created [e2e-llm-inference-service] Applying storage-config secret [e2e-llm-inference-service] secret/storage-config created [e2e-llm-inference-service] Applying SeaweedFS S3 credentials secret [e2e-llm-inference-service] secret/seaweedfs-s3-creds created [e2e-llm-inference-service] Linking seaweedfs-s3-creds to default service account [e2e-llm-inference-service] Creating odh-trusted-ca-bundle configmap [e2e-llm-inference-service] configmap/odh-trusted-ca-bundle created [e2e-llm-inference-service] Installing ServingRuntimes [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-autogluonserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-huggingfaceserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-huggingfaceserver-multinode created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-lgbserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-mlserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-paddleserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-pmmlserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-predictiveserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-sklearnserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-tensorflow-serving created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-torchserve created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-tritonserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-vllmserver created [e2e-llm-inference-service] servingruntime.serving.kserve.io/kserve-xgbserver created [e2e-llm-inference-service] CI namespace setup complete [e2e-llm-inference-service] Setup complete [e2e-llm-inference-service] === E2E cluster / operator summary === [e2e-llm-inference-service] Client Version: 4.20.11 [e2e-llm-inference-service] Kustomize Version: v5.6.0 [e2e-llm-inference-service] Server Version: 4.21.23 [e2e-llm-inference-service] Kubernetes Version: v1.34.8 [e2e-llm-inference-service] ClusterVersion desired: 4.21.23 [e2e-llm-inference-service] ClusterVersion history (latest): 4.21.23 (Completed) [e2e-llm-inference-service] CSVs in kuadrant-system: [e2e-llm-inference-service] authorino-operator.v1.4.1 Succeeded [e2e-llm-inference-service] cert-manager-operator.v1.20.0 Succeeded [e2e-llm-inference-service] dns-operator.v1.4.0 Succeeded [e2e-llm-inference-service] limitador-operator.v1.4.0 Succeeded [e2e-llm-inference-service] rhcl-operator.v1.4.1 Succeeded [e2e-llm-inference-service] CSVs in openshift-keda: [e2e-llm-inference-service] authorino-operator.v1.4.1 Succeeded [e2e-llm-inference-service] cert-manager-operator.v1.20.0 Succeeded [e2e-llm-inference-service] custom-metrics-autoscaler.v2.19.0-1 Succeeded [e2e-llm-inference-service] dns-operator.v1.4.0 Succeeded [e2e-llm-inference-service] limitador-operator.v1.4.0 Succeeded [e2e-llm-inference-service] rhcl-operator.v1.4.1 Succeeded [e2e-llm-inference-service] CSVs in cert-manager-operator: [e2e-llm-inference-service] authorino-operator.v1.4.1 Succeeded [e2e-llm-inference-service] cert-manager-operator.v1.20.0 Succeeded [e2e-llm-inference-service] dns-operator.v1.4.0 Succeeded [e2e-llm-inference-service] limitador-operator.v1.4.0 Succeeded [e2e-llm-inference-service] rhcl-operator.v1.4.1 Succeeded [e2e-llm-inference-service] CSVs in openshift-lws-operator: [e2e-llm-inference-service] authorino-operator.v1.4.1 Succeeded [e2e-llm-inference-service] cert-manager-operator.v1.20.0 Succeeded [e2e-llm-inference-service] dns-operator.v1.4.0 Succeeded [e2e-llm-inference-service] leader-worker-set.v1.0.0 Succeeded [e2e-llm-inference-service] limitador-operator.v1.4.0 Succeeded [e2e-llm-inference-service] rhcl-operator.v1.4.1 Succeeded [e2e-llm-inference-service] CSVs in openshift-operators (ODH / shared operators, filtered): [e2e-llm-inference-service] authorino-operator.v1.4.1 Succeeded [e2e-llm-inference-service] dns-operator.v1.4.0 Succeeded [e2e-llm-inference-service] limitador-operator.v1.4.0 Succeeded [e2e-llm-inference-service] rhcl-operator.v1.4.1 Succeeded [e2e-llm-inference-service] Kuadrant / Authorino (diagnostics): [e2e-llm-inference-service] CRD kuadrants.kuadrant.io versions: v1beta1 served=true storage=true [e2e-llm-inference-service] Subscriptions in kuadrant-system: [e2e-llm-inference-service] authorino-operator-stable-redhat-operators-openshift-marketplace stable redhat-operators authorino-operator.v1.4.1 [e2e-llm-inference-service] dns-operator-stable-redhat-operators-openshift-marketplace stable redhat-operators dns-operator.v1.4.0 [e2e-llm-inference-service] limitador-operator-stable-redhat-operators-openshift-marketplace stable redhat-operators limitador-operator.v1.4.0 [e2e-llm-inference-service] rhcl-operator stable redhat-operators rhcl-operator.v1.4.1 [e2e-llm-inference-service] Kuadrant CR conditions (kuadrant/kuadrant-system): [e2e-llm-inference-service] Ready=True (Ready) [e2e-llm-inference-service] KServe deployments in kserve: [e2e-llm-inference-service] kserve-controller-manager: ready=1 image=quay.io/opendatahub/kserve-controller@sha256:3af8f6b209a44c87a21ce2e0ec553929bba8086d258c434ac18056b800f65b55 [e2e-llm-inference-service] imageID: quay.io/opendatahub/kserve-controller@sha256:3af8f6b209a44c87a21ce2e0ec553929bba8086d258c434ac18056b800f65b55 [e2e-llm-inference-service] odh-model-controller: ready=1 image=quay.io/opendatahub/odh-model-controller:fast [e2e-llm-inference-service] imageID: quay.io/opendatahub/odh-model-controller@sha256:5d13ab3c20c8da1064020d19c1d95fd5a563c47cac7c19e4051ee53b992a80da [e2e-llm-inference-service] llmisvc-controller-manager: ready=1 image=quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:b6b293f866f662bd87aa23880c0bbf72defe55ad9d4d937d4b8699f9b082159a [e2e-llm-inference-service] imageID: quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:a9a2838eb00f2bd1bbeedc59a115a2793ca71536dcece047973fbf9792084c00 [e2e-llm-inference-service] === End E2E cluster / operator summary === [e2e-llm-inference-service] /workspace/source [e2e-llm-inference-service] CA certificate extracted [e2e-llm-inference-service] REQUESTS_CA_BUNDLE=/tmp/ca.crt [e2e-llm-inference-service] Run E2E tests: llminferenceservice and cluster_cpu and not autoscaling and not tracing [e2e-llm-inference-service] Starting E2E functional tests ... [e2e-llm-inference-service] Parallelism requested for pytest is 2 [e2e-llm-inference-service] ============================= test session starts ============================== [e2e-llm-inference-service] platform linux -- Python 3.11.13, pytest-7.4.4, pluggy-1.5.0 -- /workspace/source/python/kserve/.venv/bin/python [e2e-llm-inference-service] cachedir: .pytest_cache [e2e-llm-inference-service] metadata: {'Python': '3.11.13', 'Platform': 'Linux-5.14.0-570.122.1.el9_6.x86_64-x86_64-with-glibc2.34', 'Packages': {'pytest': '7.4.4', 'pluggy': '1.5.0'}, 'Plugins': {'asyncio': '0.23.8', 'anyio': '4.9.0', 'httpx': '0.30.0', 'metadata': '3.1.1', 'xdist': '3.6.1', 'cov': '5.0.0', 'json-report': '1.5.0'}, 'PLATFORM': 'el9'} [e2e-llm-inference-service] rootdir: /workspace/source/test/e2e [e2e-llm-inference-service] configfile: pytest.ini [e2e-llm-inference-service] plugins: asyncio-0.23.8, anyio-4.9.0, httpx-0.30.0, metadata-3.1.1, xdist-3.6.1, cov-5.0.0, json-report-1.5.0 [e2e-llm-inference-service] asyncio: mode=Mode.STRICT [e2e-llm-inference-service] created: 2/2 workers [e2e-llm-inference-service] 2 workers [42 items] [e2e-llm-inference-service] [e2e-llm-inference-service] scheduling tests via WorkStealingScheduling [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-precise-prefix-cache-inline-config-workload-llmd-simulator-kvcache] [e2e-llm-inference-service] llmisvc/test_gateway_section_name.py::test_gateway_section_name_propagation[cluster_single_node-cluster_cpu-with-section-name] 2026-07-08 16:46:04.981 6196 kserve INFO [conftest.py:configure_logger():40] Logger configured [e2e-llm-inference-service] 2026-07-08 16:46:04.982 6193 kserve INFO [conftest.py:configure_logger():40] Logger configured [e2e-llm-inference-service] 2026-07-08 16:46:05.039 6193 kserve.trace Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-08 16:46:05.039 6193 kserve.trace INFO [gw_api.py:create_or_update_gateway():34] Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-08 16:46:05.060 6193 kserve.trace Resource not found, creating Gateway router-gateway-1 [e2e-llm-inference-service] 2026-07-08 16:46:05.060 6193 kserve.trace INFO [gw_api.py:create_or_update_gateway():62] Resource not found, creating Gateway router-gateway-1 [e2e-llm-inference-service] 2026-07-08 16:46:05.068 6193 kserve.trace ✓ Successfully created Gateway router-gateway-1 [e2e-llm-inference-service] 2026-07-08 16:46:05.068 6193 kserve.trace INFO [gw_api.py:create_or_update_gateway():70] ✓ Successfully created Gateway router-gateway-1 [e2e-llm-inference-service] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_gateway_section_name.py::test_gateway_section_name_propagation[cluster_single_node-cluster_cpu-with-section-name] [e2e-llm-inference-service] llmisvc/test_gateway_section_name.py::test_gateway_section_name_propagation[cluster_single_node-cluster_cpu-without-section-name] 2026-07-08 16:46:18.161 6193 kserve.trace Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-08 16:46:18.161 6193 kserve.trace INFO [gw_api.py:create_or_update_gateway():34] Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-08 16:46:18.204 6193 kserve.trace ✓ Successfully updated Gateway router-gateway-1 [e2e-llm-inference-service] 2026-07-08 16:46:18.204 6193 kserve.trace INFO [gw_api.py:create_or_update_gateway():57] ✓ Successfully updated Gateway router-gateway-1 [e2e-llm-inference-service] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_gateway_section_name.py::test_gateway_section_name_propagation[cluster_single_node-cluster_cpu-without-section-name] [e2e-llm-inference-service] llmisvc/test_llm_auth.py::test_llm_auth_enabled_requires_token[cluster_cpu-cluster_single_node-auth-enabled-default] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-precise-prefix-cache-inline-config-workload-llmd-simulator-kvcache] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator0] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator0] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator1] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_auth.py::test_llm_auth_enabled_requires_token[cluster_cpu-cluster_single_node-auth-enabled-default] [e2e-llm-inference-service] llmisvc/test_llm_auth.py::test_llm_auth_invalid_token_rejected[cluster_cpu-cluster_single_node-auth-invalid-token] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator1] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator2] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_auth.py::test_llm_auth_invalid_token_rejected[cluster_cpu-cluster_single_node-auth-invalid-token] [e2e-llm-inference-service] llmisvc/test_llm_auth.py::test_llm_auth_disabled_no_token_required[cluster_cpu-cluster_single_node-auth-disabled] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator2] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m-with-lora-hf0] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_auth.py::test_llm_auth_disabled_no_token_required[cluster_cpu-cluster_single_node-auth-disabled] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-gateway-ref-router-with-managed-route-model-fb-opt-125m-workload-llmd-simulator] 2026-07-08 16:56:06.775 6193 kserve.trace Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-08 16:56:06.775 6193 kserve.trace INFO [gw_api.py:create_or_update_gateway():34] Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-08 16:56:06.823 6193 kserve.trace ✓ Successfully updated Gateway router-gateway-1 [e2e-llm-inference-service] 2026-07-08 16:56:06.823 6193 kserve.trace INFO [gw_api.py:create_or_update_gateway():57] ✓ Successfully updated Gateway router-gateway-1 [e2e-llm-inference-service] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m-with-lora-hf0] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m-with-lora-hf1] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m-with-lora-hf1] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-pvc] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-gateway-ref-router-with-managed-route-model-fb-opt-125m-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-pvc] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-pd-cpu-model-pvc] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-custom-route-timeout-scheduler-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-pd-cpu-model-pvc] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_multi_node-router-managed-workload-simulated-dp-ep-cpu-model-pvc] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-custom-route-timeout-scheduler-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-refs-scheduler-managed-workload-single-cpu-model-fb-opt-125m] 2026-07-08 17:09:29.351 6193 kserve.trace Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-08 17:09:29.351 6193 kserve.trace INFO [gw_api.py:create_or_update_gateway():34] Checking Gateway router-gateway-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-08 17:09:29.397 6193 kserve.trace ✓ Successfully updated Gateway router-gateway-1 [e2e-llm-inference-service] 2026-07-08 17:09:29.397 6193 kserve.trace INFO [gw_api.py:create_or_update_gateway():57] ✓ Successfully updated Gateway router-gateway-1 [e2e-llm-inference-service] 2026-07-08 17:09:29.398 6193 kserve.trace Checking HttpRoute router-route-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-08 17:09:29.398 6193 kserve.trace INFO [gw_api.py:create_or_update_route():121] Checking HttpRoute router-route-1 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-08 17:09:29.401 6193 kserve.trace Resource not found, creating HttpRoute router-route-1 [e2e-llm-inference-service] 2026-07-08 17:09:29.401 6193 kserve.trace INFO [gw_api.py:create_or_update_route():149] Resource not found, creating HttpRoute router-route-1 [e2e-llm-inference-service] 2026-07-08 17:09:29.410 6193 kserve.trace ✓ Successfully created HttpRoute router-route-1 [e2e-llm-inference-service] 2026-07-08 17:09:29.410 6193 kserve.trace INFO [gw_api.py:create_or_update_route():157] ✓ Successfully created HttpRoute router-route-1 [e2e-llm-inference-service] 2026-07-08 17:09:29.410 6193 kserve.trace Checking HttpRoute router-route-2 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-08 17:09:29.410 6193 kserve.trace INFO [gw_api.py:create_or_update_route():121] Checking HttpRoute router-route-2 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-08 17:09:29.419 6193 kserve.trace Resource not found, creating HttpRoute router-route-2 [e2e-llm-inference-service] 2026-07-08 17:09:29.419 6193 kserve.trace INFO [gw_api.py:create_or_update_route():149] Resource not found, creating HttpRoute router-route-2 [e2e-llm-inference-service] 2026-07-08 17:09:29.428 6193 kserve.trace ✓ Successfully created HttpRoute router-route-2 [e2e-llm-inference-service] 2026-07-08 17:09:29.428 6193 kserve.trace INFO [gw_api.py:create_or_update_route():157] ✓ Successfully created HttpRoute router-route-2 [e2e-llm-inference-service] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-refs-scheduler-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_multi_node-router-managed-workload-simulated-dp-ep-cpu-model-pvc] [e2e-llm-inference-service] llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_v1alpha1_to_v1alpha2_conversion [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_v1alpha1_to_v1alpha2_conversion [e2e-llm-inference-service] llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_v1alpha2_to_v1alpha1_conversion [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_v1alpha2_to_v1alpha1_conversion [e2e-llm-inference-service] llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_criticality_preservation_via_annotations [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_criticality_preservation_via_annotations [e2e-llm-inference-service] llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_lora_criticality_preservation [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_lora_criticality_preservation [e2e-llm-inference-service] llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_round_trip_conversion_preserves_fields [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service_conversion.py::TestLLMInferenceServiceConversion::test_round_trip_conversion_preserves_fields [e2e-llm-inference-service] llmisvc/test_llm_inference_service_stop.py::test_llm_stop_feature[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-custom-route-timeout-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-custom-route-timeout-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-refs-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] 2026-07-08 17:20:19.950 6193 kserve.trace Checking Gateway router-gateway-2 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-08 17:20:19.950 6193 kserve.trace INFO [gw_api.py:create_or_update_gateway():34] Checking Gateway router-gateway-2 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-08 17:20:19.992 6193 kserve.trace Resource not found, creating Gateway router-gateway-2 [e2e-llm-inference-service] 2026-07-08 17:20:19.992 6193 kserve.trace INFO [gw_api.py:create_or_update_gateway():62] Resource not found, creating Gateway router-gateway-2 [e2e-llm-inference-service] 2026-07-08 17:20:20.001 6193 kserve.trace ✓ Successfully created Gateway router-gateway-2 [e2e-llm-inference-service] 2026-07-08 17:20:20.001 6193 kserve.trace INFO [gw_api.py:create_or_update_gateway():70] ✓ Successfully created Gateway router-gateway-2 [e2e-llm-inference-service] 2026-07-08 17:20:20.002 6193 kserve.trace Checking HttpRoute router-route-3 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-08 17:20:20.002 6193 kserve.trace INFO [gw_api.py:create_or_update_route():121] Checking HttpRoute router-route-3 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-08 17:20:20.006 6193 kserve.trace Resource not found, creating HttpRoute router-route-3 [e2e-llm-inference-service] 2026-07-08 17:20:20.006 6193 kserve.trace INFO [gw_api.py:create_or_update_route():149] Resource not found, creating HttpRoute router-route-3 [e2e-llm-inference-service] 2026-07-08 17:20:20.024 6193 kserve.trace ✓ Successfully created HttpRoute router-route-3 [e2e-llm-inference-service] 2026-07-08 17:20:20.024 6193 kserve.trace INFO [gw_api.py:create_or_update_route():157] ✓ Successfully created HttpRoute router-route-3 [e2e-llm-inference-service] 2026-07-08 17:20:20.024 6193 kserve.trace Checking HttpRoute router-route-4 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-08 17:20:20.024 6193 kserve.trace INFO [gw_api.py:create_or_update_route():121] Checking HttpRoute router-route-4 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] 2026-07-08 17:20:20.046 6193 kserve.trace Resource not found, creating HttpRoute router-route-4 [e2e-llm-inference-service] 2026-07-08 17:20:20.046 6193 kserve.trace INFO [gw_api.py:create_or_update_route():149] Resource not found, creating HttpRoute router-route-4 [e2e-llm-inference-service] 2026-07-08 17:20:20.065 6193 kserve.trace ✓ Successfully created HttpRoute router-route-4 [e2e-llm-inference-service] 2026-07-08 17:20:20.065 6193 kserve.trace INFO [gw_api.py:create_or_update_route():157] ✓ Successfully created HttpRoute router-route-4 [e2e-llm-inference-service] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service_stop.py::test_llm_stop_feature[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_lora_adapters.py::test_llm_with_lora_adapters[cluster_cpu-single-lora-adapter-hf] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_lora_adapters.py::test_llm_with_lora_adapters[cluster_cpu-single-lora-adapter-hf] [e2e-llm-inference-service] llmisvc/test_llm_lora_adapters.py::test_llm_with_lora_adapters[cluster_cpu-multiple-lora-adapters] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-refs-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-no-scheduler-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_lora_adapters.py::test_llm_with_lora_adapters[cluster_cpu-multiple-lora-adapters] [e2e-llm-inference-service] llmisvc/test_llm_tls.py::test_llm_tls_resources[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-no-scheduler-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_multi_node-router-managed-workload-simulated-dp-ep-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_tls.py::test_llm_tls_resources[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_prestop_hook.py::test_prestop_hook[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_multi_node-router-managed-workload-simulated-dp-ep-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-inline-config-workload-llmd-simulator] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-inline-config-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator-model-qwen2.5-0.5b] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_prestop_hook.py::test_prestop_hook[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_rolling_upgrade.py::test_rolling_upgrade_coordination[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator-model-fb-opt-125m] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator-model-qwen2.5-0.5b] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-configmap-ref-workload-llmd-simulator] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_rolling_upgrade.py::test_rolling_upgrade_coordination[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_storage_version_migration.py::TestStorageVersionMigration::test_storage_version_migration_after_simulated_upgrade [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-configmap-ref-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-replicas-workload-llmd-simulator] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_storage_version_migration.py::TestStorageVersionMigration::test_storage_version_migration_after_simulated_upgrade [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-v06-pd-config-migration-workload-llmd-simulator-pd] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-replicas-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-custom-template-workload-llmd-simulator] [e2e-llm-inference-service] [gw0] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-custom-template-workload-llmd-simulator] [e2e-llm-inference-service] [gw1] FAILED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-v06-pd-config-migration-workload-llmd-simulator-pd] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-v06-nonzero-threshold-migration-workload-llmd-simulator-pd] [e2e-llm-inference-service] [gw1] PASSED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-v06-nonzero-threshold-migration-workload-llmd-simulator-pd] [e2e-llm-inference-service] [e2e-llm-inference-service] =================================== FAILURES =================================== [e2e-llm-inference-service] _ test_llm_inference_service[router-managed-scheduler-v06-pd-config-migration-workload-llmd-simulator-pd] _ [e2e-llm-inference-service] [gw1] linux -- Python 3.11.13 /workspace/source/python/kserve/.venv/bin/python [e2e-llm-inference-service] [e2e-llm-inference-service] test_case = TestCase(base_refs=['router-managed', 'scheduler-v06-pd-config-migration', 'workload-llmd-simulator-pd'], prompt='KSer... {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}, model_name='facebook/opt-125m') [e2e-llm-inference-service] [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] @pytest.mark.asyncio(loop_scope="session") [e2e-llm-inference-service] @pytest.mark.parametrize( [e2e-llm-inference-service] "test_case", [e2e-llm-inference-service] [ [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-with-gateway-ref", [e2e-llm-inference-service] "router-with-managed-route", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] endpoint="/v1/completions", [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] payload_formatter=completions_payload, [e2e-llm-inference-service] response_assertion=create_response_assertion(with_field="choices"), [e2e-llm-inference-service] expected_gateway=ROUTER_GATEWAYS[0], [e2e-llm-inference-service] before_test=[ [e2e-llm-inference-service] lambda: create_router_resources( [e2e-llm-inference-service] gateways=[ROUTER_GATEWAYS[0]], [e2e-llm-inference-service] ) [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] pytest.mark.custom_gateway, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] payload_formatter=completions_payload, [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-custom-route-timeout", [e2e-llm-inference-service] "scheduler-managed", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="custom-route-timeout-test", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-with-refs", [e2e-llm-inference-service] "scheduler-managed", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="router-with-refs-test", [e2e-llm-inference-service] expected_gateway=ROUTER_GATEWAYS[0], [e2e-llm-inference-service] before_test=[ [e2e-llm-inference-service] lambda: create_router_resources( [e2e-llm-inference-service] gateways=[ROUTER_GATEWAYS[0]], [e2e-llm-inference-service] routes=[ROUTER_ROUTES[0], ROUTER_ROUTES[1]], [e2e-llm-inference-service] ) [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.custom_gateway, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=["router-managed", "workload-pd-cpu", "model-fb-opt-125m"], [e2e-llm-inference-service] prompt="You are an expert in Kubernetes-native machine learning serving platforms, with deep knowledge of the KServe project. " [e2e-llm-inference-service] "Explain the challenges of serving large-scale models, GPU scheduling, and how KServe integrates with capabilities like multi-model serving. " [e2e-llm-inference-service] "Provide a detailed comparison with open source alternatives, focusing on operational trade-offs.", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-custom-route-timeout-pd", [e2e-llm-inference-service] "scheduler-managed", [e2e-llm-inference-service] "workload-pd-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="You are an expert in Kubernetes-native machine learning serving platforms, with deep knowledge of the KServe project. " [e2e-llm-inference-service] "Explain the challenges of serving large-scale models, GPU scheduling, and how KServe integrates with capabilities like multi-model serving. " [e2e-llm-inference-service] "Provide a detailed comparison with open source alternatives, focusing on operational trade-offs.", [e2e-llm-inference-service] service_name="custom-route-timeout-pd-test", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-with-refs-pd", [e2e-llm-inference-service] "scheduler-managed", [e2e-llm-inference-service] "workload-pd-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="You are an expert in Kubernetes-native machine learning serving platforms, with deep knowledge of the KServe project. " [e2e-llm-inference-service] "Explain the challenges of serving large-scale models, GPU scheduling, and how KServe integrates with capabilities like multi-model serving. " [e2e-llm-inference-service] "Provide a detailed comparison with open source alternatives, focusing on operational trade-offs.", [e2e-llm-inference-service] service_name="router-with-refs-pd-test", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] expected_gateway=ROUTER_GATEWAYS[1], [e2e-llm-inference-service] before_test=[ [e2e-llm-inference-service] lambda: create_router_resources( [e2e-llm-inference-service] gateways=[ROUTER_GATEWAYS[1]], [e2e-llm-inference-service] routes=[ROUTER_ROUTES[2], ROUTER_ROUTES[3]], [e2e-llm-inference-service] ) [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.custom_gateway, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-dp-ep-gpu", [e2e-llm-inference-service] "workload-dp-ep-prefill-gpu", [e2e-llm-inference-service] "model-deepseek-v2-lite", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="Delve into the multifaceted implications of a fully disaggregated cloud architecture, specifically " [e2e-llm-inference-service] "where the compute plane (P) and the data plane (D) are independently deployed and managed for a " [e2e-llm-inference-service] "geographically distributed, high-throughput, low-latency microservices ecosystem. Beyond the " [e2e-llm-inference-service] "fundamental challenges of network latency and data consistency, elaborate on the advanced " [e2e-llm-inference-service] "considerations and trade-offs inherent in such a setup: 1. Network Architecture and Protocols: " [e2e-llm-inference-service] "How would the network fabric and underlying protocols (e.g., RDMA, custom transport layers) need to " [e2e-llm-inference-service] "evolve to support optimal performance and minimize inter-plane communication overhead, especially for " [e2e-llm-inference-service] "synchronous operations? Discuss the role of network programmability (e.g., SDN, P4) in dynamically " [e2e-llm-inference-service] "optimizing routing and traffic flow between P and D. 2. Advanced Data Consistency and Durability: " [e2e-llm-inference-service] "Explore sophisticated data consistency models (e.g., causal consistency, strong eventual consistency) " [e2e-llm-inference-service] "and their applicability in balancing performance and data integrity across a globally distributed data plane. " [e2e-llm-inference-service] "Detail strategies for ensuring data durability and fault tolerance, including multi-region replication, " [e2e-llm-inference-service] "intelligent partitioning, and recovery mechanisms in the event of partial or full plane failures. " [e2e-llm-inference-service] "3. Dynamic Resource Orchestration and Cost Optimization: Analyze how an orchestration layer would intelligently " [e2e-llm-inference-service] "manage the independent scaling of compute (P) and data (D) resources, considering fluctuating workloads, " [e2e-llm-inference-service] "cost efficiency, and performance targets (e.g., using predictive analytics for resource provisioning). " [e2e-llm-inference-service] "Discuss mechanisms for dynamically reallocating compute nodes to different data partitions based on " [e2e-llm-inference-service] "workload patterns and data locality, potentially involving live migration strategies. " [e2e-llm-inference-service] "4. Security and Compliance in a Distributed Landscape: Address the enhanced security perimeter " [e2e-llm-inference-service] "challenges, including securing communication channels between P and D (encryption in transit, mutual TLS), " [e2e-llm-inference-service] "fine-grained access control to data at rest and in motion, and identity management across disaggregated " [e2e-llm-inference-service] "components. Discuss how such an architecture impacts compliance with regulatory frameworks (e.g., GDPR, HIPAA) " [e2e-llm-inference-service] "concerning data sovereignty, privacy, and auditability. 5. Operational Complexity and Observability: " [e2e-llm-inference-service] "Examine the increased complexity in monitoring, logging, and tracing across highly decoupled compute and " [e2e-llm-inference-service] "data planes. What specialized tooling and practices (e.g., distributed tracing with OpenTelemetry, advanced AIOps) " [e2e-llm-inference-service] "would be essential? How would incident response and troubleshooting differ in this disaggregated environment " [e2e-llm-inference-service] "compared to traditional integrated systems? Consider the challenges of pinpointing root causes across " [e2e-llm-inference-service] "independent failures. 6. Real-world Applicability and Future Trends: Identify specific industries " [e2e-llm-inference-service] "or use cases (e.g., high-frequency trading, IoT edge processing, large language model inference) " [e2e-llm-inference-service] "where the benefits of P/D disaggregation would strongly outweigh its complexities. " [e2e-llm-inference-service] "Conclude by speculating on emerging technologies or paradigms (e.g., serverless compute functions " [e2e-llm-inference-service] "directly interacting with object storage, in-memory disaggregation) that could further drive or " [e2e-llm-inference-service] "transform P/D disaggregation in cloud computing.", [e2e-llm-inference-service] max_tokens=2000, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_gpu, [e2e-llm-inference-service] pytest.mark.cluster_nvidia, [e2e-llm-inference-service] pytest.mark.cluster_nvidia_roce, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-no-scheduler", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="What is KServe?", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.no_scheduler, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-simulated-dp-ep-cpu", [e2e-llm-inference-service] "model-fb-opt-125m", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="This test simulates DP+EP that can run on CPU, the idea is to test the LWS-based deployment, " [e2e-llm-inference-service] "but without the resources requirements for DP+EP (GPUs and ROCe/IB).", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_multi_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Scheduler config tests [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-with-inline-config", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="scheduler-inline-config-test", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Chat completions endpoint coverage [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] "model-qwen2.5-0.5b", [e2e-llm-inference-service] ], [e2e-llm-inference-service] model_name="Qwen/Qwen2.5-0.5B-Instruct", [e2e-llm-inference-service] endpoint="/v1/chat/completions", [e2e-llm-inference-service] prompt="What is KServe?", [e2e-llm-inference-service] payload_formatter=chat_completions_payload, [e2e-llm-inference-service] response_assertion=create_response_assertion(with_field="choices"), [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-with-configmap-ref", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="scheduler-configmap-ref-test", [e2e-llm-inference-service] before_test=[create_scheduler_configmap], [e2e-llm-inference-service] after_test=[delete_scheduler_configmap], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-with-replicas", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="scheduler-ha-replicas-test", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-with-custom-template", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="scheduler-custom-template-test", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[pytest.mark.cluster_cpu, pytest.mark.cluster_single_node], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Scheduler v0.6 → v0.7 migration tests. [e2e-llm-inference-service] # Deploy v0.6-style configs and verify the controller migrates them [e2e-llm-inference-service] # so the v0.7 scheduler boots successfully. [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-v06-pd-config-migration", [e2e-llm-inference-service] "workload-llmd-simulator-pd", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="scheduler-v06-pd-migration-test", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-v06-nonzero-threshold-migration", [e2e-llm-inference-service] "workload-llmd-simulator-pd", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="scheduler-v06-threshold-migration-test", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Precise prefix KV cache routing test [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "scheduler-with-precise-prefix-cache-inline-config", [e2e-llm-inference-service] "workload-llmd-simulator-kvcache", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] service_name="precise-prefix-cache-test", [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Models endpoint coverage [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] endpoint="/v1/models", [e2e-llm-inference-service] response_assertion=create_response_assertion(with_field="data"), [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Model-based routing via X-Gateway-Model-Name header — /v1/completions [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] endpoint="/v1/completions", [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] payload_formatter=completions_payload, [e2e-llm-inference-service] response_assertion=assert_model_field_matches("facebook/opt-125m"), [e2e-llm-inference-service] url_getter=get_model_routing_url, [e2e-llm-inference-service] extra_headers={ [e2e-llm-inference-service] MODEL_ROUTING_HEADER: f"publishers/{KSERVE_TEST_NAMESPACE}/models/facebook/opt-125m", [e2e-llm-inference-service] }, [e2e-llm-inference-service] peers=[ [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] "model-qwen2.5-0.5b", [e2e-llm-inference-service] ], [e2e-llm-inference-service] endpoint="/v1/completions", [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] payload_formatter=completions_payload, [e2e-llm-inference-service] response_assertion=assert_model_field_matches( [e2e-llm-inference-service] "Qwen/Qwen2.5-0.5B-Instruct" [e2e-llm-inference-service] ), [e2e-llm-inference-service] url_getter=get_model_routing_url, [e2e-llm-inference-service] extra_headers={ [e2e-llm-inference-service] MODEL_ROUTING_HEADER: f"publishers/{KSERVE_TEST_NAMESPACE}/models/Qwen/Qwen2.5-0.5B-Instruct", [e2e-llm-inference-service] }, [e2e-llm-inference-service] ), [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] pytest.mark.model_routing, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Model-based routing via X-Gateway-Model-Name header — /v1/chat/completions [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] ], [e2e-llm-inference-service] endpoint="/v1/chat/completions", [e2e-llm-inference-service] prompt="What is KServe?", [e2e-llm-inference-service] payload_formatter=chat_completions_payload, [e2e-llm-inference-service] response_assertion=assert_model_field_matches("facebook/opt-125m"), [e2e-llm-inference-service] url_getter=get_model_routing_url, [e2e-llm-inference-service] extra_headers={ [e2e-llm-inference-service] MODEL_ROUTING_HEADER: f"publishers/{KSERVE_TEST_NAMESPACE}/models/facebook/opt-125m", [e2e-llm-inference-service] }, [e2e-llm-inference-service] peers=[ [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-llmd-simulator", [e2e-llm-inference-service] "model-qwen2.5-0.5b", [e2e-llm-inference-service] ], [e2e-llm-inference-service] endpoint="/v1/chat/completions", [e2e-llm-inference-service] prompt="What is KServe?", [e2e-llm-inference-service] payload_formatter=chat_completions_payload, [e2e-llm-inference-service] response_assertion=assert_model_field_matches( [e2e-llm-inference-service] "Qwen/Qwen2.5-0.5B-Instruct" [e2e-llm-inference-service] ), [e2e-llm-inference-service] url_getter=get_model_routing_url, [e2e-llm-inference-service] extra_headers={ [e2e-llm-inference-service] MODEL_ROUTING_HEADER: f"publishers/{KSERVE_TEST_NAMESPACE}/models/Qwen/Qwen2.5-0.5B-Instruct", [e2e-llm-inference-service] }, [e2e-llm-inference-service] ), [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.llmd_simulator, [e2e-llm-inference-service] pytest.mark.model_routing, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Model-based routing via X-Gateway-Model-Name header — LoRA adapter [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m-with-lora-hf", [e2e-llm-inference-service] ], [e2e-llm-inference-service] endpoint="/v1/completions", [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] model_name=f"publishers/{KSERVE_TEST_NAMESPACE}/models/lora-adapter-1", [e2e-llm-inference-service] payload_formatter=completions_payload, [e2e-llm-inference-service] response_assertion=assert_model_field_matches( [e2e-llm-inference-service] f"publishers/{KSERVE_TEST_NAMESPACE}/models/lora-adapter-1" [e2e-llm-inference-service] ), [e2e-llm-inference-service] url_getter=get_model_routing_url, [e2e-llm-inference-service] extra_headers={ [e2e-llm-inference-service] MODEL_ROUTING_HEADER: f"publishers/{KSERVE_TEST_NAMESPACE}/models/lora-adapter-1", [e2e-llm-inference-service] }, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.model_routing, [e2e-llm-inference-service] pytest.mark.lora, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # Model-based routing via X-Gateway-Model-Name header — /v1/models (base + LoRA) [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-fb-opt-125m-with-lora-hf", [e2e-llm-inference-service] ], [e2e-llm-inference-service] endpoint="/v1/models", [e2e-llm-inference-service] response_assertion=assert_models_contains( [e2e-llm-inference-service] "facebook/opt-125m", [e2e-llm-inference-service] f"publishers/{KSERVE_TEST_NAMESPACE}/models/facebook/opt-125m", [e2e-llm-inference-service] "lora-adapter-1", [e2e-llm-inference-service] f"publishers/{KSERVE_TEST_NAMESPACE}/models/lora-adapter-1", [e2e-llm-inference-service] ), [e2e-llm-inference-service] url_getter=get_model_routing_url, [e2e-llm-inference-service] extra_headers={ [e2e-llm-inference-service] MODEL_ROUTING_HEADER: f"publishers/{KSERVE_TEST_NAMESPACE}/models/facebook/opt-125m", [e2e-llm-inference-service] }, [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.model_routing, [e2e-llm-inference-service] pytest.mark.lora, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] # PVC storage tests -- validate direct PVC volume mount with real vLLM serving [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-single-cpu", [e2e-llm-inference-service] "model-pvc", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] before_test=[ensure_pvc_with_model], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.pvc_storage, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-pd-cpu", [e2e-llm-inference-service] "model-pvc", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] response_assertion=assert_200_with_choices, [e2e-llm-inference-service] before_test=[ensure_pvc_with_model], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_single_node, [e2e-llm-inference-service] pytest.mark.pvc_storage, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] pytest.param( [e2e-llm-inference-service] TestCase( [e2e-llm-inference-service] base_refs=[ [e2e-llm-inference-service] "router-managed", [e2e-llm-inference-service] "workload-simulated-dp-ep-cpu", [e2e-llm-inference-service] "model-pvc", [e2e-llm-inference-service] ], [e2e-llm-inference-service] prompt="KServe is a", [e2e-llm-inference-service] before_test=[ensure_pvc_with_model], [e2e-llm-inference-service] ), [e2e-llm-inference-service] marks=[ [e2e-llm-inference-service] pytest.mark.cluster_cpu, [e2e-llm-inference-service] pytest.mark.cluster_multi_node, [e2e-llm-inference-service] pytest.mark.pvc_storage, [e2e-llm-inference-service] ], [e2e-llm-inference-service] ), [e2e-llm-inference-service] ], [e2e-llm-inference-service] indirect=["test_case"], [e2e-llm-inference-service] ids=generate_test_id, [e2e-llm-inference-service] ) [e2e-llm-inference-service] @log_execution [e2e-llm-inference-service] def test_llm_inference_service(test_case: TestCase): # noqa: F811 [e2e-llm-inference-service] inject_k8s_proxy() [e2e-llm-inference-service] [e2e-llm-inference-service] kserve_client = KServeClient( [e2e-llm-inference-service] config_file=os.environ.get("KUBECONFIG", "~/.kube/config"), [e2e-llm-inference-service] client_configuration=client.Configuration(), [e2e-llm-inference-service] ) [e2e-llm-inference-service] [e2e-llm-inference-service] service_name = test_case.llm_service.metadata.name [e2e-llm-inference-service] if not test_case.llm_service.metadata.annotations: [e2e-llm-inference-service] test_case.llm_service.metadata.annotations = {} [e2e-llm-inference-service] [e2e-llm-inference-service] test_case.llm_service.metadata.annotations[ [e2e-llm-inference-service] "security.opendatahub.io/enable-auth" [e2e-llm-inference-service] ] = "false" [e2e-llm-inference-service] prefix = test_case.log_prefix [e2e-llm-inference-service] [e2e-llm-inference-service] test_failed = False [e2e-llm-inference-service] try: [e2e-llm-inference-service] print(f"{prefix} Creating LLMInferenceService {service_name}") [e2e-llm-inference-service] create_llmisvc(kserve_client, test_case.llm_service) [e2e-llm-inference-service] print(f"{prefix} Waiting for LLMInferenceService {service_name} to be ready") [e2e-llm-inference-service] wait_for_llm_isvc_ready( [e2e-llm-inference-service] kserve_client, test_case.llm_service, test_case.wait_timeout [e2e-llm-inference-service] ) [e2e-llm-inference-service] print(f"{prefix} Waiting for model response from {service_name}") [e2e-llm-inference-service] > wait_for_model_response( [e2e-llm-inference-service] kserve_client, [e2e-llm-inference-service] test_case, [e2e-llm-inference-service] test_case.wait_timeout, [e2e-llm-inference-service] extra_headers=test_case.extra_headers, [e2e-llm-inference-service] ) [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:816: [e2e-llm-inference-service] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [e2e-llm-inference-service] [e2e-llm-inference-service] args = (, TestCase(base_refs=['router-managed', 'scheduler-v0... {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}, model_name='facebook/opt-125m'), 900) [e2e-llm-inference-service] kwargs = {'extra_headers': None}, func_name = 'wait_for_model_response' [e2e-llm-inference-service] timestamp_start = '2026-07-08T17:35:53.739600', start_time = 1783532153.739859 [e2e-llm-inference-service] duration = 1103.0357158184052, timestamp_end = '2026-07-08T17:54:16.775577' [e2e-llm-inference-service] [e2e-llm-inference-service] @functools.wraps(func) [e2e-llm-inference-service] def wrapper(*args, **kwargs): [e2e-llm-inference-service] func_name = func.__name__ [e2e-llm-inference-service] [e2e-llm-inference-service] timestamp_start = datetime.now().isoformat() [e2e-llm-inference-service] logger.info( [e2e-llm-inference-service] f"[{func_name}] [{timestamp_start}] start - args={args}, kwargs={kwargs}" [e2e-llm-inference-service] ) [e2e-llm-inference-service] start_time = time.time() [e2e-llm-inference-service] [e2e-llm-inference-service] try: [e2e-llm-inference-service] > result = func(*args, **kwargs) [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/logging.py:40: [e2e-llm-inference-service] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [e2e-llm-inference-service] [e2e-llm-inference-service] kserve_client = [e2e-llm-inference-service] test_case = TestCase(base_refs=['router-managed', 'scheduler-v06-pd-config-migration', 'workload-llmd-simulator-pd'], prompt='KSer... {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}, model_name='facebook/opt-125m') [e2e-llm-inference-service] timeout_seconds = 900, extra_headers = None [e2e-llm-inference-service] [e2e-llm-inference-service] @log_execution [e2e-llm-inference-service] def wait_for_model_response( [e2e-llm-inference-service] kserve_client: KServeClient, [e2e-llm-inference-service] test_case: TestCase, # noqa: F811 [e2e-llm-inference-service] timeout_seconds: int = 900, [e2e-llm-inference-service] extra_headers: Optional[Dict[str, str]] = None, [e2e-llm-inference-service] ) -> str: [e2e-llm-inference-service] def get_successful_response(): [e2e-llm-inference-service] try: [e2e-llm-inference-service] if test_case.url_getter: [e2e-llm-inference-service] service_url = test_case.url_getter(kserve_client, test_case.llm_service) [e2e-llm-inference-service] else: [e2e-llm-inference-service] service_url = get_llm_service_url(kserve_client, test_case.llm_service) [e2e-llm-inference-service] except Exception as e: [e2e-llm-inference-service] raise AssertionError(f"❌ Failed to get service URL: {e}") from e [e2e-llm-inference-service] [e2e-llm-inference-service] model_url = service_url + test_case.endpoint [e2e-llm-inference-service] [e2e-llm-inference-service] headers = {"Content-Type": "application/json"} [e2e-llm-inference-service] if extra_headers: [e2e-llm-inference-service] headers.update(extra_headers) [e2e-llm-inference-service] [e2e-llm-inference-service] if test_case.payload_formatter is not None: [e2e-llm-inference-service] test_payload = test_case.payload_formatter(test_case) [e2e-llm-inference-service] elif test_case.prompt is not None: [e2e-llm-inference-service] test_payload = { [e2e-llm-inference-service] "model": test_case.model_name [e2e-llm-inference-service] if not extra_headers or MODEL_ROUTING_HEADER not in extra_headers [e2e-llm-inference-service] else extra_headers[MODEL_ROUTING_HEADER], [e2e-llm-inference-service] "prompt": test_case.prompt, [e2e-llm-inference-service] "max_tokens": test_case.max_tokens, [e2e-llm-inference-service] } [e2e-llm-inference-service] else: [e2e-llm-inference-service] test_payload = None [e2e-llm-inference-service] [e2e-llm-inference-service] logger.info(f"Calling LLM service at {model_url} with payload {test_payload}") [e2e-llm-inference-service] try: [e2e-llm-inference-service] if test_payload is not None: [e2e-llm-inference-service] response = post_with_retry( [e2e-llm-inference-service] model_url, [e2e-llm-inference-service] headers=headers, [e2e-llm-inference-service] json_data=test_payload, [e2e-llm-inference-service] timeout=test_case.response_timeout, [e2e-llm-inference-service] ) [e2e-llm-inference-service] else: [e2e-llm-inference-service] response = get_with_retry( [e2e-llm-inference-service] model_url, [e2e-llm-inference-service] headers=headers, [e2e-llm-inference-service] timeout=test_case.response_timeout, [e2e-llm-inference-service] ) [e2e-llm-inference-service] except Exception as e: [e2e-llm-inference-service] logger.error(f"❌ Failed to call model: {e}") [e2e-llm-inference-service] raise AssertionError(f"❌ Failed to call model: {e}") from e [e2e-llm-inference-service] [e2e-llm-inference-service] logger.info(f"Model response is {response.status_code}: {response.text[:500]}") [e2e-llm-inference-service] [e2e-llm-inference-service] if 200 <= response.status_code < 300: [e2e-llm-inference-service] return response [e2e-llm-inference-service] raise AssertionError( [e2e-llm-inference-service] f"Service returned {response.status_code}: {response.text}" [e2e-llm-inference-service] ) [e2e-llm-inference-service] [e2e-llm-inference-service] > response = wait_for(get_successful_response, timeout=timeout_seconds, interval=5.0) [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:1119: [e2e-llm-inference-service] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [e2e-llm-inference-service] [e2e-llm-inference-service] assertion_fn = .get_successful_response at 0x7faad0722fc0> [e2e-llm-inference-service] timeout = 900, interval = 5.0 [e2e-llm-inference-service] [e2e-llm-inference-service] def wait_for( [e2e-llm-inference-service] assertion_fn: Callable[[], Any], timeout: float = 5.0, interval: float = 0.1 [e2e-llm-inference-service] ) -> Any: [e2e-llm-inference-service] """Wait for the assertion to succeed within timeout.""" [e2e-llm-inference-service] deadline = time.time() + timeout [e2e-llm-inference-service] last_msg = None [e2e-llm-inference-service] while True: [e2e-llm-inference-service] try: [e2e-llm-inference-service] > return assertion_fn() [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:1215: [e2e-llm-inference-service] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [e2e-llm-inference-service] [e2e-llm-inference-service] def get_successful_response(): [e2e-llm-inference-service] try: [e2e-llm-inference-service] if test_case.url_getter: [e2e-llm-inference-service] service_url = test_case.url_getter(kserve_client, test_case.llm_service) [e2e-llm-inference-service] else: [e2e-llm-inference-service] service_url = get_llm_service_url(kserve_client, test_case.llm_service) [e2e-llm-inference-service] except Exception as e: [e2e-llm-inference-service] raise AssertionError(f"❌ Failed to get service URL: {e}") from e [e2e-llm-inference-service] [e2e-llm-inference-service] model_url = service_url + test_case.endpoint [e2e-llm-inference-service] [e2e-llm-inference-service] headers = {"Content-Type": "application/json"} [e2e-llm-inference-service] if extra_headers: [e2e-llm-inference-service] headers.update(extra_headers) [e2e-llm-inference-service] [e2e-llm-inference-service] if test_case.payload_formatter is not None: [e2e-llm-inference-service] test_payload = test_case.payload_formatter(test_case) [e2e-llm-inference-service] elif test_case.prompt is not None: [e2e-llm-inference-service] test_payload = { [e2e-llm-inference-service] "model": test_case.model_name [e2e-llm-inference-service] if not extra_headers or MODEL_ROUTING_HEADER not in extra_headers [e2e-llm-inference-service] else extra_headers[MODEL_ROUTING_HEADER], [e2e-llm-inference-service] "prompt": test_case.prompt, [e2e-llm-inference-service] "max_tokens": test_case.max_tokens, [e2e-llm-inference-service] } [e2e-llm-inference-service] else: [e2e-llm-inference-service] test_payload = None [e2e-llm-inference-service] [e2e-llm-inference-service] logger.info(f"Calling LLM service at {model_url} with payload {test_payload}") [e2e-llm-inference-service] try: [e2e-llm-inference-service] if test_payload is not None: [e2e-llm-inference-service] response = post_with_retry( [e2e-llm-inference-service] model_url, [e2e-llm-inference-service] headers=headers, [e2e-llm-inference-service] json_data=test_payload, [e2e-llm-inference-service] timeout=test_case.response_timeout, [e2e-llm-inference-service] ) [e2e-llm-inference-service] else: [e2e-llm-inference-service] response = get_with_retry( [e2e-llm-inference-service] model_url, [e2e-llm-inference-service] headers=headers, [e2e-llm-inference-service] timeout=test_case.response_timeout, [e2e-llm-inference-service] ) [e2e-llm-inference-service] except Exception as e: [e2e-llm-inference-service] logger.error(f"❌ Failed to call model: {e}") [e2e-llm-inference-service] raise AssertionError(f"❌ Failed to call model: {e}") from e [e2e-llm-inference-service] [e2e-llm-inference-service] logger.info(f"Model response is {response.status_code}: {response.text[:500]}") [e2e-llm-inference-service] [e2e-llm-inference-service] if 200 <= response.status_code < 300: [e2e-llm-inference-service] return response [e2e-llm-inference-service] > raise AssertionError( [e2e-llm-inference-service] f"Service returned {response.status_code}: {response.text}" [e2e-llm-inference-service] ) [e2e-llm-inference-service] E AssertionError: Service returned 502: [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:1115: AssertionError [e2e-llm-inference-service] ------------------------------ Captured log setup ------------------------------ [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1637 No HTTP proxy configured for k8s client [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1586 Checking LLMInferenceServiceConfig router-managed-scheduler-v06-pd-5a5debb2 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1612 Resource not found, creating LLMInferenceServiceConfig router-managed-scheduler-v06-pd-5a5debb2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1622 ✓ Successfully created LLMInferenceServiceConfig router-managed-scheduler-v06-pd-5a5debb2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1586 Checking LLMInferenceServiceConfig scheduler-v06-pd-config-migrati-bb3264a2 in namespace kserve-ci-e2e-test [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1612 Resource not found, creating LLMInferenceServiceConfig scheduler-v06-pd-config-migrati-bb3264a2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1622 ✓ Successfully created LLMInferenceServiceConfig scheduler-v06-pd-config-migrati-bb3264a2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1586 Checking LLMInferenceServiceConfig workload-llmd-simulator-pd-sche-64d0fc8b in namespace kserve-ci-e2e-test [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1612 Resource not found, creating LLMInferenceServiceConfig workload-llmd-simulator-pd-sche-64d0fc8b [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1622 ✓ Successfully created LLMInferenceServiceConfig workload-llmd-simulator-pd-sche-64d0fc8b [e2e-llm-inference-service] ------------------------------ Captured log call ------------------------------- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [test_llm_inference_service] [2026-07-08T17:35:01.662391] start - args=(), kwargs={'test_case': TestCase(base_refs=['router-managed', 'scheduler-v06-pd-config-migration', 'workload-llmd-simulator-pd'], prompt='KServe is a', service_name='scheduler-v06-pd-migration-test', endpoint='/v1/completions', max_tokens=20, payload_formatter=None, response_assertion=, wait_timeout=900, response_timeout=60, extra_headers=None, url_getter=None, expected_gateway=None, before_test=[], after_test=[], peers=[], llm_service={'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': None, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'scheduler-v06-pd-migration-test', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-managed-scheduler-v06-pd-5a5debb2'}, [e2e-llm-inference-service] {'name': 'scheduler-v06-pd-config-migrati-bb3264a2'}, [e2e-llm-inference-service] {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}, model_name='facebook/opt-125m')} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:fixtures.py:1637 No HTTP proxy configured for k8s client [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [create_llmisvc] [2026-07-08T17:35:01.674741] start - args=(, {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security.opendatahub.io/enable-auth': 'false'}, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'scheduler-v06-pd-migration-test', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-managed-scheduler-v06-pd-5a5debb2'}, [e2e-llm-inference-service] {'name': 'scheduler-v06-pd-config-migrati-bb3264a2'}, [e2e-llm-inference-service] {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [create_llmisvc] [2026-07-08T17:35:01.759015] end - ✅ in 0.084s [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [wait_for_llm_isvc_ready] [2026-07-08T17:35:01.759188] start - args=(, {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security.opendatahub.io/enable-auth': 'false'}, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'scheduler-v06-pd-migration-test', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-managed-scheduler-v06-pd-5a5debb2'}, [e2e-llm-inference-service] {'name': 'scheduler-v06-pd-config-migrati-bb3264a2'}, [e2e-llm-inference-service] {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}, 900), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1222 Waiting: No conditions found in status [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1222 Waiting: Missing true conditions: {'Ready', 'RouterReady', 'WorkloadsReady'}, expected {'Ready', 'RouterReady', 'WorkloadsReady'}, got [{'lastTransitionTime': '2026-07-08T17:35:22Z', 'message': 'The following HTTPRoutes are not ready: [kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route: "False" (reason "InvalidKind", message "referencing unsupported backendRef: group \\"inference.networking.x-k8s.io\\" kind \\"InferencePool\\"")]', 'reason': 'HTTPRoutesNotReady', 'severity': 'Info', 'status': 'False', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-07-08T17:35:22Z', 'message': 'Inference Pool kserve-ci-e2e-test/scheduler-v06-pd-migration-test-inference-pool exists but no Gateway controller has accepted it yet', 'reason': 'WaitingForGateway', 'severity': 'Info', 'status': 'False', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-07-08T17:35:22Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-07-08T17:35:22Z', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-07-08T17:35:22Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-07-08T17:35:22Z', 'message': 'The following HTTPRoutes are not ready: [kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route: "False" (reason "InvalidKind", message "referencing unsupported backendRef: group \\"inference.networking.x-k8s.io\\" kind \\"InferencePool\\"")]', 'reason': 'HTTPRoutesNotReady', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-07-08T17:35:22Z', 'message': 'The following HTTPRoutes are not ready: [kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route: "False" (reason "InvalidKind", message "referencing unsupported backendRef: group \\"inference.networking.x-k8s.io\\" kind \\"InferencePool\\"")]', 'reason': 'HTTPRoutesNotReady', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-07-08T17:35:22Z', 'message': 'Deployment rollout in progress', 'reason': 'Progressing', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-07-08T17:35:22Z', 'reason': 'Progressing', 'status': 'False', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1222 Waiting: Missing true conditions: {'Ready', 'RouterReady'}, expected {'Ready', 'RouterReady', 'WorkloadsReady'}, got [{'lastTransitionTime': '2026-07-08T17:35:36Z', 'severity': 'Info', 'status': 'True', 'type': 'HTTPRoutesReady'}, {'lastTransitionTime': '2026-07-08T17:35:36Z', 'severity': 'Info', 'status': 'True', 'type': 'InferencePoolReady'}, {'lastTransitionTime': '2026-07-08T17:35:36Z', 'severity': 'Info', 'status': 'True', 'type': 'MainWorkloadReady'}, {'lastTransitionTime': '2026-07-08T17:35:36Z', 'severity': 'Info', 'status': 'True', 'type': 'PrefillWorkloadReady'}, {'lastTransitionTime': '2026-07-08T17:35:22Z', 'severity': 'Info', 'status': 'True', 'type': 'PresetsCombined'}, {'lastTransitionTime': '2026-07-08T17:35:36Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Ready'}, {'lastTransitionTime': '2026-07-08T17:35:36Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'RouterReady'}, {'lastTransitionTime': '2026-07-08T17:35:36Z', 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'severity': 'Info', 'status': 'False', 'type': 'SchedulerWorkloadReady'}, {'lastTransitionTime': '2026-07-08T17:35:36Z', 'status': 'True', 'type': 'WorkloadsReady'}] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [wait_for_llm_isvc_ready] [2026-07-08T17:35:53.739447] end - ✅ in 51.980s [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [wait_for_model_response] [2026-07-08T17:35:53.739600] start - args=(, TestCase(base_refs=['router-managed', 'scheduler-v06-pd-config-migration', 'workload-llmd-simulator-pd'], prompt='KServe is a', service_name='scheduler-v06-pd-migration-test', endpoint='/v1/completions', max_tokens=20, payload_formatter=None, response_assertion=, wait_timeout=900, response_timeout=60, extra_headers=None, url_getter=None, expected_gateway=None, before_test=[], after_test=[], peers=[], llm_service={'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security.opendatahub.io/enable-auth': 'false'}, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'scheduler-v06-pd-migration-test', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-managed-scheduler-v06-pd-5a5debb2'}, [e2e-llm-inference-service] {'name': 'scheduler-v06-pd-config-migrati-bb3264a2'}, [e2e-llm-inference-service] {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}, model_name='facebook/opt-125m'), 900), kwargs={'extra_headers': None} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llm_service_url] [2026-07-08T17:35:53.739862] start - args=(, {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security.opendatahub.io/enable-auth': 'false'}, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'scheduler-v06-pd-migration-test', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-managed-scheduler-v06-pd-5a5debb2'}, [e2e-llm-inference-service] {'name': 'scheduler-v06-pd-config-migrati-bb3264a2'}, [e2e-llm-inference-service] {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llm_service_url] [2026-07-08T17:35:53.749226] end - ✅ in 0.009s [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1092 Calling LLM service at http://a36d7a8b4dbbe4bfda86ba837ed4b07e-731336034.us-east-1.elb.amazonaws.com/kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/completions with payload {'model': 'facebook/opt-125m', 'prompt': 'KServe is a', 'max_tokens': 20} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1111 Model response is 502: [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1222 Waiting: Service returned 502: [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llm_service_url] [2026-07-08T17:42:03.080010] start - args=(, {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security.opendatahub.io/enable-auth': 'false'}, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'scheduler-v06-pd-migration-test', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-managed-scheduler-v06-pd-5a5debb2'}, [e2e-llm-inference-service] {'name': 'scheduler-v06-pd-config-migrati-bb3264a2'}, [e2e-llm-inference-service] {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llm_service_url] [2026-07-08T17:42:03.138111] end - ✅ in 0.057s [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1092 Calling LLM service at http://a36d7a8b4dbbe4bfda86ba837ed4b07e-731336034.us-east-1.elb.amazonaws.com/kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/completions with payload {'model': 'facebook/opt-125m', 'prompt': 'KServe is a', 'max_tokens': 20} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1111 Model response is 502: [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:34 [get_llm_service_url] [2026-07-08T17:48:12.450293] start - args=(, {'api_version': 'serving.kserve.io/v1alpha1', [e2e-llm-inference-service] 'kind': 'LLMInferenceService', [e2e-llm-inference-service] 'metadata': {'annotations': {'security.opendatahub.io/enable-auth': 'false'}, [e2e-llm-inference-service] 'creation_timestamp': None, [e2e-llm-inference-service] 'deletion_grace_period_seconds': None, [e2e-llm-inference-service] 'deletion_timestamp': None, [e2e-llm-inference-service] 'finalizers': None, [e2e-llm-inference-service] 'generate_name': None, [e2e-llm-inference-service] 'generation': None, [e2e-llm-inference-service] 'labels': None, [e2e-llm-inference-service] 'managed_fields': None, [e2e-llm-inference-service] 'name': 'scheduler-v06-pd-migration-test', [e2e-llm-inference-service] 'namespace': 'kserve-ci-e2e-test', [e2e-llm-inference-service] 'owner_references': None, [e2e-llm-inference-service] 'resource_version': None, [e2e-llm-inference-service] 'self_link': None, [e2e-llm-inference-service] 'uid': None}, [e2e-llm-inference-service] 'spec': {'baseRefs': [{'name': 'router-managed-scheduler-v06-pd-5a5debb2'}, [e2e-llm-inference-service] {'name': 'scheduler-v06-pd-config-migrati-bb3264a2'}, [e2e-llm-inference-service] {'name': 'workload-llmd-simulator-pd-sche-64d0fc8b'}]}, [e2e-llm-inference-service] 'status': None}), kwargs={} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:logging.py:43 [get_llm_service_url] [2026-07-08T17:48:12.493702] end - ✅ in 0.043s [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1092 Calling LLM service at http://a36d7a8b4dbbe4bfda86ba837ed4b07e-731336034.us-east-1.elb.amazonaws.com/kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/completions with payload {'model': 'facebook/opt-125m', 'prompt': 'KServe is a', 'max_tokens': 20} [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1111 Model response is 502: [e2e-llm-inference-service] ERROR e2e.llmisvc.logging:test_llm_inference_service.py:1219 Timed out waiting: Service returned 502: [e2e-llm-inference-service] ERROR e2e.llmisvc.logging:logging.py:48 [wait_for_model_response] [2026-07-08T17:54:16.775577] end - ❌ 1103.036s: Service returned 502: [e2e-llm-inference-service] ERROR e2e.llmisvc.logging:test_llm_inference_service.py:831 [router-managed-scheduler-v06-pd-config-migration-workload-llmd-simulator-pd] ❌ ERROR: Failed to call llm inference service scheduler-v06-pd-migration-test: Service returned 502: [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1240 🔍 # Diagnostics for 'scheduler-v06-pd-migration-test' in 'kserve-ci-e2e-test' [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1241 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1242 # LLMInferenceService scheduler-v06-pd-migration-test [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1245 apiVersion: serving.kserve.io/v1alpha1 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] security.opendatahub.io/enable-auth: 'false' [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:01Z' [e2e-llm-inference-service] finalizers: [e2e-llm-inference-service] - serving.kserve.io/llmisvc-finalizer [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:security.opendatahub.io/enable-auth: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:baseRefs: {} [e2e-llm-inference-service] manager: OpenAPI-Generator [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-08T17:35:01Z' [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:finalizers: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] v:"serving.kserve.io/llmisvc-finalizer": {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-08T17:35:01Z' [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:addresses: {} [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:serving.kserve.io/config-llm-decode-template: {} [e2e-llm-inference-service] f:serving.kserve.io/config-llm-decode-worker-data-parallel: {} [e2e-llm-inference-service] f:serving.kserve.io/config-llm-prefill-template: {} [e2e-llm-inference-service] f:serving.kserve.io/config-llm-prefill-worker-data-parallel: {} [e2e-llm-inference-service] f:serving.kserve.io/config-llm-router-route: {} [e2e-llm-inference-service] f:serving.kserve.io/config-llm-scheduler: {} [e2e-llm-inference-service] f:serving.kserve.io/config-llm-template: {} [e2e-llm-inference-service] f:serving.kserve.io/config-llm-tracing: {} [e2e-llm-inference-service] f:serving.kserve.io/config-llm-worker-data-parallel: {} [e2e-llm-inference-service] f:appliedConfigs: {} [e2e-llm-inference-service] f:conditions: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:router: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:gateways: {} [e2e-llm-inference-service] f:scheduler: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:inferencePool: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:group: {} [e2e-llm-inference-service] f:kind: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:service: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:group: {} [e2e-llm-inference-service] f:kind: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:url: {} [e2e-llm-inference-service] f:workloads: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:prefill: {} [e2e-llm-inference-service] f:primary: {} [e2e-llm-inference-service] f:scheduler: {} [e2e-llm-inference-service] f:service: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] time: '2026-07-08T17:35:53Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] resourceVersion: '64775' [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] baseRefs: [e2e-llm-inference-service] - name: router-managed-scheduler-v06-pd-5a5debb2 [e2e-llm-inference-service] - name: scheduler-v06-pd-config-migrati-bb3264a2 [e2e-llm-inference-service] - name: workload-llmd-simulator-pd-sche-64d0fc8b [e2e-llm-inference-service] model: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uri: '' [e2e-llm-inference-service] status: [e2e-llm-inference-service] addresses: [e2e-llm-inference-service] - name: gateway-external-model-routing [e2e-llm-inference-service] url: http://a36d7a8b4dbbe4bfda86ba837ed4b07e-731336034.us-east-1.elb.amazonaws.com/ [e2e-llm-inference-service] - name: gateway-external [e2e-llm-inference-service] url: http://a36d7a8b4dbbe4bfda86ba837ed4b07e-731336034.us-east-1.elb.amazonaws.com/kserve-ci-e2e-test/scheduler-v06-pd-migration-test [e2e-llm-inference-service] - name: gateway-internal-model-routing [e2e-llm-inference-service] url: http://openshift-ai-inference-openshift-default.openshift-ingress.svc.cluster.local/ [e2e-llm-inference-service] - name: gateway-internal [e2e-llm-inference-service] url: http://openshift-ai-inference-openshift-default.openshift-ingress.svc.cluster.local/kserve-ci-e2e-test/scheduler-v06-pd-migration-test [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] serving.kserve.io/config-llm-decode-template: kserve-config-llm-decode-template [e2e-llm-inference-service] serving.kserve.io/config-llm-decode-worker-data-parallel: kserve-config-llm-decode-worker-data-parallel [e2e-llm-inference-service] serving.kserve.io/config-llm-prefill-template: kserve-config-llm-prefill-template [e2e-llm-inference-service] serving.kserve.io/config-llm-prefill-worker-data-parallel: kserve-config-llm-prefill-worker-data-parallel [e2e-llm-inference-service] serving.kserve.io/config-llm-router-route: kserve-config-llm-router-route [e2e-llm-inference-service] serving.kserve.io/config-llm-scheduler: kserve-config-llm-scheduler [e2e-llm-inference-service] serving.kserve.io/config-llm-template: kserve-config-llm-template [e2e-llm-inference-service] serving.kserve.io/config-llm-tracing: kserve-config-llm-tracing [e2e-llm-inference-service] serving.kserve.io/config-llm-worker-data-parallel: kserve-config-llm-worker-data-parallel [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] - lastTransitionTime: '2026-07-08T17:35:36Z' [e2e-llm-inference-service] severity: Info [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: HTTPRoutesReady [e2e-llm-inference-service] - lastTransitionTime: '2026-07-08T17:35:36Z' [e2e-llm-inference-service] severity: Info [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: InferencePoolReady [e2e-llm-inference-service] - lastTransitionTime: '2026-07-08T17:35:36Z' [e2e-llm-inference-service] severity: Info [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: MainWorkloadReady [e2e-llm-inference-service] - lastTransitionTime: '2026-07-08T17:35:36Z' [e2e-llm-inference-service] severity: Info [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: PrefillWorkloadReady [e2e-llm-inference-service] - lastTransitionTime: '2026-07-08T17:35:22Z' [e2e-llm-inference-service] severity: Info [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: PresetsCombined [e2e-llm-inference-service] - lastTransitionTime: '2026-07-08T17:35:53Z' [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: Ready [e2e-llm-inference-service] - lastTransitionTime: '2026-07-08T17:35:53Z' [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: RouterReady [e2e-llm-inference-service] - lastTransitionTime: '2026-07-08T17:35:53Z' [e2e-llm-inference-service] severity: Info [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: SchedulerWorkloadReady [e2e-llm-inference-service] - lastTransitionTime: '2026-07-08T17:35:36Z' [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: WorkloadsReady [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] url: http://a36d7a8b4dbbe4bfda86ba837ed4b07e-731336034.us-east-1.elb.amazonaws.com/kserve-ci-e2e-test/scheduler-v06-pd-migration-test [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:44 TIME NAMESPACE SOURCE TYPE REASON MESSAGE [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:45 -------------------------------------------------------------------------------------------------- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/auth-disabled-test-kserve-84ff994f99-sl6v4 to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:30 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.53/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:31 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:31 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:31 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:36 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:36 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:36 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:30 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.53:8000/health": dial tcp 10.133.0.53:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:46 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:01 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.53:8000/health": dial tcp 10.133.0.53:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:30 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: auth-disabled-test-kserve-84ff994f99-sl6v4 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/auth-disabled-test-kserve-router-scheduler-7575d494fd-whhqz to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:31 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.54/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:31 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:31 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:31 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:32 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:32 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:32 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:46 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:46 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:31 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: auth-disabled-test-kserve-router-scheduler-7575d494fd-whhqz [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:31 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set auth-disabled-test-kserve-router-scheduler-7575d494fd from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:30 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set auth-disabled-test-kserve-84ff994f99 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:30 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy auth-disabled-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/auth-disabled-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "auth-disabled-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/auth-disabled-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/auth-disabled-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/auth-disabled-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/auth-disabled-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-disabled-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/auth-disabled-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/auth-disabled-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:31 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/auth-disabled-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:31 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/auth-disabled-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:37 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-disabled-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:36 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/auth-disabled-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:36 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/auth-disabled-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:41 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [auth-disabled-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:46 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-disabled-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/auth-enabled-test-kserve-67f6dd7f6f-p6frc to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:24 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.48/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:24 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:24 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:24 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:30 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulling Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:59 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" in 28.715s (28.715s including waiting). Image size: 3531177328 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:59 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:59 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:04 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.48:8000/health": dial tcp 10.133.0.48:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:19 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:35 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.48:8000/health": dial tcp 10.133.0.48:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:23 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: auth-enabled-test-kserve-67f6dd7f6f-p6frc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-857b4f747c-7k9fn to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:24 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.49/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:24 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:24 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:24 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:26 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulling Pulling image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:27 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Successfully pulled image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" in 1.645s (1.645s including waiting). Image size: 75073927 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:27 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:28 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:19 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:19 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:24 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: auth-enabled-test-kserve-router-scheduler-857b4f747c-7k9fn [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:24 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set auth-enabled-test-kserve-router-scheduler-857b4f747c from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:23 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set auth-enabled-test-kserve-67f6dd7f6f from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/auth-enabled-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/auth-enabled-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/auth-enabled-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/auth-enabled-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-enabled-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/auth-enabled-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/auth-enabled-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/auth-enabled-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:50 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-enabled-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:49 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/auth-enabled-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:49 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/auth-enabled-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:14 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [auth-enabled-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-enabled-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/auth-invalid-token-test-kserve-69f89b8bf7-whpjz to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:55 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.51/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:55 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:55 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:55 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:51:02 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:51:02 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:51:02 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:55 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.51:8000/health": dial tcp 10.133.0.51:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:07 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:55 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: auth-invalid-token-test-kserve-69f89b8bf7-whpjz [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:55 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: auth-invalid-token-test-kserve-router-scheduler-5478bf674ccw6tc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/auth-invalid-token-test-kserve-router-scheduler-5478bf674ccw6tc to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:55 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.52/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:56 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:56 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:56 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:57 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:57 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:57 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:07 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:07 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:55 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set auth-invalid-token-test-kserve-router-scheduler-5478bf674c from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:55 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set auth-invalid-token-test-kserve-69f89b8bf7 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:55 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/auth-invalid-token-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:55 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/auth-invalid-token-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:55 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/auth-invalid-token-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:55 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/auth-invalid-token-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:55 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-invalid-token-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:55 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/auth-invalid-token-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:55 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/auth-invalid-token-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:55 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/auth-invalid-token-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:55 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/auth-invalid-token-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:51:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-invalid-token-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:51:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/auth-invalid-token-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:51:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/auth-invalid-token-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:06 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [auth-invalid-token-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:53:07 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-invalid-token-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:08 kserve-ci-e2e-test LLMInferenceServiceController Warning UpdateFailed Failed to update status for LLMInferenceService "conv-test-criticality": llminferenceservices.serving.kserve.io "conv-test-criticality" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:08 kserve-ci-e2e-test LLMInferenceServiceController Warning UpdateFailed Failed to update status for LLMInferenceService "conv-test-lora-crit": llminferenceservices.serving.kserve.io "conv-test-lora-crit" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:09 kserve-ci-e2e-test LLMInferenceServiceController Warning UpdateFailed Failed to update status for LLMInferenceService "conv-test-round-trip": llminferenceservices.serving.kserve.io "conv-test-round-trip" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-67588db874-f6b8t to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.68/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:20 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:20 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:20 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:27 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:27 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:27 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:19:39 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.68:8001/health": dial tcp 10.133.0.68:8001: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:19:59 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:19:59 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: custom-route-timeout-pd-test-kserve-67588db874-f6b8t [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-94b6f6947-rx456 to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.69/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:25 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:25 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:25 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:19:39 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.69:8000/health": dial tcp 10.133.0.69:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:19:59 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: custom-route-timeout-pd-test-kserve-prefill-94b6f6947-rx456 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set custom-route-timeout-pd-test-kserve-prefill-94b6f6947 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: custom-route-timeout-pd-test-kserve-router-scheduler-74789fhwf6 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-74789fhwf6 to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.55/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:20 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:20 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:20 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:19:59 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:19:59 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set custom-route-timeout-pd-test-kserve-router-scheduler-7478954df5 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set custom-route-timeout-pd-test-kserve-67588db874 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:15 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-pd-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-pd-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:18 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:18 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:18 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:18 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:43 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:42 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:43 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:19:50 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [custom-route-timeout-pd-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:19:59 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-86c9c75755-7p6kx to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:16 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.61/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:16 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:16 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:16 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:23 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:23 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:23 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:08:46 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.61:8000/health": dial tcp 10.133.0.61:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:09 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:25 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.61:8000/health": dial tcp 10.133.0.61:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:15 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: custom-route-timeout-test-kserve-86c9c75755-7p6kx [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:16 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: custom-route-timeout-test-kserve-router-scheduler-664966fctvzts [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-664966fctvzts to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:16 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.50/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:16 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:16 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:16 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:17 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:17 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:17 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:09 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:09 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:16 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set custom-route-timeout-test-kserve-router-scheduler-664966fc9d from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:15 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set custom-route-timeout-test-kserve-86c9c75755 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:15 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:16 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:16 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:16 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/custom-route-timeout-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:16 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:16 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:16 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:08:56 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [custom-route-timeout-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:08 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/e2e-pvc-model-download-bsd5v to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:04 kserve-ci-e2e-test attachdetach-controller Normal SuccessfulAttachVolume AttachVolume.Attach succeeded for volume "pvc-6394c2ef-5d09-4573-b34c-dae5966e5434" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:11 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.47/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:11 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:11 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:11 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:59:59 kserve-ci-e2e-test job-controller Normal SuccessfulCreate Created pod: e2e-pvc-model-download-bsd5v [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:20 kserve-ci-e2e-test job-controller Normal Completed Job completed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:59:59 kserve-ci-e2e-test persistentvolume-controller Normal WaitForFirstConsumer waiting for first consumer to be created before binding [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:59:59 kserve-ci-e2e-test ebs.csi.aws.com_aws-ebs-csi-driver-controller-6f9c858f49-qw5h8_27915ec2-eed3-423c-86c6-596d130af027 Normal Provisioning External provisioner is provisioning volume for claim "kserve-ci-e2e-test/e2e-pvc-model-storage" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:00 kserve-ci-e2e-test persistentvolume-controller Normal ExternalProvisioning Waiting for a volume to be created either by the external provisioner 'ebs.csi.aws.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:01 kserve-ci-e2e-test ebs.csi.aws.com_aws-ebs-csi-driver-controller-6f9c858f49-qw5h8_27915ec2-eed3-423c-86c6-596d130af027 Normal ProvisioningSucceeded Successfully provisioned volume pvc-6394c2ef-5d09-4573-b34c-dae5966e5434 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:15 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc526tch [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc526tch to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:16 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.37/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:16 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulling Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:17 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.383s (1.383s including waiting). Image size: 98346788 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:17 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:17 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:39 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:54 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.132.0.37:8000/health": dial tcp 10.132.0.37:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:15 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:16 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:17 kserve-ci-e2e-test LLMInferenceServiceController Warning UpdateFailed Failed to update status for LLMInferenceService "gw-section-name-router-with-gat-2f0a622e": Operation cannot be fulfilled on llminferenceservices.serving.kserve.io "gw-section-name-router-with-gat-2f0a622e": the object has been modified; please apply your changes to the latest version and try again [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:52 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq to ip-10-0-142-172.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:53 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.19/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:53 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Pulling Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:54 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Pulled Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.017s (1.017s including waiting). Image size: 98346788 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:54 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:54 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:07 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:22 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.134.0.19:8000/health": dial tcp 10.134.0.19:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:52 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:52 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:52 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:52 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:52 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:52 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:54 kserve-ci-e2e-test LLMInferenceServiceController Warning UpdateFailed Failed to update status for LLMInferenceService "gw-section-name-router-with-gat-f1d92d0f": Operation cannot be fulfilled on llminferenceservices.serving.kserve.io "gw-section-name-router-with-gat-f1d92d0f": the object has been modified; please apply your changes to the latest version and try again [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:46 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-fb-opt-125m-route-3c960099-kserve-6d69fc44d8842wn [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-6d69fc44d8842wn to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:47 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.76/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:47 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:47 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:47 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:53 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:53 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:53 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:47 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.76:8000/health": dial tcp 10.133.0.76:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:01 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:46 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-fb-opt-125m-route-3c960099-kserve-6d69fc44d8 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:44 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-3c960099-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-3c960099-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:46 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisvd10b93c8eba12f87c3a350a5cae2ee0c-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:46 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:46 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:47 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:47 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:58 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisvd10b93c8eba12f87c3a350a5cae2ee0c-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:57 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-fb-opt-125m-route-3c960099] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-fb-opt-125m-route-50bc673d-kserve-59596f6d4fsgc99 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-59596f6d4fsgc99 to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.65/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:24 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:24 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:24 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:30 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:30 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:30 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:15:23 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.65:8001/health": dial tcp 10.133.0.65:8001: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:15:48 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:15:48 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5989gpd [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5989gpd to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.66/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:31 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:31 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:31 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:15:23 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.66:8000/health": dial tcp 10.133.0.66:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:15:48 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:03 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.66:8000/health": dial tcp 10.133.0.66:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-596f5b7f78 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-fb-opt-125m-route-50bc673d-kserve-59596f6d4f from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:21 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test00d7278d8a22c4e39146a6b0eb840f45-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:15:34 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-fb-opt-125m-route-50bc673d] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:15:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test00d7278d8a22c4e39146a6b0eb840f45-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:53 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-fb-opt-125m-route-87882a8e-kserve-66b95f57dfnrhp7 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-66b95f57dfnrhp7 to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:53 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.58/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:53 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:53 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:53 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:58 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:58 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:59 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:05:23 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.58:8000/health": dial tcp 10.133.0.58:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:05:44 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:00 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.58:8000/health": dial tcp 10.133.0.58:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:53 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-fb-opt-125m-route-87882a8e-kserve-66b95f57df from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:51 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test21fe6730fe484f3a92b1a16afe1bac8f-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:05:34 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-fb-opt-125m-route-87882a8e] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:05:44 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test21fe6730fe484f3a92b1a16afe1bac8f-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.59/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:30 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulling Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:57 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" in 26.858s (26.858s including waiting). Image size: 3531177328 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:57 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:57 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:46 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test statefulset-controller Normal SuccessfulCreate create Pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 in StatefulSet llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 successful [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.78/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:32 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:32 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:32 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:06 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.78:8000/health": dial tcp 10.133.0.78:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:30 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test leaderworkerset Normal CreatingRevision Creating revision with key d6546f6 for a newly created LeaderWorkerSet [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test leaderworkerset Normal GroupsProgressing Created leader statefulset llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test leaderworkerset Normal GroupsProgressing Replicas are progressing, with 0 groups ready of total 1 groups [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test statefulset-controller Normal SuccessfulCreate create Pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 in StatefulSet llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn successful [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test leaderworkerset Normal GroupsProgressing Created worker statefulset for leader pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:16 kserve-ci-e2e-test leaderworkerset Normal AllGroupsReady All replicas are ready, with 1 groups ready of total 1 groups [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:24 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-scc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test386bd5808c5c450f11fd8632e1f821fb-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:33 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:32 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:32 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:23 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-fb-opt-125m-route-dc21cb14] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test386bd5808c5c450f11fd8632e1f821fb-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:15 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9 to ip-10-0-142-172.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:15 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.25/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:15 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:15 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:15 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:28 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:44 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.134.0.25:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:15 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:13 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:26 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-fb-opt-125m-route-e95b1dc1] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6c94dd65d4-jd986 to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:27 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.55/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:27 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:27 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:27 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:33 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:33 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:33 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:47 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.55:8000/health": dial tcp 10.133.0.55:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:23 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:27 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6c94dd65d4-jd986 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:27 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schepcpc7 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:27 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler-6f4dcf465 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schepcpc7 to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:28 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.45/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:28 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:28 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:28 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:29 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:29 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:29 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:23 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:23 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:27 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6c94dd65d4 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:22 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test5216bfd716f919dc046bc693ceb22e41-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:37 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:36 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:55:36 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:58 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-fb-opt-125m-with-7ca60146] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test5216bfd716f919dc046bc693ceb22e41-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-7dfc79f5dc-wvz4n to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:57 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.56/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:57 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:57 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:57 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:58:21 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:58:21 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:58:21 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:59:27 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.56:8000/health": dial tcp 10.133.0.56:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:59:38 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:59:54 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.56:8000/health": dial tcp 10.133.0.56:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:56 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-7dfc79f5dc-wvz4n [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:57 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schen2sbt [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:57 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler-5f4547675b from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schen2sbt to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:57 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.46/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:57 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:57 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:57 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:59 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:59 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:59 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:59:38 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:59:38 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:56 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-7dfc79f5dc from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:54 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test05addb65ba05195619f26ef266e8fc04-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:56 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:57 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:57 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:57:57 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:58:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:58:11 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:58:11 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:59:37 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-fb-opt-125m-with-ba4d693a] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:59:38 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test05addb65ba05195619f26ef266e8fc04-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:04 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.63/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:04 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:05 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:05 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:50 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:00 kserve-ci-e2e-test statefulset-controller Normal SuccessfulCreate create Pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 in StatefulSet llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 successful [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:02 kserve-ci-e2e-test attachdetach-controller Normal SuccessfulAttachVolume AttachVolume.Attach succeeded for volume "pvc-6394c2ef-5d09-4573-b34c-dae5966e5434" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:04 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.62/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:04 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:04 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:04 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:44 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.62:8000/health": dial tcp 10.133.0.62:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:33 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:49 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.62:8000/health": dial tcp 10.133.0.62:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:00 kserve-ci-e2e-test leaderworkerset Normal CreatingRevision Creating revision with key 686d468674 for a newly created LeaderWorkerSet [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:00 kserve-ci-e2e-test leaderworkerset Normal GroupsProgressing Created leader statefulset llmisvc-model-pvc-router-manage-2577e794-kserve-mn [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:00 kserve-ci-e2e-test leaderworkerset Normal GroupsProgressing Replicas are progressing, with 0 groups ready of total 1 groups [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:00 kserve-ci-e2e-test statefulset-controller Normal SuccessfulCreate create Pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 in StatefulSet llmisvc-model-pvc-router-manage-2577e794-kserve-mn successful [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:00 kserve-ci-e2e-test leaderworkerset Normal GroupsProgressing Created worker statefulset for leader pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:54 kserve-ci-e2e-test leaderworkerset Normal AllGroupsReady All replicas are ready, with 1 groups ready of total 1 groups [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:58 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-2577e794-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-2577e794-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:59 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:59 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-scc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:59 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:59 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:59 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:59 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:00 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test37591b20e96e9663d45a730d03070f1e-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:00 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:00 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:11 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:11 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:27 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-pvc-router-manage-2577e794] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:33 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test37591b20e96e9663d45a730d03070f1e-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:39 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9df8wz4 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9df8wz4 to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:42 kserve-ci-e2e-test attachdetach-controller Normal SuccessfulAttachVolume AttachVolume.Attach succeeded for volume "pvc-6394c2ef-5d09-4573-b34c-dae5966e5434" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:47 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.57/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:47 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:47 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:47 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:27 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.57:8000/health": dial tcp 10.133.0.57:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:41 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:57 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.57:8000/health": dial tcp 10.133.0.57:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:39 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:39 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-59b9d263-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-59b9d263-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:39 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv8bf079eb6eda4debfb4ef5bb7817824c-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:39 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:39 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:39 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:39 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-testc9569cf4801efc0ed27b2f25ffaee875-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:39 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:40 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:40 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:40 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:49 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:01:00 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv8bf079eb6eda4debfb4ef5bb7817824c-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:37 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-pvc-router-manage-59b9d263] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testc9569cf4801efc0ed27b2f25ffaee875-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-2hv7k to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:12 kserve-ci-e2e-test attachdetach-controller Normal SuccessfulAttachVolume AttachVolume.Attach succeeded for volume "pvc-6394c2ef-5d09-4573-b34c-dae5966e5434" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:20 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.59/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:20 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulling Pulling image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:21 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Successfully pulled image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" in 782ms (782ms including waiting). Image size: 44914394 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:21 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:21 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:22 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:22 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:22 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:10 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.59:8001/health": dial tcp 10.133.0.59:8001: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:34 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:34 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:10 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-2hv7k [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:10 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-795tshv [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-795tshv to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:12 kserve-ci-e2e-test attachdetach-controller Normal SuccessfulAttachVolume AttachVolume.Attach succeeded for volume "pvc-6394c2ef-5d09-4573-b34c-dae5966e5434" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:20 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.60/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:20 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:20 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:20 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:10 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.60:8000/health": dial tcp 10.133.0.60:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:34 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:50 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.60:8000/health": dial tcp 10.133.0.60:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:10 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79497db4cc from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:10 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:09 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-e8706282-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-e8706282-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:09 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisvb19f98874e050eec8ca94d49676113f0-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:09 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:09 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:10 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:10 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:10 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-prefill [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:10 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:10 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:10 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-testf5d060a5eb39a04e074b78907a1556a6-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisvb19f98874e050eec8ca94d49676113f0-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:27 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-pvc-router-manage-e8706282] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:34 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testf5d060a5eb39a04e074b78907a1556a6-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k to ip-10-0-142-172.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.30/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:10 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:29 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test80f99418f0f3eb4c80f02e6144a6d4f2-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:54 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:09 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-4c1ba212] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:10 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test80f99418f0f3eb4c80f02e6144a6d4f2-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:01 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss to ip-10-0-142-172.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:02 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.22/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:02 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:02 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:02 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:37 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:01 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:00 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test76d7f532acb694e4a7bcef75d32cd8a1-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:31 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:30 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:36 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-4f8c0978] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:37 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test76d7f532acb694e4a7bcef75d32cd8a1-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:41 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w to ip-10-0-142-172.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:42 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.21/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:42 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:42 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:42 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:51:33 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:41 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:36 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-testb7025ca4d8a6f8f5b2fd08b5581d2678-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:42 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:42 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:42 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:42 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:51:11 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:51:11 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:51:11 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:51:30 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-a50492e9] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:51:33 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testb7025ca4d8a6f8f5b2fd08b5581d2678-llmisvc-mode [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-5np5b to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:16 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.43/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:16 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:16 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:16 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:57 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:15 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-5np5b [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:15 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:15 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-4b931143-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-4b931143-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test8ac8e3d2264ccb939eb021b0b835847c-llmisvc-rout [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:15 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:16 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:16 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:16 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:23 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:24 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:49 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-router-managed-test-llm-4b931143] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:57 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test8ac8e3d2264ccb939eb021b0b835847c-llmisvc-rout [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:53 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb46pms2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb46pms2 to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:54 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.41/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:54 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:54 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:54 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:51:52 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:53 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:44 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-5b1e8f15-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-5b1e8f15-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:54 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:54 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test7f54e84970003a6e7372bdbcb574f7ed-llmisvc-rout [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:54 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:54 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:54 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:54 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:00 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:59 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:59 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:26 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-router-managed-test-llm-5b1e8f15] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:51:52 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test7f54e84970003a6e7372bdbcb574f7ed-llmisvc-rout [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:28 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879cvnz8 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879cvnz8 to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:28 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.40/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:28 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:28 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:29 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:04 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:19 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.132.0.40:8000/health": dial tcp 10.132.0.40:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:28 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:24 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-e45d1f79-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-e45d1f79-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-testef4d2875be14b30dc1561ed84d0d4bde-llmisvc-rout [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:33 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:32 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:33 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:03 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [llmisvc-router-managed-test-llm-e45d1f79] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:04 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testef4d2875be14b30dc1561ed84d0d4bde-llmisvc-rout [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:02 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:02 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler-6fcb489785 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4 to ip-10-0-142-172.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:02 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.23/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:02 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:02 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:02 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:37 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:37 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:00 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:00 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler-7dbcb75dbc from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq to ip-10-0-142-172.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:00 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.27/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:00 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:00 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:00 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:07:02 kserve-ci-e2e-test attachdetach-controller Warning FailedAttachVolume Multi-Attach error for volume "pvc-6394c2ef-5d09-4573-b34c-dae5966e5434" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0, llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:33 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:33 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schebbsmf to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.60/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:27 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:27 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:27 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:27 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:28 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:30 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:30 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schebbsmf [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:27:26 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler-79ccfb59 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schezdkxl [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler-79866dc455 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schezdkxl to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.80/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:37 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:10 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:10 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schepcckr [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:23 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler-5d8499d949 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schepcckr to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:24 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.53/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:24 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:24 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:24 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:25 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:25 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:25 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:15:48 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:15:48 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:28 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:28 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler-5dd88bfbb7 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd to ip-10-0-142-172.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:29 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.20/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:29 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Pulling Pulling image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:30 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Pulled Successfully pulled image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" in 1.56s (1.56s including waiting). Image size: 75073927 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:30 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:30 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:04 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:04 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:40 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schehqcg7 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:40 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler-5f555d4d85 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schehqcg7 to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:40 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.48/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:40 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:40 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:40 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:00:42 kserve-ci-e2e-test attachdetach-controller Warning FailedAttachVolume Multi-Attach error for volume "pvc-6394c2ef-5d09-4573-b34c-dae5966e5434" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9df8wz4 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:41 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:41 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche58jw2 to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:53 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.49/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:54 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:54 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:54 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:54 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:54 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:54 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:05:44 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:05:44 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:53 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche58jw2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:02:53 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler-5dccc4965f from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche82tj8 to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:42 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.50/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:42 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:42 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:42 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:51:33 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:51:33 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:42 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche82tj8 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:50:42 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler-6d86bd4d9d from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:10 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:10 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler-67b4bb9646 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925 to ip-10-0-142-172.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:10 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.26/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:11 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:11 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:11 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:03:12 kserve-ci-e2e-test attachdetach-controller Warning FailedAttachVolume Multi-Attach error for volume "pvc-6394c2ef-5d09-4573-b34c-dae5966e5434" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-2hv7k, llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-795tshv [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:34 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:06:34 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:16 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep77sg [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:16 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler-68cc9685d6 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep77sg to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:16 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.44/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:16 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:16 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:52:16 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:57 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:54:57 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheckgmc to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:54 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.42/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:54 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:54 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:54 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:51:52 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:51:52 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:54 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheckgmc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:49:54 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler-749449dbc8 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-7c8db66c87-pzn59 to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:02 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.75/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:02 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:02 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:02 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:07 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:07 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:07 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:25:11 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.75:8000/health": dial tcp 10.133.0.75:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:08 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:24 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.75:8000/health": dial tcp 10.133.0.75:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:01 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: lora-multiple-adapters-test-kserve-7c8db66c87-pzn59 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:01 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set lora-multiple-adapters-test-kserve-7c8db66c87 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:23:59 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy lora-multiple-adapters-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "lora-multiple-adapters-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/lora-multiple-adapters-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.HTTPRoute kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.DestinationRule kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:11 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:25:22 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [lora-multiple-adapters-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/lora-single-adapter-test-kserve-75fdddbc5d-r8z7x to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:30 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.72/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:30 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:30 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:30 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:36 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:36 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:36 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:21:50 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.72:8000/health": dial tcp 10.133.0.72:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:23:27 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:23:43 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.72:8000/health": dial tcp 10.133.0.72:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:23:45 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.72:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:29 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: lora-single-adapter-test-kserve-75fdddbc5d-r8z7x [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:29 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set lora-single-adapter-test-kserve-75fdddbc5d from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:26 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy lora-single-adapter-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/lora-single-adapter-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "lora-single-adapter-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/lora-single-adapter-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/lora-single-adapter-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/lora-single-adapter-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.HTTPRoute kserve-ci-e2e-test/lora-single-adapter-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:29 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.DestinationRule kserve-ci-e2e-test/lora-single-adapter-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:44 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/lora-single-adapter-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:22:00 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [lora-single-adapter-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-595cd9479-68wpf to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.38/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:43 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:43 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:43 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:53 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:08 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.132.0.38:8000/health": dial tcp 10.132.0.38:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-595cd9479-9fl82 to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.46/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulling Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:41 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" in 4.624s (4.624s including waiting). Image size: 301879267 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:41 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:41 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:46 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulling Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:47 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.035s (1.035s including waiting). Image size: 98346788 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:48 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:48 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:53 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:48:09 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.46:8000/health": dial tcp 10.133.0.46:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: precise-prefix-cache-test-kserve-595cd9479-68wpf [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: precise-prefix-cache-test-kserve-595cd9479-9fl82 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: precise-prefix-cache-test-kserve-router-scheduler-77df687bw4gt6 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-77df687bw4gt6 to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:37 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.39/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:37 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:37 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:37 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:38 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulling Pulling image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:40 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Successfully pulled image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" in 1.655s (1.655s including waiting). Image size: 75073927 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:14 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:14 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:40 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulling Pulling image "ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:13 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Successfully pulled image "ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1" in 33.295s (33.295s including waiting). Image size: 2989890188 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:13 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: tokenizer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:13 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container tokenizer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:14 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:27 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning Unhealthy Liveness probe failed: timeout: failed to connect service "10.132.0.39:9003" within 1s: context deadline exceeded [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:53 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container tokenizer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:53 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:53 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set precise-prefix-cache-test-kserve-router-scheduler-77df687b47 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set precise-prefix-cache-test-kserve-595cd9479 from 0 to 2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:22 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy precise-prefix-cache-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "precise-prefix-cache-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/precise-prefix-cache-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/precise-prefix-cache-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/precise-prefix-cache-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:36 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:05 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/precise-prefix-cache-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:04 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:05 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:52 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [precise-prefix-cache-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:47:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:55 kserve-ci-e2e-test endpoint-controller Warning FailedToUpdateEndpoint Failed to update endpoint kserve-ci-e2e-test/prestop-hook-test-inference-pool-ip-2912a14d: Operation cannot be fulfilled on endpoints "prestop-hook-test-inference-pool-ip-2912a14d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/kserve-ci-e2e-test/prestop-hook-test-inference-pool-ip-2912a14d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 32e064b2-d952-4091-ae3b-d84769ba0c3f, UID in object meta: [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-5b7d7d79ff-52bt2 to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:20 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.61/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:20 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:20 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:20 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:24 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:24 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:24 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:10 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.132.0.61:8000/health": dial tcp 10.132.0.61:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:25 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:40 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.132.0.61:8000/health": dial tcp 10.132.0.61:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-5b7d7d79ff-k79hx to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:25 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.63/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:25 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:25 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:25 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:30 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:30 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:30 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:55 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.132.0.63:8000/health": dial tcp 10.132.0.63:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:55 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:19 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: prestop-hook-test-kserve-5b7d7d79ff-52bt2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:25 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: prestop-hook-test-kserve-5b7d7d79ff-k79hx [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-767d7586b8-gptkj to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:20 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.79/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:20 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:20 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:20 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:22 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:22 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:22 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:55 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:55 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:20 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: prestop-hook-test-kserve-router-scheduler-767d7586b8-gptkj [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:20 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set prestop-hook-test-kserve-router-scheduler-767d7586b8 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:19 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set prestop-hook-test-kserve-5b7d7d79ff from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/prestop-hook-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/prestop-hook-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/prestop-hook-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:20 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/prestop-hook-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:20 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-prestop-hook-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:20 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/prestop-hook-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:20 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/prestop-hook-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:20 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:20 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/prestop-hook-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/prestop-hook-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:50 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/prestop-hook-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/prestop-hook-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:31:55 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-prestop-hook-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-84gdc to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:17 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.64/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:17 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:17 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:17 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:03 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:18 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.132.0.64:8000/health": dial tcp 10.132.0.64:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:16 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: rolling-upgrade-test-kserve-54bc76f55b-84gdc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:03 kserve-ci-e2e-test replicaset-controller Normal SuccessfulDelete Deleted pod: rolling-upgrade-test-kserve-54bc76f55b-84gdc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-7zscs to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:52 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.82/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:52 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:52 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:52 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:20 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning FailedMount MountVolume.SetUp failed for volume "tls-certs" : secret "rolling-upgrade-test-kserve-self-signed-certs" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:05 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:52 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: rolling-upgrade-test-kserve-859df57bcb-7zscs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-hwz6g to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:17 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.81/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:18 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:18 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:18 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:03 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:03 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:17 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-hwz6g [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:17 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:16 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set rolling-upgrade-test-kserve-54bc76f55b from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:52 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set rolling-upgrade-test-kserve-859df57bcb from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:03 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled down replica set rolling-upgrade-test-kserve-54bc76f55b from 1 to 0 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:16 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy rolling-upgrade-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/rolling-upgrade-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "rolling-upgrade-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:16 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:16 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:16 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/rolling-upgrade-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:17 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/rolling-upgrade-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:17 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-rolling-upgrade-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:17 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/rolling-upgrade-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:17 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/rolling-upgrade-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:17 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:17 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/rolling-upgrade-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:32 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/rolling-upgrade-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:02 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:31 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/rolling-upgrade-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:51 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [rolling-upgrade-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:52 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:03 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-rolling-upgrade-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gb4wz to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:05 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.36/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:06 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:06 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:06 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:20 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:24 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning Unhealthy Readiness probe failed: Get "http://10.132.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-rxfpz to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:55 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.47/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:25 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:25 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:25 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:31 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:05 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-gateway-1-openshift-default-54c47cdfc7-gb4wz [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:20 kserve-ci-e2e-test replicaset-controller Normal SuccessfulDelete Deleted pod: router-gateway-1-openshift-default-54c47cdfc7-gb4wz [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:55 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-gateway-1-openshift-default-54c47cdfc7-rxfpz [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv to ip-10-0-142-172.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:07 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.24/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:07 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Pulling Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:10 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Pulled Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 2.685s (2.685s including waiting). Image size: 181251556 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:10 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Created Created container: istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:10 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Started Started container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:10 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Killing Stopping container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6gdsh to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:05 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.44/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:05 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulling Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:08 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 2.945s (2.945s including waiting). Image size: 181251556 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:08 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:08 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:09 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-dw428 to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:18 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.45/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:32 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:32 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:32 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:38 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:58 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-z6cd2 to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:29 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.51/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:30 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:30 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:30 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:32 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:05 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-gateway-1-openshift-default-799f46c59b-6gdsh [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:08 kserve-ci-e2e-test replicaset-controller Normal SuccessfulDelete Deleted pod: router-gateway-1-openshift-default-799f46c59b-6gdsh [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:18 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-gateway-1-openshift-default-799f46c59b-dw428 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:58 kserve-ci-e2e-test replicaset-controller Normal SuccessfulDelete Deleted pod: router-gateway-1-openshift-default-799f46c59b-dw428 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:06 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-gateway-1-openshift-default-799f46c59b-44gcv [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:56:07 kserve-ci-e2e-test replicaset-controller Normal SuccessfulDelete Deleted pod: router-gateway-1-openshift-default-799f46c59b-44gcv [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:29 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-gateway-1-openshift-default-799f46c59b-z6cd2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:31 kserve-ci-e2e-test replicaset-controller Normal SuccessfulDelete Deleted pod: router-gateway-1-openshift-default-799f46c59b-z6cd2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:29 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set router-gateway-1-openshift-default-799f46c59b from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:05 kserve-ci-e2e-test service-controller Normal EnsuringLoadBalancer Ensuring load balancer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:55 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set router-gateway-1-openshift-default-54c47cdfc7 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:31 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled down replica set router-gateway-1-openshift-default-799f46c59b from 1 to 0 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:09 kserve-ci-e2e-test service-controller Normal EnsuredLoadBalancer Ensured load balancer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 16:46:20 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled down replica set router-gateway-1-openshift-default-54c47cdfc7 from 1 to 0 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:29 kserve-ci-e2e-test gateway_labeler_controller Normal AddedLabel Added label istio.io/rev=openshift-gateway to gateway router-gateway-1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4 to ip-10-0-142-172.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:20 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.28/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:20 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Pulled Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:20 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Created Created container: istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:20 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Started Started container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:23 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Killing Stopping container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:20 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-gateway-2-openshift-default-54c789bdc6-tppn4 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:22 kserve-ci-e2e-test replicaset-controller Normal SuccessfulDelete Deleted pod: router-gateway-2-openshift-default-54c789bdc6-tppn4 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-h2x2d to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:20 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.71/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:34 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:34 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:34 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container istio-proxy [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:40 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:20 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-gateway-2-openshift-default-684dc9b4b9-h2x2d [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:20 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set router-gateway-2-openshift-default-54c789bdc6 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:20 kserve-ci-e2e-test service-controller Normal EnsuringLoadBalancer Ensuring load balancer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:20 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set router-gateway-2-openshift-default-684dc9b4b9 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:22 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled down replica set router-gateway-2-openshift-default-54c789bdc6 from 1 to 0 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:23 kserve-ci-e2e-test service-controller Normal EnsuredLoadBalancer Ensured load balancer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:20 kserve-ci-e2e-test gateway_labeler_controller Normal AddedLabel Added label istio.io/rev=openshift-gateway to gateway router-gateway-2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-57d4965598-p2stc to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:39 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.73/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:40 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:40 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:40 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:40 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:40 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:40 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:45 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:45 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:45 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:23:49 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.73:8001/health": dial tcp 10.133.0.73:8001: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:13 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:13 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:39 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-with-refs-pd-test-kserve-57d4965598-p2stc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-5c9fc7cc79-2ggqn to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:40 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.74/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:40 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:40 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:40 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:44 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:44 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:44 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:23:39 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.74:8000/health": dial tcp 10.133.0.74:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:13 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:39 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-with-refs-pd-test-kserve-prefill-5c9fc7cc79-2ggqn [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:39 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set router-with-refs-pd-test-kserve-prefill-5c9fc7cc79 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:40 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-with-refs-pd-test-kserve-router-scheduler-68dbc8995xw9h6 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-68dbc8995xw9h6 to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:40 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.57/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:40 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:40 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:40 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:42 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:42 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:42 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:13 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:13 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:40 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set router-with-refs-pd-test-kserve-router-scheduler-68dbc89955 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:39 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set router-with-refs-pd-test-kserve-57d4965598 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:39 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:39 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:39 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/router-with-refs-pd-test-kserve-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:39 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-pd-test-kserve-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:39 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:39 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:39 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/router-with-refs-pd-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:39 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:39 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-pd-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:47 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:04 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [router-with-refs-pd-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:24:13 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-697958d7-hhdqd to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:44 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.64/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:44 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:44 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:44 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:53 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:53 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:53 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:11:44 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.64:8000/health": dial tcp 10.133.0.64:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:11:58 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:12:15 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.64:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:43 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-with-refs-test-kserve-697958d7-hhdqd [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-85b8956674-9vvqt to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:44 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.52/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:44 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:44 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:44 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:45 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:45 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:45 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:11:58 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:11:58 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:44 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: router-with-refs-test-kserve-router-scheduler-85b8956674-9vvqt [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:44 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set router-with-refs-test-kserve-router-scheduler-85b8956674 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:43 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set router-with-refs-test-kserve-697958d7 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:43 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:43 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:43 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/router-with-refs-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:43 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:43 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:44 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/router-with-refs-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:44 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:44 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:44 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/router-with-refs-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:45 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:09:54 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:11:54 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [router-with-refs-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:11:58 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk to ip-10-0-142-172.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:39 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.31/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:39 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:39 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:39 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:12 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:38 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:39 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-configmap-ref-test-kserve-router-scheduler-68f87xj26f [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87xj26f to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:39 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.65/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:39 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:39 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:39 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:12 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:12 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:39 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-configmap-ref-test-kserve-router-scheduler-68f876cc5d from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:38 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-configmap-ref-test-kserve-744bf59fbd from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:38 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-configmap-ref-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-configmap-ref-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:38 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:38 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:38 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:38 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:38 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:38 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:39 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:39 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:39 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:49 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:32:49 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:11 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [scheduler-configmap-ref-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:12 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-jbf8p to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:28 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.85/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:28 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:28 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:28 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:36:01 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:27 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-custom-template-test-kserve-5bc7bd6864-jbf8p [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:28 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-custom-template-test-kserve-router-scheduler-5677kqnn [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-5677kqnn to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:28 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.69/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:28 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:28 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:28 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:36:01 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:36:01 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:28 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-custom-template-test-kserve-router-scheduler-567469f665 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:27 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-custom-template-test-kserve-5bc7bd6864 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:23 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-custom-template-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-custom-template-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-custom-template-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/scheduler-custom-template-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-custom-template-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/scheduler-custom-template-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-custom-template-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:27 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-custom-template-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/scheduler-custom-template-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/scheduler-custom-template-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:28 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/scheduler-custom-template-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-custom-template-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:40 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/scheduler-custom-template-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:40 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-custom-template-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:36:00 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [scheduler-custom-template-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:36:01 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-custom-template-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-jlqwh to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:49 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.67/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:49 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:49 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:49 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:34:49 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:48 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-ha-replicas-test-kserve-5c5cfcf776-jlqwh [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d9dg95 to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:49 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.83/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:49 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:49 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:49 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:34:49 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:34:49 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:49 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d9dg95 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:49 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9 to ip-10-0-142-172.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:49 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.32/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:49 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:49 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:49 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:34:49 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Warning Unhealthy Readiness probe failed: service unhealthy (responded with "NOT_SERVING") [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:34:49 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:34:49 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:48 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dbc4 from 0 to 2 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:48 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-ha-replicas-test-kserve-5c5cfcf776 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:42 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-ha-replicas-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-ha-replicas-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:49 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:33:49 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:34:20 kserve-ci-e2e-test LLMInferenceServiceController Warning Error Reconciliation failed: failed to reconcile workload: failed to reconcile self-signed certificates secret: failed to reconcile self-signed TLS certificate: failed to get defaults for v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs: context canceled [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:34:46 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:34:47 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:34:47 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.DestinationRule kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:34:47 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [scheduler-ha-replicas-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:34:48 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb to ip-10-0-142-172.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:26 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.29/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:26 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:26 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:26 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:59 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:25 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-inline-config-test-kserve-7c6c58cc96-rclxb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:25 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-inline-config-test-kserve-router-scheduler-d9ddfsqtmv [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddfsqtmv to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:26 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.62/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:26 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:26 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:26 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:59 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:59 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:25 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-inline-config-test-kserve-router-scheduler-d9ddf6c4d from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:25 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-inline-config-test-kserve-7c6c58cc96 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:25 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-inline-config-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-inline-config-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-inline-config-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/scheduler-inline-config-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/scheduler-inline-config-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:25 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:44 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-inline-config-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:43 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:43 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:58 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [scheduler-inline-config-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:30:59 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:20 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.68/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:20 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulling Pulling image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:21 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Successfully pulled image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" in 725ms (725ms including waiting). Image size: 44914394 bytes. [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:21 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:21 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container llm-d-routing-sidecar [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:21 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:21 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:21 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:20 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46 to ip-10-0-142-172.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:20 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.134.0.33/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:20 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:20 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:20 kserve-ci-e2e-test kubelet/ip-10-0-142-172.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:20 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:20 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-595ls74 to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:20 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.84/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:20 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:20 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:20 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:20 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: scheduler-v06-pd-migration-test-kserve-router-scheduler-595ls74 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:20 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-v06-pd-migration-test-kserve-router-scheduler-59dc679cd from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:19 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set scheduler-v06-pd-migration-test-kserve-5c87756974 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:11 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-v06-pd-migration-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-v06-pd-migration-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:19 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:20 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:20 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:20 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-v06-pd-migration-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:34 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:34 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:35:53 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [scheduler-v06-pd-migration-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-7c7845f79f-knxs6 to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:12 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.67/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:12 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:12 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:12 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:18 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:18 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:18 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:15:51 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.67:8000/health": dial tcp 10.133.0.67:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:03 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-7c7845f79f-tfvwg to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:30 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.70/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:30 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:30 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:30 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:36 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:36 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:36 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:19:50 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.70:8000/health": dial tcp 10.133.0.70:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:02 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:11 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: stop-feature-test-kserve-7c7845f79f-knxs6 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:30 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: stop-feature-test-kserve-7c7845f79f-tfvwg [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7cb57d7b84-rhxsb to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:12 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.54/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:12 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:12 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:12 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:13 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:13 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:13 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:03 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:03 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7cb57d7b84-rn8hp to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:31 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.56/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:31 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:31 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:31 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:32 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:32 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:32 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:02 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:02 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:11 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: stop-feature-test-kserve-router-scheduler-7cb57d7b84-rhxsb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:30 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: stop-feature-test-kserve-router-scheduler-7cb57d7b84-rn8hp [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:11 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set stop-feature-test-kserve-router-scheduler-7cb57d7b84 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:30 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set stop-feature-test-kserve-router-scheduler-7cb57d7b84 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:11 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set stop-feature-test-kserve-7c7845f79f from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:30 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set stop-feature-test-kserve-7c7845f79f from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:16 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy stop-feature-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "stop-feature-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:11 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:11 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:11 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:11 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:11 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-stop-feature-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:11 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/stop-feature-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:11 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/stop-feature-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:11 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:11 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:22 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/stop-feature-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:21 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:13:22 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:20:01 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [stop-feature-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:03 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:03 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:03 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:03 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:03 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:03 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:03 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.InferencePool kserve-ci-e2e-test/stop-feature-test-inference-pool [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:16:04 kserve-ci-e2e-test LLMInferenceServiceController Warning LLMInferenceServiceNotReady LLMInferenceService [stop-feature-test] is no longer Ready because of: GatewaysReady, HTTPRoutesReady, InferencePoolReady, MainWorkloadReady, PrefillWorkerWorkloadReady, PrefillWorkloadReady, RouterReady, SchedulerWorkloadReady, WorkerWorkloadReady, WorkloadsReady [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/tls-verification-test-kserve-5847b7959f-z68fl to ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:35 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.133.0.77/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:35 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:35 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:35 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:42 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Pulled Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:42 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:42 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:28:35 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Startup probe failed: Get "https://10.133.0.77:8000/health": dial tcp 10.133.0.77:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:28:54 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:29:09 kserve-ci-e2e-test kubelet/ip-10-0-128-142.ec2.internal Warning Unhealthy Readiness probe failed: Get "https://10.133.0.77:8000/health": dial tcp 10.133.0.77:8000: connect: connection refused [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:35 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: tls-verification-test-kserve-5847b7959f-z68fl [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 None kserve-ci-e2e-test Normal Scheduled Successfully assigned kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-5d7755bf56-kb4bv to ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:36 kserve-ci-e2e-test multus Normal AddedInterface Add eth0 [10.132.0.58/23] from ovn-kubernetes [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:36 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:43b18792ad3c8c70fe63e50dee47838dba7fd6b00a2dcfe15c76c1dafc2c7ad8" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:36 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:36 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container storage-initializer [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:37 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Pulled Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:37 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Created Created container: main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:37 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Started Started container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:28:54 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Normal Killing Stopping container main [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:28:54 kserve-ci-e2e-test kubelet/ip-10-0-130-182.ec2.internal Warning FailedPreStopHook PreStopHook failed [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:35 kserve-ci-e2e-test replicaset-controller Normal SuccessfulCreate Created pod: tls-verification-test-kserve-router-scheduler-5d7755bf56-kb4bv [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:35 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set tls-verification-test-kserve-router-scheduler-5d7755bf56 from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:35 kserve-ci-e2e-test deployment-controller Normal ScalingReplicaSet Scaled up replica set tls-verification-test-kserve-5847b7959f from 0 to 1 [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:34 kserve-ci-e2e-test OpenDataHubModelController Warning ReconcileError Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy tls-verification-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/tls-verification-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "tls-verification-test-kserve-route" not found [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Secret kserve-ci-e2e-test/tls-verification-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/tls-verification-test-kserve [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/tls-verification-test-kserve-workload-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ServiceAccount kserve-ci-e2e-test/tls-verification-test-epp-sa [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.ClusterRoleBinding /kserve-ci-e2e-test-tls-verification-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Role kserve-ci-e2e-test/tls-verification-test-epp-role [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.RoleBinding kserve-ci-e2e-test/tls-verification-test-epp-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Deployment kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:35 kserve-ci-e2e-test LLMInferenceServiceController Normal Created Created v1.Service kserve-ci-e2e-test/tls-verification-test-epp-service [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:42 kserve-ci-e2e-test LLMInferenceServiceController Normal Created (combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/tls-verification-test-kserve-shadow-svc [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.Secret kserve-ci-e2e-test/tls-verification-test-kserve-self-signed-certs [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:26:41 kserve-ci-e2e-test LLMInferenceServiceController Normal Updated Updated v1.HTTPRoute kserve-ci-e2e-test/tls-verification-test-kserve-route [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:28:46 kserve-ci-e2e-test LLMInferenceServiceController Normal LLMInferenceServiceReady LLMInferenceService [tls-verification-test] is Ready [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:56 2026-07-08 17:28:53 kserve-ci-e2e-test LLMInferenceServiceController Normal Deleted Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-tls-verification-test-epp-auth-rb [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:148 ### Pod scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx (phase=Running) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:188 #### init-container 'llm-d-routing-sidecar' (restarts=0) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:201 # -- logs (current) -- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:202 Flag --decoder-use-tls has been deprecated, use --enable-tls=decoder instead [e2e-llm-inference-service] Flag --prefiller-use-tls has been deprecated, use --enable-tls=prefiller instead [e2e-llm-inference-service] {"level":"info","ts":1783532121.3016627,"msg":"Proxy starting","Built on":"v0.9.0-rc.2","From Git SHA":"181aa8358916e19b8844ccc752b2d6153d4b2ad6"} [e2e-llm-inference-service] {"level":"info","ts":1783532121.3016996,"msg":"Proxy configuration","config":"{\"Port\":\"8000\",\"KVConnector\":\"nixlv2\",\"ECConnector\":\"\",\"DataParallelSize\":1,\"MaxIdleConnsPerHost\":1024,\"EnablePrefillerSampling\":false,\"PrefillMaxRetries\":0,\"PrefillRetryBackoff\":200000000,\"UseTLSForPrefiller\":true,\"UseTLSForDecoder\":true,\"UseTLSForEncoder\":false,\"InsecureSkipVerifyForPrefiller\":false,\"InsecureSkipVerifyForEncoder\":false,\"InsecureSkipVerifyForDecoder\":false,\"SecureServing\":true,\"CertPath\":\"/var/run/kserve/tls\",\"MooncakeBootstrapPort\":8998,\"EnableSSRFProtection\":true,\"InferencePoolNamespace\":\"kserve-ci-e2e-test\",\"InferencePoolName\":\"scheduler-v06-pd-migration-test-inference-pool\",\"PoolGroup\":\"inference.networking.x-k8s.io\",\"DecodeChunkSize\":0,\"Tracing\":false,\"MoRIIOWriteMode\":false,\"MoRIIODecodeNotifyPort\":61005,\"MoRIIODecodeHandshakePort\":6301,\"MoRIIODecodePodIP\":\"\",\"MoRIIOParallelDispatch\":false,\"MoRIIOPrefillHandshakePort\":6301,\"MoRIIOPrefillNotifyPort\":61005,\"MoRIIOTPSize\":1,\"MoRIIODPSize\":1,\"MoRIIORemoteHosts\":null,\"MoRIIODPSizeLocal\":0,\"MoRIIODecodeHosts\":null,\"DecoderURL\":\"https://localhost:8001\"}"} [e2e-llm-inference-service] {"level":"info","ts":1783532121.3022628,"logger":"allowlist-validator","msg":"starting SSRF protection allowlist validator","namespace":"kserve-ci-e2e-test","poolName":"scheduler-v06-pd-migration-test-inference-pool","gvr":"inference.networking.x-k8s.io/v1alpha2, Resource=inferencepools"} [e2e-llm-inference-service] {"level":"info","ts":1783532121.3170924,"logger":"allowlist-validator","msg":"InferencePool added","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532121.32541,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":0,"targets":{}} [e2e-llm-inference-service] {"level":"info","ts":1783532121.3254726,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":0,"targets":{}} [e2e-llm-inference-service] {"level":"info","ts":1783532121.4023988,"logger":"allowlist-validator","msg":"allowlist validator started successfully"} [e2e-llm-inference-service] {"level":"info","ts":1783532121.4033864,"logger":"proxy server on port 8000","msg":"server TLS configured"} [e2e-llm-inference-service] {"level":"info","ts":1783532121.4034035,"logger":"proxy server on port 8000","msg":"starting","addr":"[::]:8000"} [e2e-llm-inference-service] {"level":"info","ts":1783532121.4147716,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":2,"targets":{"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532121.444648,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532122.4503953,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532130.3736944,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532130.3798203,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532130.4592962,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532130.5002098,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532131.5075543,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532151.3178859,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532151.32872,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532151.3287964,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] 2026/07/08 17:35:53 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532153.8187768,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"783c802b-7af3-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/08 17:35:53 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532153.8371322,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"783f83d2-7af3-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/08 17:35:57 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532157.8576374,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"7aa4ebcd-7af3-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/08 17:36:05 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532165.8766139,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"7f6c9c4d-7af3-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783532181.3187046,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532181.32683,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532181.3268907,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] 2026/07/08 17:36:21 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532181.9170866,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"88fc02b1-7af3-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783532211.3196495,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532211.3286178,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532211.3286753,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] 2026/07/08 17:36:53 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532213.9392672,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"9c1218a9-7af3-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783532241.3203635,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532241.3294702,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532241.3295262,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532271.3207939,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532271.3306293,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532271.3306892,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] 2026/07/08 17:37:57 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532277.9848094,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"c23ea432-7af3-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783532301.3213487,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532301.3294551,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532301.329512,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532331.3219013,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532331.3313062,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532331.3313575,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532361.3219578,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532361.33027,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532361.3303437,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532391.3223162,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532391.331793,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532391.33184,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] 2026/07/08 17:39:58 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532398.0308383,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"09cc440c-7af4-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783532421.3225398,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532421.331939,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532421.3319907,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532451.3233345,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532451.3321128,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532451.33217,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532481.323499,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532481.3319561,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532481.3320074,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532511.3238847,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532511.3332627,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532511.3333175,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] 2026/07/08 17:41:58 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532518.0772107,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"5159d6b3-7af4-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/08 17:42:03 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532523.1848643,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"54657bdd-7af4-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/08 17:42:03 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532523.213923,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"5469ead1-7af4-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/08 17:42:07 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532527.2403092,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"56d03bea-7af4-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/08 17:42:15 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532535.2591383,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"5b97cf8a-7af4-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783532541.324223,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532541.3314989,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532541.3315601,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] 2026/07/08 17:42:31 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532551.2818651,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"65247c89-7af4-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783532571.3245444,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532571.3336616,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532571.3337173,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] 2026/07/08 17:43:03 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532583.304591,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"783ad17a-7af4-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783532601.3256443,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532601.3336656,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532601.333717,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532631.3264594,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532631.3370543,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532631.337111,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] 2026/07/08 17:44:07 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532647.3497686,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"9e675358-7af4-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783532661.3269815,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532661.3364646,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532661.3365262,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532691.3275056,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532691.3403566,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532691.340421,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532721.3281698,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532721.336309,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532721.3363602,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532751.3284209,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532751.337325,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532751.3373814,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] 2026/07/08 17:46:07 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532767.4001346,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"e5f5889a-7af4-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783532781.3294969,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532781.3380666,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532781.3381164,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532811.3304963,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532811.3397825,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532811.3398476,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532841.331188,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532841.3398602,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532841.3399165,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532871.3318417,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532871.3409808,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532871.341035,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] 2026/07/08 17:48:07 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532887.447634,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"2d832f94-7af5-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/08 17:48:12 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532892.531127,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"308b3a6b-7af5-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/08 17:48:12 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532892.5474393,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"308dc84e-7af5-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/08 17:48:16 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532896.5656216,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"32f2df3e-7af5-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783532901.3320053,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532901.3408623,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532901.340922,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] 2026/07/08 17:48:24 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532904.5844223,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"37ba7044-7af5-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] 2026/07/08 17:48:40 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532920.6068833,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"414713f4-7af5-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783532931.3320522,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532931.3410034,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532931.34106,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] 2026/07/08 17:49:12 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783532952.6302333,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"545d7c23-7af5-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783532961.3329225,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532961.3403964,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532961.3404639,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532991.333,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783532991.342211,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783532991.3422785,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] 2026/07/08 17:50:16 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783533016.6784344,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"7a8a69b2-7af5-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783533021.3334248,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783533021.340849,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783533021.340902,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783533051.3337467,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783533051.343492,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783533051.3435504,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783533081.3342073,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783533081.3420506,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783533081.3420985,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783533111.3351328,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783533111.3445024,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783533111.3445585,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] 2026/07/08 17:52:16 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783533136.725048,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"c2180da6-7af5-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] {"level":"info","ts":1783533141.3358078,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783533141.343377,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783533141.3434265,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783533171.336201,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783533171.3453991,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783533171.345452,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783533201.3364632,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783533201.344212,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783533201.3442578,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783533231.3374684,"logger":"allowlist-validator","msg":"InferencePool updated","name":"scheduler-v06-pd-migration-test-inference-pool"} [e2e-llm-inference-service] {"level":"info","ts":1783533231.3529918,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] {"level":"info","ts":1783533231.353041,"logger":"allowlist-validator","msg":"rebuilt allowlist","targetCount":4,"targets":{"10.132.0.68":{},"10.134.0.33":{},"scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx":{},"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46":{}}} [e2e-llm-inference-service] 2026/07/08 17:54:16 http: proxy error: tls: failed to verify certificate: x509: certificate is valid for 127.0.0.1, not 10.134.0.33 [e2e-llm-inference-service] {"level":"error","ts":1783533256.7732034,"logger":"proxy server on port 8000","msg":"prefill request failed","request_id":"09a60394-7af6-11f1-b514-0a580a840044","body":"","error":"prefill returned 502","stacktrace":"github.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).handleNIXLV2\n\t/workspace/pkg/sidecar/proxy/connector_nixlv2.go:242\ngithub.com/llm-d/llm-d-router/pkg/sidecar/proxy.(*Server).createRoutes.(*Server).disaggregatedPrefillHandler.func3\n\t/workspace/pkg/sidecar/proxy/chat_completions.go:183\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2861\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*middleware).serveHTTP\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:178\ngo.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.NewMiddleware.func1.1\n\t/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp@v0.68.0/handler.go:66\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2322\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3340\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2109"} [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:188 #### container 'main' (restarts=0) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:201 # -- logs (current) -- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:202 I0708 17:35:21.501155 1 config.go:602] "Configuration:" =< [e2e-llm-inference-service] { [e2e-llm-inference-service] "IP": "", [e2e-llm-inference-service] "PodName": "", [e2e-llm-inference-service] "PodNameSpace": "", [e2e-llm-inference-service] "VllmDevMode": false, [e2e-llm-inference-service] "block-size": 16, [e2e-llm-inference-service] "data-parallel-rank": -1, [e2e-llm-inference-service] "data-parallel-size": 1, [e2e-llm-inference-service] "dataset-in-memory": false, [e2e-llm-inference-service] "dataset-path": "", [e2e-llm-inference-service] "dataset-table-name": "llmd", [e2e-llm-inference-service] "dataset-url": "", [e2e-llm-inference-service] "default-embedding-dimensions": 384, [e2e-llm-inference-service] "ec-transfer-config": "", [e2e-llm-inference-service] "enable-kvcache": false, [e2e-llm-inference-service] "enable-prefix-caching": false, [e2e-llm-inference-service] "enable-request-id-headers": false, [e2e-llm-inference-service] "enable-sleep-mode": false, [e2e-llm-inference-service] "enforce-eager": false, [e2e-llm-inference-service] "event-batch-size": 16, [e2e-llm-inference-service] "failure-injection-rate": 0, [e2e-llm-inference-service] "failure-types": null, [e2e-llm-inference-service] "fake-metrics": null, [e2e-llm-inference-service] "fake-metrics-refresh-interval": 100000000, [e2e-llm-inference-service] "global-cache-hit-threshold": 0, [e2e-llm-inference-service] "hash-seed": "", [e2e-llm-inference-service] "inter-token-latency": 0, [e2e-llm-inference-service] "inter-token-latency-std-dev": 0, [e2e-llm-inference-service] "kv-cache-size": 1024, [e2e-llm-inference-service] "kv-cache-transfer-latency": 0, [e2e-llm-inference-service] "kv-cache-transfer-latency-std-dev": 0, [e2e-llm-inference-service] "kv-cache-transfer-time-per-token": 0, [e2e-llm-inference-service] "kv-cache-transfer-time-std-dev": 0, [e2e-llm-inference-service] "latency-calculator": "", [e2e-llm-inference-service] "lora-modules": null, [e2e-llm-inference-service] "max-cpu-loras": 1, [e2e-llm-inference-service] "max-loras": 1, [e2e-llm-inference-service] "max-model-len": 1024, [e2e-llm-inference-service] "max-num-seqs": 5, [e2e-llm-inference-service] "max-tool-call-array-param-length": 5, [e2e-llm-inference-service] "max-tool-call-integer-param": 100, [e2e-llm-inference-service] "max-tool-call-number-param": 100, [e2e-llm-inference-service] "max-waiting-queue-length": 1000, [e2e-llm-inference-service] "min-tool-call-array-param-length": 1, [e2e-llm-inference-service] "min-tool-call-integer-param": 0, [e2e-llm-inference-service] "min-tool-call-number-param": 0, [e2e-llm-inference-service] "mm-encoder-only": false, [e2e-llm-inference-service] "mm-processor-kwargs": "", [e2e-llm-inference-service] "mode": "random", [e2e-llm-inference-service] "model": "facebook/opt-125m", [e2e-llm-inference-service] "object-tool-call-not-required-field-probability": 50, [e2e-llm-inference-service] "port": 8001, [e2e-llm-inference-service] "prefill-overhead": 0, [e2e-llm-inference-service] "prefill-time-per-token": 0, [e2e-llm-inference-service] "prefill-time-std-dev": 0, [e2e-llm-inference-service] "seed": 1783532121500737300, [e2e-llm-inference-service] "self-signed-certs": false, [e2e-llm-inference-service] "served-model-name": [ [e2e-llm-inference-service] "facebook/opt-125m" [e2e-llm-inference-service] ], [e2e-llm-inference-service] "ssl-certfile": "/var/run/kserve/tls/tls.crt", [e2e-llm-inference-service] "ssl-keyfile": "/var/run/kserve/tls/tls.key", [e2e-llm-inference-service] "time-factor-under-load": 1, [e2e-llm-inference-service] "time-to-first-token": 0, [e2e-llm-inference-service] "time-to-first-token-std-dev": 0, [e2e-llm-inference-service] "tool-call-not-required-param-probability": 50, [e2e-llm-inference-service] "uds-socket-path": "/tmp/tokenizer/tokenizer-uds.socket", [e2e-llm-inference-service] "zmq-endpoint": "tcp://127.0.0.1:5557" [e2e-llm-inference-service] } [e2e-llm-inference-service] > [e2e-llm-inference-service] I0708 17:35:21.537248 1 tokenizer.go:104] "Model is not a real HF model, using simulated tokenizer" model="facebook/opt-125m" [e2e-llm-inference-service] I0708 17:35:21.541667 1 context.go:138] "No dataset path or URL provided, using random text for responses" [e2e-llm-inference-service] I0708 17:35:21.541727 1 communication.go:49] "Starting communication layer" [e2e-llm-inference-service] I0708 17:35:21.541823 1 simulator.go:188] "Start processing routine" [e2e-llm-inference-service] I0708 17:35:21.542020 1 http_server_tls.go:44] "HTTPS server starting with certificate files" cert="/var/run/kserve/tls/tls.crt" key="/var/run/kserve/tls/tls.key" [e2e-llm-inference-service] I0708 17:35:21.542065 1 grpc.go:126] "Server starting" protocol="gRPC" port=8001 [e2e-llm-inference-service] I0708 17:35:21.542653 1 http.go:96] "Server starting" protocol="HTTPS" port=8001 [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:148 ### Pod scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46 (phase=Running) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:188 #### container 'main' (restarts=0) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:201 # -- logs (current) -- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:202 I0708 17:35:20.576726 1 config.go:602] "Configuration:" =< [e2e-llm-inference-service] { [e2e-llm-inference-service] "IP": "", [e2e-llm-inference-service] "PodName": "", [e2e-llm-inference-service] "PodNameSpace": "", [e2e-llm-inference-service] "VllmDevMode": false, [e2e-llm-inference-service] "block-size": 16, [e2e-llm-inference-service] "data-parallel-rank": -1, [e2e-llm-inference-service] "data-parallel-size": 1, [e2e-llm-inference-service] "dataset-in-memory": false, [e2e-llm-inference-service] "dataset-path": "", [e2e-llm-inference-service] "dataset-table-name": "llmd", [e2e-llm-inference-service] "dataset-url": "", [e2e-llm-inference-service] "default-embedding-dimensions": 384, [e2e-llm-inference-service] "ec-transfer-config": "", [e2e-llm-inference-service] "enable-kvcache": false, [e2e-llm-inference-service] "enable-prefix-caching": false, [e2e-llm-inference-service] "enable-request-id-headers": false, [e2e-llm-inference-service] "enable-sleep-mode": false, [e2e-llm-inference-service] "enforce-eager": false, [e2e-llm-inference-service] "event-batch-size": 16, [e2e-llm-inference-service] "failure-injection-rate": 0, [e2e-llm-inference-service] "failure-types": null, [e2e-llm-inference-service] "fake-metrics": null, [e2e-llm-inference-service] "fake-metrics-refresh-interval": 100000000, [e2e-llm-inference-service] "global-cache-hit-threshold": 0, [e2e-llm-inference-service] "hash-seed": "", [e2e-llm-inference-service] "inter-token-latency": 0, [e2e-llm-inference-service] "inter-token-latency-std-dev": 0, [e2e-llm-inference-service] "kv-cache-size": 1024, [e2e-llm-inference-service] "kv-cache-transfer-latency": 0, [e2e-llm-inference-service] "kv-cache-transfer-latency-std-dev": 0, [e2e-llm-inference-service] "kv-cache-transfer-time-per-token": 0, [e2e-llm-inference-service] "kv-cache-transfer-time-std-dev": 0, [e2e-llm-inference-service] "latency-calculator": "", [e2e-llm-inference-service] "lora-modules": null, [e2e-llm-inference-service] "max-cpu-loras": 1, [e2e-llm-inference-service] "max-loras": 1, [e2e-llm-inference-service] "max-model-len": 1024, [e2e-llm-inference-service] "max-num-seqs": 5, [e2e-llm-inference-service] "max-tool-call-array-param-length": 5, [e2e-llm-inference-service] "max-tool-call-integer-param": 100, [e2e-llm-inference-service] "max-tool-call-number-param": 100, [e2e-llm-inference-service] "max-waiting-queue-length": 1000, [e2e-llm-inference-service] "min-tool-call-array-param-length": 1, [e2e-llm-inference-service] "min-tool-call-integer-param": 0, [e2e-llm-inference-service] "min-tool-call-number-param": 0, [e2e-llm-inference-service] "mm-encoder-only": false, [e2e-llm-inference-service] "mm-processor-kwargs": "", [e2e-llm-inference-service] "mode": "random", [e2e-llm-inference-service] "model": "facebook/opt-125m", [e2e-llm-inference-service] "object-tool-call-not-required-field-probability": 50, [e2e-llm-inference-service] "port": 8000, [e2e-llm-inference-service] "prefill-overhead": 0, [e2e-llm-inference-service] "prefill-time-per-token": 0, [e2e-llm-inference-service] "prefill-time-std-dev": 0, [e2e-llm-inference-service] "seed": 1783532120576266800, [e2e-llm-inference-service] "self-signed-certs": false, [e2e-llm-inference-service] "served-model-name": [ [e2e-llm-inference-service] "facebook/opt-125m" [e2e-llm-inference-service] ], [e2e-llm-inference-service] "ssl-certfile": "/var/run/kserve/tls/tls.crt", [e2e-llm-inference-service] "ssl-keyfile": "/var/run/kserve/tls/tls.key", [e2e-llm-inference-service] "time-factor-under-load": 1, [e2e-llm-inference-service] "time-to-first-token": 0, [e2e-llm-inference-service] "time-to-first-token-std-dev": 0, [e2e-llm-inference-service] "tool-call-not-required-param-probability": 50, [e2e-llm-inference-service] "uds-socket-path": "/tmp/tokenizer/tokenizer-uds.socket", [e2e-llm-inference-service] "zmq-endpoint": "tcp://127.0.0.1:5557" [e2e-llm-inference-service] } [e2e-llm-inference-service] > [e2e-llm-inference-service] I0708 17:35:20.611515 1 tokenizer.go:104] "Model is not a real HF model, using simulated tokenizer" model="facebook/opt-125m" [e2e-llm-inference-service] I0708 17:35:20.617058 1 context.go:138] "No dataset path or URL provided, using random text for responses" [e2e-llm-inference-service] I0708 17:35:20.617122 1 communication.go:49] "Starting communication layer" [e2e-llm-inference-service] I0708 17:35:20.617135 1 simulator.go:188] "Start processing routine" [e2e-llm-inference-service] I0708 17:35:20.617405 1 http_server_tls.go:44] "HTTPS server starting with certificate files" cert="/var/run/kserve/tls/tls.crt" key="/var/run/kserve/tls/tls.key" [e2e-llm-inference-service] I0708 17:35:20.617448 1 grpc.go:126] "Server starting" protocol="gRPC" port=8000 [e2e-llm-inference-service] I0708 17:35:20.618052 1 http.go:96] "Server starting" protocol="HTTPS" port=8000 [e2e-llm-inference-service] I0708 17:35:53.818724 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:34674\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:35:53.837169 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:34688\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:35:57.857653 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:43304\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:36:05.876612 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:43318\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:36:21.917127 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:35588\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:36:53.939345 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:54960\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:37:57.984883 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:51042\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:39:58.030881 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:57012\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:41:58.077266 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:39722\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:42:03.184882 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:39738\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:42:03.213937 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:39750\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:42:07.240351 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:36498\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:42:15.259181 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:36512\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:42:31.281875 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:59616\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:43:03.304582 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:47272\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:44:07.349755 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:41656\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:46:07.400133 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:45116\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:48:07.447616 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:37520\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:48:12.531136 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:37522\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:48:12.547463 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:37536\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:48:16.565599 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:59662\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:48:24.584450 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:59664\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:48:40.606928 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:42360\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:49:12.630306 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:46546\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:50:16.678443 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:60700\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:52:16.725128 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:53140\": remote error: tls: bad certificate" [e2e-llm-inference-service] I0708 17:54:16.773319 1 communication.go:105] "Server error" msg="error when serving connection \"10.134.0.33:8000\"<->\"10.132.0.68:58718\": remote error: tls: bad certificate" [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:148 ### Pod scheduler-v06-pd-migration-test-kserve-router-scheduler-595ls74 (phase=Running) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:188 #### container 'main' (restarts=0) [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:201 # -- logs (current) -- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:diagnostic.py:202 "Value": "v0.9.0-rc.2" [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] ], [e2e-llm-inference-service] "InstrumentationScope": { [e2e-llm-inference-service] "Name": "llm-d-router/pkg/epp/framework/plugins/scheduling", [e2e-llm-inference-service] "Version": "v0.9.0-rc.2", [e2e-llm-inference-service] "SchemaURL": "", [e2e-llm-inference-service] "Attributes": [ [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "commit-sha", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "181aa8358916e19b8844ccc752b2d6153d4b2ad6" [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] ] [e2e-llm-inference-service] }, [e2e-llm-inference-service] "InstrumentationLibrary": { [e2e-llm-inference-service] "Name": "llm-d-router/pkg/epp/framework/plugins/scheduling", [e2e-llm-inference-service] "Version": "v0.9.0-rc.2", [e2e-llm-inference-service] "SchemaURL": "", [e2e-llm-inference-service] "Attributes": [ [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "commit-sha", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "181aa8358916e19b8844ccc752b2d6153d4b2ad6" [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] ] [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] { [e2e-llm-inference-service] "Name": "gateway.request_orchestration", [e2e-llm-inference-service] "SpanContext": { [e2e-llm-inference-service] "TraceID": "0c356b2d88df7bd0123a7a17818ab2d7", [e2e-llm-inference-service] "SpanID": "a1abfc590f65bc5e", [e2e-llm-inference-service] "TraceFlags": "01", [e2e-llm-inference-service] "TraceState": "", [e2e-llm-inference-service] "Remote": false [e2e-llm-inference-service] }, [e2e-llm-inference-service] "Parent": { [e2e-llm-inference-service] "TraceID": "0c356b2d88df7bd0123a7a17818ab2d7", [e2e-llm-inference-service] "SpanID": "fa2c3a3678c910bb", [e2e-llm-inference-service] "TraceFlags": "01", [e2e-llm-inference-service] "TraceState": "", [e2e-llm-inference-service] "Remote": false [e2e-llm-inference-service] }, [e2e-llm-inference-service] "SpanKind": 2, [e2e-llm-inference-service] "StartTime": "2026-07-08T17:52:16.708589096Z", [e2e-llm-inference-service] "EndTime": "2026-07-08T17:52:16.708823331Z", [e2e-llm-inference-service] "Attributes": [ [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "target_model", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "facebook/opt-125m" [e2e-llm-inference-service] } [e2e-llm-inference-service] }, [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "request_prio", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "INT64", [e2e-llm-inference-service] "Value": 0 [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] ], [e2e-llm-inference-service] "Events": null, [e2e-llm-inference-service] "Links": null, [e2e-llm-inference-service] "Status": { [e2e-llm-inference-service] "Code": "Unset", [e2e-llm-inference-service] "Description": "" [e2e-llm-inference-service] }, [e2e-llm-inference-service] "DroppedAttributes": 0, [e2e-llm-inference-service] "DroppedEvents": 0, [e2e-llm-inference-service] "DroppedLinks": 0, [e2e-llm-inference-service] "ChildSpanCount": 5, [e2e-llm-inference-service] "Resource": [ [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "service.name", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "llm-d-epp" [e2e-llm-inference-service] } [e2e-llm-inference-service] }, [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "service.version", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "v0.9.0-rc.2" [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] ], [e2e-llm-inference-service] "InstrumentationScope": { [e2e-llm-inference-service] "Name": "llm-d-router/pkg/epp/requestcontrol", [e2e-llm-inference-service] "Version": "v0.9.0-rc.2", [e2e-llm-inference-service] "SchemaURL": "", [e2e-llm-inference-service] "Attributes": [ [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "commit-sha", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "181aa8358916e19b8844ccc752b2d6153d4b2ad6" [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] ] [e2e-llm-inference-service] }, [e2e-llm-inference-service] "InstrumentationLibrary": { [e2e-llm-inference-service] "Name": "llm-d-router/pkg/epp/requestcontrol", [e2e-llm-inference-service] "Version": "v0.9.0-rc.2", [e2e-llm-inference-service] "SchemaURL": "", [e2e-llm-inference-service] "Attributes": [ [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "commit-sha", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "181aa8358916e19b8844ccc752b2d6153d4b2ad6" [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] ] [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] { [e2e-llm-inference-service] "Name": "gateway.request", [e2e-llm-inference-service] "SpanContext": { [e2e-llm-inference-service] "TraceID": "0c356b2d88df7bd0123a7a17818ab2d7", [e2e-llm-inference-service] "SpanID": "fa2c3a3678c910bb", [e2e-llm-inference-service] "TraceFlags": "01", [e2e-llm-inference-service] "TraceState": "", [e2e-llm-inference-service] "Remote": false [e2e-llm-inference-service] }, [e2e-llm-inference-service] "Parent": { [e2e-llm-inference-service] "TraceID": "00000000000000000000000000000000", [e2e-llm-inference-service] "SpanID": "0000000000000000", [e2e-llm-inference-service] "TraceFlags": "00", [e2e-llm-inference-service] "TraceState": "", [e2e-llm-inference-service] "Remote": false [e2e-llm-inference-service] }, [e2e-llm-inference-service] "SpanKind": 2, [e2e-llm-inference-service] "StartTime": "2026-07-08T17:52:16.708539056Z", [e2e-llm-inference-service] "EndTime": "2026-07-08T17:52:16.726383319Z", [e2e-llm-inference-service] "Attributes": null, [e2e-llm-inference-service] "Events": null, [e2e-llm-inference-service] "Links": null, [e2e-llm-inference-service] "Status": { [e2e-llm-inference-service] "Code": "Unset", [e2e-llm-inference-service] "Description": "" [e2e-llm-inference-service] }, [e2e-llm-inference-service] "DroppedAttributes": 0, [e2e-llm-inference-service] "DroppedEvents": 0, [e2e-llm-inference-service] "DroppedLinks": 0, [e2e-llm-inference-service] "ChildSpanCount": 1, [e2e-llm-inference-service] "Resource": [ [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "service.name", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "llm-d-epp" [e2e-llm-inference-service] } [e2e-llm-inference-service] }, [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "service.version", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "v0.9.0-rc.2" [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] ], [e2e-llm-inference-service] "InstrumentationScope": { [e2e-llm-inference-service] "Name": "llm-d-router/pkg/epp/handlers", [e2e-llm-inference-service] "Version": "v0.9.0-rc.2", [e2e-llm-inference-service] "SchemaURL": "", [e2e-llm-inference-service] "Attributes": [ [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "commit-sha", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "181aa8358916e19b8844ccc752b2d6153d4b2ad6" [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] ] [e2e-llm-inference-service] }, [e2e-llm-inference-service] "InstrumentationLibrary": { [e2e-llm-inference-service] "Name": "llm-d-router/pkg/epp/handlers", [e2e-llm-inference-service] "Version": "v0.9.0-rc.2", [e2e-llm-inference-service] "SchemaURL": "", [e2e-llm-inference-service] "Attributes": [ [e2e-llm-inference-service] { [e2e-llm-inference-service] "Key": "commit-sha", [e2e-llm-inference-service] "Value": { [e2e-llm-inference-service] "Type": "STRING", [e2e-llm-inference-service] "Value": "181aa8358916e19b8844ccc752b2d6153d4b2ad6" [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] ] [e2e-llm-inference-service] } [e2e-llm-inference-service] } [e2e-llm-inference-service] {"level":"info","ts":1783533256.7557192,"caller":"handlers/server.go:395","msg":"EPP received request","x-request-id":"1d45cc90-a613-4061-ab62-a3ba090ed100"} [e2e-llm-inference-service] {"level":"info","ts":1783533256.7560043,"caller":"handlers/server.go:656","msg":"EPP sent request body response(s) to proxy","x-request-id":"1d45cc90-a613-4061-ab62-a3ba090ed100","modelName":"facebook/opt-125m","targetModelName":"facebook/opt-125m"} [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-service [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 11a3c204-9ba0-43bd-a523-78306540d229 [e2e-llm-inference-service] resourceVersion: '64762' [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] endpoints.kubernetes.io/managed-by: endpoint-controller [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] endpoints.kubernetes.io/last-change-trigger-time: '2026-07-08T17:35:52Z' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:52Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:endpoints.kubernetes.io/last-change-trigger-time: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:endpoints.kubernetes.io/managed-by: {} [e2e-llm-inference-service] f:subsets: {} [e2e-llm-inference-service] subsets: [e2e-llm-inference-service] - addresses: [e2e-llm-inference-service] - ip: 10.133.0.84 [e2e-llm-inference-service] nodeName: ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] targetRef: [e2e-llm-inference-service] kind: Pod [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-router-scheduler-595ls74 [e2e-llm-inference-service] uid: c6e3eb6e-ca4d-41fd-a402-927efffc9858 [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - name: grpc-health [e2e-llm-inference-service] port: 9003 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: metrics [e2e-llm-inference-service] port: 9090 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: zmq [e2e-llm-inference-service] port: 5557 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: grpc [e2e-llm-inference-service] port: 9002 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] kind: Endpoints [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 03ac9c8f-f019-444b-9617-b625e8f9041e [e2e-llm-inference-service] resourceVersion: '64491' [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] endpoints.kubernetes.io/managed-by: endpoint-controller [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] endpoints.kubernetes.io/last-change-trigger-time: '2026-07-08T17:35:31Z' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:31Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:endpoints.kubernetes.io/last-change-trigger-time: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:endpoints.kubernetes.io/managed-by: {} [e2e-llm-inference-service] f:subsets: {} [e2e-llm-inference-service] subsets: [e2e-llm-inference-service] - addresses: [e2e-llm-inference-service] - ip: 10.132.0.68 [e2e-llm-inference-service] nodeName: ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] targetRef: [e2e-llm-inference-service] kind: Pod [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx [e2e-llm-inference-service] uid: 1eaa996a-363c-4232-abfd-bfcf8a0a1aa2 [e2e-llm-inference-service] - ip: 10.134.0.33 [e2e-llm-inference-service] nodeName: ip-10-0-142-172.ec2.internal [e2e-llm-inference-service] targetRef: [e2e-llm-inference-service] kind: Pod [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46 [e2e-llm-inference-service] uid: 6964cc10-b630-4b37-9005-73e5a9a47a08 [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - name: https [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] appProtocol: https [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] kind: Endpoints [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx [e2e-llm-inference-service] generateName: scheduler-v06-pd-migration-test-kserve-5c87756974- [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 1eaa996a-363c-4232-abfd-bfcf8a0a1aa2 [e2e-llm-inference-service] resourceVersion: '64490' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: decode [e2e-llm-inference-service] pod-template-hash: 5c87756974 [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] k8s.ovn.org/pod-networks: '{"default":{"ip_addresses":["10.132.0.68/23"],"mac_address":"0a:58:0a:84:00:44","gateway_ips":["10.132.0.1"],"routes":[{"dest":"10.132.0.0/14","nextHop":"10.132.0.1"},{"dest":"172.31.0.0/16","nextHop":"10.132.0.1"},{"dest":"169.254.0.5/32","nextHop":"10.132.0.1"},{"dest":"100.64.0.0/16","nextHop":"10.132.0.1"}],"ip_address":"10.132.0.68/23","gateway_ip":"10.132.0.1","role":"primary"}}' [e2e-llm-inference-service] k8s.v1.cni.cncf.io/network-status: "[{\n \"name\": \"ovn-kubernetes\",\n \ [e2e-llm-inference-service] \ \"interface\": \"eth0\",\n \"ips\": [\n \"10.132.0.68\"\n ],\n\ [e2e-llm-inference-service] \ \"mac\": \"0a:58:0a:84:00:44\",\n \"default\": true,\n \"dns\": {}\n\ [e2e-llm-inference-service] }]" [e2e-llm-inference-service] openshift.io/scc: restricted-v2 [e2e-llm-inference-service] seccomp.security.alpha.kubernetes.io/pod: runtime/default [e2e-llm-inference-service] security.openshift.io/validated-scc-subject-type: user [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: apps/v1 [e2e-llm-inference-service] kind: ReplicaSet [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-5c87756974 [e2e-llm-inference-service] uid: 9b80e29d-2ecd-4e16-87fc-95060c248006 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:generateName: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:pod-template-hash: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"9b80e29d-2ecd-4e16-87fc-95060c248006"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:containers: [e2e-llm-inference-service] k:{"name":"main"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:args: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"HF_HUB_CACHE"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"HOME"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"VLLM_LOGGING_LEVEL"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:lifecycle: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:preStop: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":8001,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:limits: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:requests: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:seccompProfile: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:startupProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/dev/shm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/models"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/tmp"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:dnsPolicy: {} [e2e-llm-inference-service] f:enableServiceLinks: {} [e2e-llm-inference-service] f:initContainers: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"llm-d-routing-sidecar"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"INFERENCE_POOL_NAME"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"INFERENCE_POOL_NAMESPACE"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:valueFrom: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:fieldRef: {} [e2e-llm-inference-service] k:{"name":"SSL_CERT_DIR"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":8000,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:schedulerName: {} [e2e-llm-inference-service] f:securityContext: {} [e2e-llm-inference-service] f:serviceAccount: {} [e2e-llm-inference-service] f:serviceAccountName: {} [e2e-llm-inference-service] f:terminationGracePeriodSeconds: {} [e2e-llm-inference-service] f:volumes: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"dshm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:medium: {} [e2e-llm-inference-service] f:sizeLimit: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"model-cache"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tls-certs"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:secret: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:defaultMode: {} [e2e-llm-inference-service] f:secretName: {} [e2e-llm-inference-service] k:{"name":"tmp-dir"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] - manager: ip-10-0-130-182 [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] f:k8s.ovn.org/pod-networks: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] - manager: multus-daemon [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] f:k8s.v1.cni.cncf.io/network-status: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] - manager: kubelet [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:31Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:conditions: [e2e-llm-inference-service] k:{"type":"ContainersReady"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"Initialized"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"PodReadyToStartContainers"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"PodScheduled"}: [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] k:{"type":"Ready"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:containerStatuses: {} [e2e-llm-inference-service] f:hostIP: {} [e2e-llm-inference-service] f:hostIPs: {} [e2e-llm-inference-service] f:initContainerStatuses: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:phase: {} [e2e-llm-inference-service] f:podIP: {} [e2e-llm-inference-service] f:podIPs: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"ip":"10.132.0.68"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:ip: {} [e2e-llm-inference-service] f:startTime: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] spec: [e2e-llm-inference-service] volumes: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] emptyDir: [e2e-llm-inference-service] medium: Memory [e2e-llm-inference-service] sizeLimit: 1Gi [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] secret: [e2e-llm-inference-service] secretName: scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] - name: kube-api-access-94vcr [e2e-llm-inference-service] projected: [e2e-llm-inference-service] sources: [e2e-llm-inference-service] - serviceAccountToken: [e2e-llm-inference-service] expirationSeconds: 3607 [e2e-llm-inference-service] path: token [e2e-llm-inference-service] - configMap: [e2e-llm-inference-service] name: kube-root-ca.crt [e2e-llm-inference-service] items: [e2e-llm-inference-service] - key: ca.crt [e2e-llm-inference-service] path: ca.crt [e2e-llm-inference-service] - downwardAPI: [e2e-llm-inference-service] items: [e2e-llm-inference-service] - path: namespace [e2e-llm-inference-service] fieldRef: [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] fieldPath: metadata.namespace [e2e-llm-inference-service] - configMap: [e2e-llm-inference-service] name: openshift-service-ca.crt [e2e-llm-inference-service] items: [e2e-llm-inference-service] - key: service-ca.crt [e2e-llm-inference-service] path: service-ca.crt [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] initContainers: [e2e-llm-inference-service] - name: llm-d-routing-sidecar [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/pd-sidecar [e2e-llm-inference-service] - --port=8000 [e2e-llm-inference-service] - --vllm-port=8001 [e2e-llm-inference-service] - --kv-connector=nixlv2 [e2e-llm-inference-service] - --enable-ssrf-protection=true [e2e-llm-inference-service] - --pool-group=inference.networking.x-k8s.io [e2e-llm-inference-service] - --inference-pool=kserve-ci-e2e-test/scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] - --secure-proxy=true [e2e-llm-inference-service] - --cert-path=/var/run/kserve/tls [e2e-llm-inference-service] - --decoder-use-tls=true [e2e-llm-inference-service] - --prefiller-use-tls=true [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - containerPort: 8000 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: INFERENCE_POOL_NAMESPACE [e2e-llm-inference-service] valueFrom: [e2e-llm-inference-service] fieldRef: [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] fieldPath: metadata.namespace [e2e-llm-inference-service] - name: SSL_CERT_DIR [e2e-llm-inference-service] value: /var/run/kserve/tls:/var/run/secrets/kubernetes.io/serviceaccount:/etc/pki/tls/certs [e2e-llm-inference-service] - name: INFERENCE_POOL_NAME [e2e-llm-inference-service] value: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] resources: {} [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] - name: kube-api-access-94vcr [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/secrets/kubernetes.io/serviceaccount [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] initialDelaySeconds: 10 [e2e-llm-inference-service] timeoutSeconds: 10 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 3 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] initialDelaySeconds: 10 [e2e-llm-inference-service] timeoutSeconds: 5 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 10 [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: FallbackToLogsOnError [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsUser: 1000690000 [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-inference-sim:v0.8.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/llm-d-inference-sim [e2e-llm-inference-service] args: [e2e-llm-inference-service] - --port [e2e-llm-inference-service] - '8001' [e2e-llm-inference-service] - --model [e2e-llm-inference-service] - facebook/opt-125m [e2e-llm-inference-service] - --mode [e2e-llm-inference-service] - random [e2e-llm-inference-service] - --ssl-certfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.crt [e2e-llm-inference-service] - --ssl-keyfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.key [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - containerPort: 8001 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: HOME [e2e-llm-inference-service] value: /home [e2e-llm-inference-service] - name: VLLM_LOGGING_LEVEL [e2e-llm-inference-service] value: INFO [e2e-llm-inference-service] - name: HF_HUB_CACHE [e2e-llm-inference-service] value: /models [e2e-llm-inference-service] resources: [e2e-llm-inference-service] limits: [e2e-llm-inference-service] cpu: '1' [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] mountPath: /home [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] mountPath: /tmp [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] mountPath: /dev/shm [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] mountPath: /models [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] - name: kube-api-access-94vcr [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/secrets/kubernetes.io/serviceaccount [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8001 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 10 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8001 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 1 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 2 [e2e-llm-inference-service] startupProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8001 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 60 [e2e-llm-inference-service] lifecycle: [e2e-llm-inference-service] preStop: [e2e-llm-inference-service] exec: [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /bin/sleep [e2e-llm-inference-service] - '15' [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: FallbackToLogsOnError [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsUser: 1000690000 [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] terminationGracePeriodSeconds: 60 [e2e-llm-inference-service] dnsPolicy: ClusterFirst [e2e-llm-inference-service] serviceAccountName: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] serviceAccount: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] nodeName: ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] seLinuxOptions: [e2e-llm-inference-service] level: s0:c26,c20 [e2e-llm-inference-service] fsGroup: 1000690000 [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] imagePullSecrets: [e2e-llm-inference-service] - name: default-dockercfg-8qxdr [e2e-llm-inference-service] - name: scheduler-v06-pd-migration-test-kserve-dockercfg-6cjq8 [e2e-llm-inference-service] schedulerName: default-scheduler [e2e-llm-inference-service] tolerations: [e2e-llm-inference-service] - key: node.kubernetes.io/not-ready [e2e-llm-inference-service] operator: Exists [e2e-llm-inference-service] effect: NoExecute [e2e-llm-inference-service] tolerationSeconds: 300 [e2e-llm-inference-service] - key: node.kubernetes.io/unreachable [e2e-llm-inference-service] operator: Exists [e2e-llm-inference-service] effect: NoExecute [e2e-llm-inference-service] tolerationSeconds: 300 [e2e-llm-inference-service] - key: node.kubernetes.io/memory-pressure [e2e-llm-inference-service] operator: Exists [e2e-llm-inference-service] effect: NoSchedule [e2e-llm-inference-service] priority: 0 [e2e-llm-inference-service] enableServiceLinks: true [e2e-llm-inference-service] preemptionPolicy: PreemptLowerPriority [e2e-llm-inference-service] status: [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] phase: Running [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] - type: PodReadyToStartContainers [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:21Z' [e2e-llm-inference-service] - type: Initialized [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:21Z' [e2e-llm-inference-service] - type: Ready [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:31Z' [e2e-llm-inference-service] - type: ContainersReady [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:31Z' [e2e-llm-inference-service] - type: PodScheduled [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] hostIP: 10.0.130.182 [e2e-llm-inference-service] hostIPs: [e2e-llm-inference-service] - ip: 10.0.130.182 [e2e-llm-inference-service] podIP: 10.132.0.68 [e2e-llm-inference-service] podIPs: [e2e-llm-inference-service] - ip: 10.132.0.68 [e2e-llm-inference-service] startTime: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] initContainerStatuses: [e2e-llm-inference-service] - name: llm-d-routing-sidecar [e2e-llm-inference-service] state: [e2e-llm-inference-service] running: [e2e-llm-inference-service] startedAt: '2026-07-08T17:35:21Z' [e2e-llm-inference-service] lastState: {} [e2e-llm-inference-service] ready: true [e2e-llm-inference-service] restartCount: 0 [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2 [e2e-llm-inference-service] imageID: ghcr.io/llm-d/llm-d-router-disagg-sidecar@sha256:1ec2c035216ea0a4f8a6f7ccda55398fc3d9f71f487c135f49ba0dea08163f12 [e2e-llm-inference-service] containerID: cri-o://0fbe4c84ce0edbef0e28e54622da9d6064fe832628cbba687d67edf284c332d9 [e2e-llm-inference-service] started: true [e2e-llm-inference-service] resources: {} [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] recursiveReadOnly: Disabled [e2e-llm-inference-service] - name: kube-api-access-94vcr [e2e-llm-inference-service] mountPath: /var/run/secrets/kubernetes.io/serviceaccount [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] recursiveReadOnly: Disabled [e2e-llm-inference-service] user: [e2e-llm-inference-service] linux: [e2e-llm-inference-service] uid: 1000690000 [e2e-llm-inference-service] gid: 0 [e2e-llm-inference-service] supplementalGroups: [e2e-llm-inference-service] - 0 [e2e-llm-inference-service] - 1000690000 [e2e-llm-inference-service] containerStatuses: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] state: [e2e-llm-inference-service] running: [e2e-llm-inference-service] startedAt: '2026-07-08T17:35:21Z' [e2e-llm-inference-service] lastState: {} [e2e-llm-inference-service] ready: true [e2e-llm-inference-service] restartCount: 0 [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-inference-sim:v0.8.2 [e2e-llm-inference-service] imageID: ghcr.io/llm-d/llm-d-inference-sim@sha256:bab162bd25e2ed8b15022387cdb223023aeb33be49476af9f0115c0398fb8ff5 [e2e-llm-inference-service] containerID: cri-o://ddaa99df2425a55be997512cfa9222e89e06842056b322465cbd0d4a8280c4c9 [e2e-llm-inference-service] started: true [e2e-llm-inference-service] allocatedResources: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] resources: [e2e-llm-inference-service] limits: [e2e-llm-inference-service] cpu: '1' [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] mountPath: /home [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] mountPath: /tmp [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] mountPath: /dev/shm [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] mountPath: /models [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] recursiveReadOnly: Disabled [e2e-llm-inference-service] - name: kube-api-access-94vcr [e2e-llm-inference-service] mountPath: /var/run/secrets/kubernetes.io/serviceaccount [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] recursiveReadOnly: Disabled [e2e-llm-inference-service] user: [e2e-llm-inference-service] linux: [e2e-llm-inference-service] uid: 1000690000 [e2e-llm-inference-service] gid: 0 [e2e-llm-inference-service] supplementalGroups: [e2e-llm-inference-service] - 0 [e2e-llm-inference-service] - 1000690000 [e2e-llm-inference-service] qosClass: Burstable [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] kind: Pod [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46 [e2e-llm-inference-service] generateName: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847- [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 6964cc10-b630-4b37-9005-73e5a9a47a08 [e2e-llm-inference-service] resourceVersion: '64470' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload-prefill [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: prefill [e2e-llm-inference-service] pod-template-hash: 78b7f4c847 [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] k8s.ovn.org/pod-networks: '{"default":{"ip_addresses":["10.134.0.33/23"],"mac_address":"0a:58:0a:86:00:21","gateway_ips":["10.134.0.1"],"routes":[{"dest":"10.132.0.0/14","nextHop":"10.134.0.1"},{"dest":"172.31.0.0/16","nextHop":"10.134.0.1"},{"dest":"169.254.0.5/32","nextHop":"10.134.0.1"},{"dest":"100.64.0.0/16","nextHop":"10.134.0.1"}],"ip_address":"10.134.0.33/23","gateway_ip":"10.134.0.1","role":"primary"}}' [e2e-llm-inference-service] k8s.v1.cni.cncf.io/network-status: "[{\n \"name\": \"ovn-kubernetes\",\n \ [e2e-llm-inference-service] \ \"interface\": \"eth0\",\n \"ips\": [\n \"10.134.0.33\"\n ],\n\ [e2e-llm-inference-service] \ \"mac\": \"0a:58:0a:86:00:21\",\n \"default\": true,\n \"dns\": {}\n\ [e2e-llm-inference-service] }]" [e2e-llm-inference-service] openshift.io/scc: restricted-v2 [e2e-llm-inference-service] seccomp.security.alpha.kubernetes.io/pod: runtime/default [e2e-llm-inference-service] security.openshift.io/validated-scc-subject-type: user [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: apps/v1 [e2e-llm-inference-service] kind: ReplicaSet [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847 [e2e-llm-inference-service] uid: 95aab951-0729-4253-8d67-3a3f6c3d079e [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: ip-10-0-142-172 [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] f:k8s.ovn.org/pod-networks: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:generateName: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:pod-template-hash: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"95aab951-0729-4253-8d67-3a3f6c3d079e"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:containers: [e2e-llm-inference-service] k:{"name":"main"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:args: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"HF_HUB_CACHE"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"HOME"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"VLLM_LOGGING_LEVEL"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:lifecycle: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:preStop: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":8000,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:limits: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:requests: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:seccompProfile: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:startupProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/dev/shm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/models"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/tmp"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:dnsPolicy: {} [e2e-llm-inference-service] f:enableServiceLinks: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:schedulerName: {} [e2e-llm-inference-service] f:securityContext: {} [e2e-llm-inference-service] f:terminationGracePeriodSeconds: {} [e2e-llm-inference-service] f:volumes: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"dshm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:medium: {} [e2e-llm-inference-service] f:sizeLimit: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"model-cache"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tls-certs"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:secret: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:defaultMode: {} [e2e-llm-inference-service] f:secretName: {} [e2e-llm-inference-service] k:{"name":"tmp-dir"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] - manager: multus-daemon [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] f:k8s.v1.cni.cncf.io/network-status: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] - manager: kubelet [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:30Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:conditions: [e2e-llm-inference-service] k:{"type":"ContainersReady"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"Initialized"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"PodReadyToStartContainers"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"PodScheduled"}: [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] k:{"type":"Ready"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:containerStatuses: {} [e2e-llm-inference-service] f:hostIP: {} [e2e-llm-inference-service] f:hostIPs: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:phase: {} [e2e-llm-inference-service] f:podIP: {} [e2e-llm-inference-service] f:podIPs: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"ip":"10.134.0.33"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:ip: {} [e2e-llm-inference-service] f:startTime: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] spec: [e2e-llm-inference-service] volumes: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] emptyDir: [e2e-llm-inference-service] medium: Memory [e2e-llm-inference-service] sizeLimit: 1Gi [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] secret: [e2e-llm-inference-service] secretName: scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] - name: kube-api-access-m64lb [e2e-llm-inference-service] projected: [e2e-llm-inference-service] sources: [e2e-llm-inference-service] - serviceAccountToken: [e2e-llm-inference-service] expirationSeconds: 3607 [e2e-llm-inference-service] path: token [e2e-llm-inference-service] - configMap: [e2e-llm-inference-service] name: kube-root-ca.crt [e2e-llm-inference-service] items: [e2e-llm-inference-service] - key: ca.crt [e2e-llm-inference-service] path: ca.crt [e2e-llm-inference-service] - downwardAPI: [e2e-llm-inference-service] items: [e2e-llm-inference-service] - path: namespace [e2e-llm-inference-service] fieldRef: [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] fieldPath: metadata.namespace [e2e-llm-inference-service] - configMap: [e2e-llm-inference-service] name: openshift-service-ca.crt [e2e-llm-inference-service] items: [e2e-llm-inference-service] - key: service-ca.crt [e2e-llm-inference-service] path: service-ca.crt [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-inference-sim:v0.8.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/llm-d-inference-sim [e2e-llm-inference-service] args: [e2e-llm-inference-service] - --port [e2e-llm-inference-service] - '8000' [e2e-llm-inference-service] - --model [e2e-llm-inference-service] - facebook/opt-125m [e2e-llm-inference-service] - --mode [e2e-llm-inference-service] - random [e2e-llm-inference-service] - --ssl-certfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.crt [e2e-llm-inference-service] - --ssl-keyfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.key [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - containerPort: 8000 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: HOME [e2e-llm-inference-service] value: /home [e2e-llm-inference-service] - name: VLLM_LOGGING_LEVEL [e2e-llm-inference-service] value: INFO [e2e-llm-inference-service] - name: HF_HUB_CACHE [e2e-llm-inference-service] value: /models [e2e-llm-inference-service] resources: [e2e-llm-inference-service] limits: [e2e-llm-inference-service] cpu: '1' [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] mountPath: /home [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] mountPath: /tmp [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] mountPath: /dev/shm [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] mountPath: /models [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] - name: kube-api-access-m64lb [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/secrets/kubernetes.io/serviceaccount [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 10 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 1 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 2 [e2e-llm-inference-service] startupProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 60 [e2e-llm-inference-service] lifecycle: [e2e-llm-inference-service] preStop: [e2e-llm-inference-service] exec: [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /bin/sleep [e2e-llm-inference-service] - '15' [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: File [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsUser: 1000690000 [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] terminationGracePeriodSeconds: 60 [e2e-llm-inference-service] dnsPolicy: ClusterFirst [e2e-llm-inference-service] serviceAccountName: default [e2e-llm-inference-service] serviceAccount: default [e2e-llm-inference-service] nodeName: ip-10-0-142-172.ec2.internal [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] seLinuxOptions: [e2e-llm-inference-service] level: s0:c26,c20 [e2e-llm-inference-service] fsGroup: 1000690000 [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] imagePullSecrets: [e2e-llm-inference-service] - name: default-dockercfg-8qxdr [e2e-llm-inference-service] schedulerName: default-scheduler [e2e-llm-inference-service] tolerations: [e2e-llm-inference-service] - key: node.kubernetes.io/not-ready [e2e-llm-inference-service] operator: Exists [e2e-llm-inference-service] effect: NoExecute [e2e-llm-inference-service] tolerationSeconds: 300 [e2e-llm-inference-service] - key: node.kubernetes.io/unreachable [e2e-llm-inference-service] operator: Exists [e2e-llm-inference-service] effect: NoExecute [e2e-llm-inference-service] tolerationSeconds: 300 [e2e-llm-inference-service] - key: node.kubernetes.io/memory-pressure [e2e-llm-inference-service] operator: Exists [e2e-llm-inference-service] effect: NoSchedule [e2e-llm-inference-service] priority: 0 [e2e-llm-inference-service] enableServiceLinks: true [e2e-llm-inference-service] preemptionPolicy: PreemptLowerPriority [e2e-llm-inference-service] status: [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] phase: Running [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] - type: PodReadyToStartContainers [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:21Z' [e2e-llm-inference-service] - type: Initialized [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] - type: Ready [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:30Z' [e2e-llm-inference-service] - type: ContainersReady [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:30Z' [e2e-llm-inference-service] - type: PodScheduled [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] hostIP: 10.0.142.172 [e2e-llm-inference-service] hostIPs: [e2e-llm-inference-service] - ip: 10.0.142.172 [e2e-llm-inference-service] podIP: 10.134.0.33 [e2e-llm-inference-service] podIPs: [e2e-llm-inference-service] - ip: 10.134.0.33 [e2e-llm-inference-service] startTime: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] containerStatuses: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] state: [e2e-llm-inference-service] running: [e2e-llm-inference-service] startedAt: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] lastState: {} [e2e-llm-inference-service] ready: true [e2e-llm-inference-service] restartCount: 0 [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-inference-sim:v0.8.2 [e2e-llm-inference-service] imageID: ghcr.io/llm-d/llm-d-inference-sim@sha256:bab162bd25e2ed8b15022387cdb223023aeb33be49476af9f0115c0398fb8ff5 [e2e-llm-inference-service] containerID: cri-o://f893dce706c0cde7242fd34e768f4829f6706a2f7d49bf7d717a7b245a8154e8 [e2e-llm-inference-service] started: true [e2e-llm-inference-service] allocatedResources: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] resources: [e2e-llm-inference-service] limits: [e2e-llm-inference-service] cpu: '1' [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] mountPath: /home [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] mountPath: /tmp [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] mountPath: /dev/shm [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] mountPath: /models [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] recursiveReadOnly: Disabled [e2e-llm-inference-service] - name: kube-api-access-m64lb [e2e-llm-inference-service] mountPath: /var/run/secrets/kubernetes.io/serviceaccount [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] recursiveReadOnly: Disabled [e2e-llm-inference-service] user: [e2e-llm-inference-service] linux: [e2e-llm-inference-service] uid: 1000690000 [e2e-llm-inference-service] gid: 0 [e2e-llm-inference-service] supplementalGroups: [e2e-llm-inference-service] - 0 [e2e-llm-inference-service] - 1000690000 [e2e-llm-inference-service] qosClass: Burstable [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] kind: Pod [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-router-scheduler-595ls74 [e2e-llm-inference-service] generateName: scheduler-v06-pd-migration-test-kserve-router-scheduler-59dc679cd- [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: c6e3eb6e-ca4d-41fd-a402-927efffc9858 [e2e-llm-inference-service] resourceVersion: '64761' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] pod-template-hash: 59dc679cd [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] app.kubernetes.io/version: 0.9.0 [e2e-llm-inference-service] certificates.kserve.io/expiration-v2: 'true' [e2e-llm-inference-service] k8s.ovn.org/pod-networks: '{"default":{"ip_addresses":["10.133.0.84/23"],"mac_address":"0a:58:0a:85:00:54","gateway_ips":["10.133.0.1"],"routes":[{"dest":"10.132.0.0/14","nextHop":"10.133.0.1"},{"dest":"172.31.0.0/16","nextHop":"10.133.0.1"},{"dest":"169.254.0.5/32","nextHop":"10.133.0.1"},{"dest":"100.64.0.0/16","nextHop":"10.133.0.1"}],"ip_address":"10.133.0.84/23","gateway_ip":"10.133.0.1","role":"primary"}}' [e2e-llm-inference-service] k8s.v1.cni.cncf.io/network-status: "[{\n \"name\": \"ovn-kubernetes\",\n \ [e2e-llm-inference-service] \ \"interface\": \"eth0\",\n \"ips\": [\n \"10.133.0.84\"\n ],\n\ [e2e-llm-inference-service] \ \"mac\": \"0a:58:0a:85:00:54\",\n \"default\": true,\n \"dns\": {}\n\ [e2e-llm-inference-service] }]" [e2e-llm-inference-service] openshift.io/scc: restricted-v2 [e2e-llm-inference-service] seccomp.security.alpha.kubernetes.io/pod: runtime/default [e2e-llm-inference-service] security.openshift.io/validated-scc-subject-type: user [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: apps/v1 [e2e-llm-inference-service] kind: ReplicaSet [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-router-scheduler-59dc679cd [e2e-llm-inference-service] uid: 1d63b5a2-e983-4b49-b99e-0112c3012fc6 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: ip-10-0-128-142 [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] f:k8s.ovn.org/pod-networks: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/version: {} [e2e-llm-inference-service] f:certificates.kserve.io/expiration-v2: {} [e2e-llm-inference-service] f:generateName: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:pod-template-hash: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"1d63b5a2-e983-4b49-b99e-0112c3012fc6"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:containers: [e2e-llm-inference-service] k:{"name":"main"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:args: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"SSL_CERT_DIR"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:lifecycle: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:preStop: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:grpc: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:service: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":5557,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] k:{"containerPort":9002,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] k:{"containerPort":9003,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] k:{"containerPort":9090,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:grpc: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:service: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:requests: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:seccompProfile: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/tmp/tokenizer"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:dnsPolicy: {} [e2e-llm-inference-service] f:enableServiceLinks: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:schedulerName: {} [e2e-llm-inference-service] f:securityContext: {} [e2e-llm-inference-service] f:serviceAccount: {} [e2e-llm-inference-service] f:serviceAccountName: {} [e2e-llm-inference-service] f:terminationGracePeriodSeconds: {} [e2e-llm-inference-service] f:volumes: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"tls-certs"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:secret: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:defaultMode: {} [e2e-llm-inference-service] f:secretName: {} [e2e-llm-inference-service] k:{"name":"tokenizer-cache"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tokenizer-tmp"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tokenizer-uds"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] - manager: multus-daemon [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] f:k8s.v1.cni.cncf.io/network-status: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] - manager: kubelet [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:52Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:conditions: [e2e-llm-inference-service] k:{"type":"ContainersReady"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"Initialized"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"PodReadyToStartContainers"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"PodScheduled"}: [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] k:{"type":"Ready"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastProbeTime: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:containerStatuses: {} [e2e-llm-inference-service] f:hostIP: {} [e2e-llm-inference-service] f:hostIPs: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:phase: {} [e2e-llm-inference-service] f:podIP: {} [e2e-llm-inference-service] f:podIPs: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"ip":"10.133.0.84"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:ip: {} [e2e-llm-inference-service] f:startTime: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] spec: [e2e-llm-inference-service] volumes: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] secret: [e2e-llm-inference-service] secretName: scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] - name: tokenizer-uds [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tokenizer-tmp [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tokenizer-cache [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: kube-api-access-vr7wx [e2e-llm-inference-service] projected: [e2e-llm-inference-service] sources: [e2e-llm-inference-service] - serviceAccountToken: [e2e-llm-inference-service] expirationSeconds: 3607 [e2e-llm-inference-service] path: token [e2e-llm-inference-service] - configMap: [e2e-llm-inference-service] name: kube-root-ca.crt [e2e-llm-inference-service] items: [e2e-llm-inference-service] - key: ca.crt [e2e-llm-inference-service] path: ca.crt [e2e-llm-inference-service] - downwardAPI: [e2e-llm-inference-service] items: [e2e-llm-inference-service] - path: namespace [e2e-llm-inference-service] fieldRef: [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] fieldPath: metadata.namespace [e2e-llm-inference-service] - configMap: [e2e-llm-inference-service] name: openshift-service-ca.crt [e2e-llm-inference-service] items: [e2e-llm-inference-service] - key: service-ca.crt [e2e-llm-inference-service] path: service-ca.crt [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/epp [e2e-llm-inference-service] - --pool-name [e2e-llm-inference-service] - scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] - --pool-namespace [e2e-llm-inference-service] - kserve-ci-e2e-test [e2e-llm-inference-service] - --zap-encoder [e2e-llm-inference-service] - json [e2e-llm-inference-service] - --grpc-port [e2e-llm-inference-service] - '9002' [e2e-llm-inference-service] - --grpc-health-port [e2e-llm-inference-service] - '9003' [e2e-llm-inference-service] - --enable-cert-reload=true [e2e-llm-inference-service] - --secure-serving=true [e2e-llm-inference-service] - --model-server-metrics-scheme=https [e2e-llm-inference-service] - --cert-path=/var/run/kserve/tls [e2e-llm-inference-service] args: [e2e-llm-inference-service] - --config-text [e2e-llm-inference-service] - "apiVersion: inference.networking.x-k8s.io/v1alpha1\nkind: EndpointPickerConfig\n\ [e2e-llm-inference-service] plugins:\n- type: disagg-headers-handler\n- type: prefill-filter\n- type: decode-filter\n\ [e2e-llm-inference-service] - type: always-disagg-pd-decider\n- parameters:\n deciders:\n prefill:\ [e2e-llm-inference-service] \ always-disagg-pd-decider\n type: disagg-profile-handler\n- type: prefix-cache-scorer\n\ [e2e-llm-inference-service] - type: queue-scorer\n- type: max-score-picker\nschedulingProfiles:\n- name:\ [e2e-llm-inference-service] \ prefill\n plugins:\n - pluginRef: prefill-filter\n - pluginRef: queue-scorer\n\ [e2e-llm-inference-service] \ weight: 2\n - pluginRef: prefix-cache-scorer\n weight: 3\n - pluginRef:\ [e2e-llm-inference-service] \ max-score-picker\n- name: decode\n plugins:\n - pluginRef: decode-filter\n\ [e2e-llm-inference-service] \ - pluginRef: queue-scorer\n weight: 2\n - pluginRef: prefix-cache-scorer\n\ [e2e-llm-inference-service] \ weight: 3\n - pluginRef: max-score-picker\n" [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - name: grpc [e2e-llm-inference-service] containerPort: 9002 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: grpc-health [e2e-llm-inference-service] containerPort: 9003 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: metrics [e2e-llm-inference-service] containerPort: 9090 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: zmq [e2e-llm-inference-service] containerPort: 5557 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: SSL_CERT_DIR [e2e-llm-inference-service] value: /var/run/kserve/tls:/var/run/secrets/kubernetes.io/serviceaccount:/etc/pki/tls/certs [e2e-llm-inference-service] resources: [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 256m [e2e-llm-inference-service] memory: 500Mi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] - name: tokenizer-uds [e2e-llm-inference-service] mountPath: /tmp/tokenizer [e2e-llm-inference-service] - name: kube-api-access-vr7wx [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/secrets/kubernetes.io/serviceaccount [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] grpc: [e2e-llm-inference-service] port: 9003 [e2e-llm-inference-service] service: liveness [e2e-llm-inference-service] initialDelaySeconds: 5 [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 3 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] grpc: [e2e-llm-inference-service] port: 9003 [e2e-llm-inference-service] service: readiness [e2e-llm-inference-service] initialDelaySeconds: 30 [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 3 [e2e-llm-inference-service] lifecycle: [e2e-llm-inference-service] preStop: [e2e-llm-inference-service] exec: [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /bin/sleep [e2e-llm-inference-service] - '15' [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: FallbackToLogsOnError [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsUser: 1000690000 [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] terminationGracePeriodSeconds: 60 [e2e-llm-inference-service] dnsPolicy: ClusterFirst [e2e-llm-inference-service] serviceAccountName: scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] serviceAccount: scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] nodeName: ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] seLinuxOptions: [e2e-llm-inference-service] level: s0:c26,c20 [e2e-llm-inference-service] fsGroup: 1000690000 [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] imagePullSecrets: [e2e-llm-inference-service] - name: default-dockercfg-8qxdr [e2e-llm-inference-service] - name: scheduler-v06-pd-migration-test-epp-sa-dockercfg-zdc7b [e2e-llm-inference-service] schedulerName: default-scheduler [e2e-llm-inference-service] tolerations: [e2e-llm-inference-service] - key: node.kubernetes.io/not-ready [e2e-llm-inference-service] operator: Exists [e2e-llm-inference-service] effect: NoExecute [e2e-llm-inference-service] tolerationSeconds: 300 [e2e-llm-inference-service] - key: node.kubernetes.io/unreachable [e2e-llm-inference-service] operator: Exists [e2e-llm-inference-service] effect: NoExecute [e2e-llm-inference-service] tolerationSeconds: 300 [e2e-llm-inference-service] - key: node.kubernetes.io/memory-pressure [e2e-llm-inference-service] operator: Exists [e2e-llm-inference-service] effect: NoSchedule [e2e-llm-inference-service] priority: 0 [e2e-llm-inference-service] enableServiceLinks: true [e2e-llm-inference-service] preemptionPolicy: PreemptLowerPriority [e2e-llm-inference-service] status: [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] phase: Running [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] - type: PodReadyToStartContainers [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:21Z' [e2e-llm-inference-service] - type: Initialized [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] - type: Ready [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:52Z' [e2e-llm-inference-service] - type: ContainersReady [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:52Z' [e2e-llm-inference-service] - type: PodScheduled [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastProbeTime: null [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] hostIP: 10.0.128.142 [e2e-llm-inference-service] hostIPs: [e2e-llm-inference-service] - ip: 10.0.128.142 [e2e-llm-inference-service] podIP: 10.133.0.84 [e2e-llm-inference-service] podIPs: [e2e-llm-inference-service] - ip: 10.133.0.84 [e2e-llm-inference-service] startTime: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] containerStatuses: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] state: [e2e-llm-inference-service] running: [e2e-llm-inference-service] startedAt: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] lastState: {} [e2e-llm-inference-service] ready: true [e2e-llm-inference-service] restartCount: 0 [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2 [e2e-llm-inference-service] imageID: ghcr.io/llm-d/llm-d-router-endpoint-picker@sha256:06b6c75d77afd0e07053402752a9736c2dfbc12a306d0d37d963aac4c1d4e6a6 [e2e-llm-inference-service] containerID: cri-o://f8de174ffa63fef37d2487b3f3e38fb5583e68af440801beefea57bfc6f699bb [e2e-llm-inference-service] started: true [e2e-llm-inference-service] allocatedResources: [e2e-llm-inference-service] cpu: 256m [e2e-llm-inference-service] memory: 500Mi [e2e-llm-inference-service] resources: [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 256m [e2e-llm-inference-service] memory: 500Mi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] recursiveReadOnly: Disabled [e2e-llm-inference-service] - name: tokenizer-uds [e2e-llm-inference-service] mountPath: /tmp/tokenizer [e2e-llm-inference-service] - name: kube-api-access-vr7wx [e2e-llm-inference-service] mountPath: /var/run/secrets/kubernetes.io/serviceaccount [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] recursiveReadOnly: Disabled [e2e-llm-inference-service] user: [e2e-llm-inference-service] linux: [e2e-llm-inference-service] uid: 1000690000 [e2e-llm-inference-service] gid: 0 [e2e-llm-inference-service] supplementalGroups: [e2e-llm-inference-service] - 0 [e2e-llm-inference-service] - 1000690000 [e2e-llm-inference-service] qosClass: Burstable [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] kind: Pod [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 956af896-f2e8-4ba3-8e78-d047efed9de0 [e2e-llm-inference-service] resourceVersion: '64032' [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] openshift.io/internal-registry-pull-secret-ref: scheduler-v06-pd-migration-test-epp-sa-dockercfg-zdc7b [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: openshift.io/image-registry-pull-secrets_service-account-controller [e2e-llm-inference-service] operation: Apply [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:imagePullSecrets: {} [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] f:openshift.io/internal-registry-pull-secret-ref: {} [e2e-llm-inference-service] f:secrets: [e2e-llm-inference-service] k:{"name":"scheduler-v06-pd-migration-test-epp-sa-dockercfg-zdc7b"}: {} [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:secrets: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"default-dockercfg-8qxdr"}: {} [e2e-llm-inference-service] k:{"name":"seaweedfs-s3-creds"}: {} [e2e-llm-inference-service] secrets: [e2e-llm-inference-service] - name: default-dockercfg-8qxdr [e2e-llm-inference-service] - name: seaweedfs-s3-creds [e2e-llm-inference-service] - name: scheduler-v06-pd-migration-test-epp-sa-dockercfg-zdc7b [e2e-llm-inference-service] imagePullSecrets: [e2e-llm-inference-service] - name: default-dockercfg-8qxdr [e2e-llm-inference-service] - name: scheduler-v06-pd-migration-test-epp-sa-dockercfg-zdc7b [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] kind: ServiceAccount [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 02e974e2-bd8f-4056-9e69-42ad1d47b2b5 [e2e-llm-inference-service] resourceVersion: '63989' [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] openshift.io/internal-registry-pull-secret-ref: scheduler-v06-pd-migration-test-kserve-dockercfg-6cjq8 [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: openshift.io/image-registry-pull-secrets_service-account-controller [e2e-llm-inference-service] operation: Apply [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:imagePullSecrets: {} [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] f:openshift.io/internal-registry-pull-secret-ref: {} [e2e-llm-inference-service] f:secrets: [e2e-llm-inference-service] k:{"name":"scheduler-v06-pd-migration-test-kserve-dockercfg-6cjq8"}: {} [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:secrets: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"default-dockercfg-8qxdr"}: {} [e2e-llm-inference-service] k:{"name":"seaweedfs-s3-creds"}: {} [e2e-llm-inference-service] secrets: [e2e-llm-inference-service] - name: default-dockercfg-8qxdr [e2e-llm-inference-service] - name: seaweedfs-s3-creds [e2e-llm-inference-service] - name: scheduler-v06-pd-migration-test-kserve-dockercfg-6cjq8 [e2e-llm-inference-service] imagePullSecrets: [e2e-llm-inference-service] - name: default-dockercfg-8qxdr [e2e-llm-inference-service] - name: scheduler-v06-pd-migration-test-kserve-dockercfg-6cjq8 [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] kind: ServiceAccount [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-service [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 855be77e-20b0-4dbd-81af-9c2611d8fdb1 [e2e-llm-inference-service] resourceVersion: '64052' [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:internalTrafficPolicy: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"port":5557,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:targetPort: {} [e2e-llm-inference-service] k:{"port":9002,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:targetPort: {} [e2e-llm-inference-service] k:{"port":9003,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:targetPort: {} [e2e-llm-inference-service] k:{"port":9090,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:targetPort: {} [e2e-llm-inference-service] f:selector: {} [e2e-llm-inference-service] f:sessionAffinity: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] spec: [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - name: grpc [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] port: 9002 [e2e-llm-inference-service] targetPort: grpc [e2e-llm-inference-service] - name: grpc-health [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] port: 9003 [e2e-llm-inference-service] targetPort: grpc-health [e2e-llm-inference-service] - name: metrics [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] port: 9090 [e2e-llm-inference-service] targetPort: metrics [e2e-llm-inference-service] - name: zmq [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] port: 5557 [e2e-llm-inference-service] targetPort: zmq [e2e-llm-inference-service] selector: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] clusterIP: 172.31.57.74 [e2e-llm-inference-service] clusterIPs: [e2e-llm-inference-service] - 172.31.57.74 [e2e-llm-inference-service] type: ClusterIP [e2e-llm-inference-service] sessionAffinity: None [e2e-llm-inference-service] ipFamilies: [e2e-llm-inference-service] - IPv4 [e2e-llm-inference-service] ipFamilyPolicy: SingleStack [e2e-llm-inference-service] internalTrafficPolicy: Cluster [e2e-llm-inference-service] status: [e2e-llm-inference-service] loadBalancer: {} [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: e63d0c38-0b5f-4d84-afd6-067ba906d418 [e2e-llm-inference-service] resourceVersion: '64018' [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:internalTrafficPolicy: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"port":8000,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:appProtocol: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:targetPort: {} [e2e-llm-inference-service] f:selector: {} [e2e-llm-inference-service] f:sessionAffinity: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] spec: [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - name: https [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] appProtocol: https [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] targetPort: 8000 [e2e-llm-inference-service] selector: [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] clusterIP: 172.31.47.146 [e2e-llm-inference-service] clusterIPs: [e2e-llm-inference-service] - 172.31.47.146 [e2e-llm-inference-service] type: ClusterIP [e2e-llm-inference-service] sessionAffinity: None [e2e-llm-inference-service] ipFamilies: [e2e-llm-inference-service] - IPv4 [e2e-llm-inference-service] ipFamilyPolicy: SingleStack [e2e-llm-inference-service] internalTrafficPolicy: Cluster [e2e-llm-inference-service] status: [e2e-llm-inference-service] loadBalancer: {} [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 1aed87da-69a2-4ebd-9328-c17b23bab1eb [e2e-llm-inference-service] resourceVersion: '64494' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: decode [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] deployment.kubernetes.io/revision: '1' [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:progressDeadlineSeconds: {} [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] f:revisionHistoryLimit: {} [e2e-llm-inference-service] f:selector: {} [e2e-llm-inference-service] f:strategy: [e2e-llm-inference-service] f:rollingUpdate: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:maxSurge: {} [e2e-llm-inference-service] f:maxUnavailable: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:template: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:containers: [e2e-llm-inference-service] k:{"name":"main"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:args: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"HF_HUB_CACHE"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"HOME"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"VLLM_LOGGING_LEVEL"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:lifecycle: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:preStop: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":8001,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:limits: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:requests: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:seccompProfile: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:startupProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/dev/shm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/models"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/tmp"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:dnsPolicy: {} [e2e-llm-inference-service] f:initContainers: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"llm-d-routing-sidecar"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"INFERENCE_POOL_NAME"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"INFERENCE_POOL_NAMESPACE"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:valueFrom: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:fieldRef: {} [e2e-llm-inference-service] k:{"name":"SSL_CERT_DIR"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":8000,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:schedulerName: {} [e2e-llm-inference-service] f:securityContext: {} [e2e-llm-inference-service] f:serviceAccount: {} [e2e-llm-inference-service] f:serviceAccountName: {} [e2e-llm-inference-service] f:terminationGracePeriodSeconds: {} [e2e-llm-inference-service] f:volumes: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"dshm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:medium: {} [e2e-llm-inference-service] f:sizeLimit: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"model-cache"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tls-certs"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:secret: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:defaultMode: {} [e2e-llm-inference-service] f:secretName: {} [e2e-llm-inference-service] k:{"name":"tmp-dir"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:31Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/revision: {} [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:availableReplicas: {} [e2e-llm-inference-service] f:conditions: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"type":"Available"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:lastUpdateTime: {} [e2e-llm-inference-service] f:message: {} [e2e-llm-inference-service] f:reason: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"Progressing"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:lastUpdateTime: {} [e2e-llm-inference-service] f:message: {} [e2e-llm-inference-service] f:reason: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:readyReplicas: {} [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] f:updatedReplicas: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] spec: [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] selector: [e2e-llm-inference-service] matchLabels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: decode [e2e-llm-inference-service] template: [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: decode [e2e-llm-inference-service] spec: [e2e-llm-inference-service] volumes: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] emptyDir: [e2e-llm-inference-service] medium: Memory [e2e-llm-inference-service] sizeLimit: 1Gi [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] secret: [e2e-llm-inference-service] secretName: scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] initContainers: [e2e-llm-inference-service] - name: llm-d-routing-sidecar [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/pd-sidecar [e2e-llm-inference-service] - --port=8000 [e2e-llm-inference-service] - --vllm-port=8001 [e2e-llm-inference-service] - --kv-connector=nixlv2 [e2e-llm-inference-service] - --enable-ssrf-protection=true [e2e-llm-inference-service] - --pool-group=inference.networking.x-k8s.io [e2e-llm-inference-service] - --inference-pool=kserve-ci-e2e-test/scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] - --secure-proxy=true [e2e-llm-inference-service] - --cert-path=/var/run/kserve/tls [e2e-llm-inference-service] - --decoder-use-tls=true [e2e-llm-inference-service] - --prefiller-use-tls=true [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - containerPort: 8000 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: INFERENCE_POOL_NAMESPACE [e2e-llm-inference-service] valueFrom: [e2e-llm-inference-service] fieldRef: [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] fieldPath: metadata.namespace [e2e-llm-inference-service] - name: SSL_CERT_DIR [e2e-llm-inference-service] value: /var/run/kserve/tls:/var/run/secrets/kubernetes.io/serviceaccount:/etc/pki/tls/certs [e2e-llm-inference-service] - name: INFERENCE_POOL_NAME [e2e-llm-inference-service] value: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] resources: {} [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] initialDelaySeconds: 10 [e2e-llm-inference-service] timeoutSeconds: 10 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 3 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] initialDelaySeconds: 10 [e2e-llm-inference-service] timeoutSeconds: 5 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 10 [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: FallbackToLogsOnError [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-inference-sim:v0.8.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/llm-d-inference-sim [e2e-llm-inference-service] args: [e2e-llm-inference-service] - --port [e2e-llm-inference-service] - '8001' [e2e-llm-inference-service] - --model [e2e-llm-inference-service] - facebook/opt-125m [e2e-llm-inference-service] - --mode [e2e-llm-inference-service] - random [e2e-llm-inference-service] - --ssl-certfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.crt [e2e-llm-inference-service] - --ssl-keyfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.key [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - containerPort: 8001 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: HOME [e2e-llm-inference-service] value: /home [e2e-llm-inference-service] - name: VLLM_LOGGING_LEVEL [e2e-llm-inference-service] value: INFO [e2e-llm-inference-service] - name: HF_HUB_CACHE [e2e-llm-inference-service] value: /models [e2e-llm-inference-service] resources: [e2e-llm-inference-service] limits: [e2e-llm-inference-service] cpu: '1' [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] mountPath: /home [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] mountPath: /tmp [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] mountPath: /dev/shm [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] mountPath: /models [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8001 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 10 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8001 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 1 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 2 [e2e-llm-inference-service] startupProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8001 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 60 [e2e-llm-inference-service] lifecycle: [e2e-llm-inference-service] preStop: [e2e-llm-inference-service] exec: [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /bin/sleep [e2e-llm-inference-service] - '15' [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: FallbackToLogsOnError [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] terminationGracePeriodSeconds: 60 [e2e-llm-inference-service] dnsPolicy: ClusterFirst [e2e-llm-inference-service] serviceAccountName: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] serviceAccount: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] securityContext: {} [e2e-llm-inference-service] schedulerName: default-scheduler [e2e-llm-inference-service] strategy: [e2e-llm-inference-service] type: RollingUpdate [e2e-llm-inference-service] rollingUpdate: [e2e-llm-inference-service] maxUnavailable: 25% [e2e-llm-inference-service] maxSurge: 25% [e2e-llm-inference-service] revisionHistoryLimit: 10 [e2e-llm-inference-service] progressDeadlineSeconds: 600 [e2e-llm-inference-service] status: [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] updatedReplicas: 1 [e2e-llm-inference-service] readyReplicas: 1 [e2e-llm-inference-service] availableReplicas: 1 [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] - type: Available [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastUpdateTime: '2026-07-08T17:35:31Z' [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:31Z' [e2e-llm-inference-service] reason: MinimumReplicasAvailable [e2e-llm-inference-service] message: Deployment has minimum availability. [e2e-llm-inference-service] - type: Progressing [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastUpdateTime: '2026-07-08T17:35:31Z' [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] reason: NewReplicaSetAvailable [e2e-llm-inference-service] message: ReplicaSet "scheduler-v06-pd-migration-test-kserve-5c87756974" has successfully [e2e-llm-inference-service] progressed. [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] kind: Deployment [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-prefill [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 738db50a-d55d-4d78-9dbf-ee805ccf5b04 [e2e-llm-inference-service] resourceVersion: '64474' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload-prefill [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: prefill [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] deployment.kubernetes.io/revision: '1' [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:progressDeadlineSeconds: {} [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] f:revisionHistoryLimit: {} [e2e-llm-inference-service] f:selector: {} [e2e-llm-inference-service] f:strategy: [e2e-llm-inference-service] f:rollingUpdate: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:maxSurge: {} [e2e-llm-inference-service] f:maxUnavailable: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:template: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:containers: [e2e-llm-inference-service] k:{"name":"main"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:args: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"HF_HUB_CACHE"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"HOME"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"VLLM_LOGGING_LEVEL"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:lifecycle: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:preStop: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":8000,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:limits: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:requests: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:seccompProfile: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:startupProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/dev/shm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/models"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/tmp"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:dnsPolicy: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:schedulerName: {} [e2e-llm-inference-service] f:securityContext: {} [e2e-llm-inference-service] f:terminationGracePeriodSeconds: {} [e2e-llm-inference-service] f:volumes: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"dshm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:medium: {} [e2e-llm-inference-service] f:sizeLimit: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"model-cache"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tls-certs"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:secret: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:defaultMode: {} [e2e-llm-inference-service] f:secretName: {} [e2e-llm-inference-service] k:{"name":"tmp-dir"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:30Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/revision: {} [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:availableReplicas: {} [e2e-llm-inference-service] f:conditions: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"type":"Available"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:lastUpdateTime: {} [e2e-llm-inference-service] f:message: {} [e2e-llm-inference-service] f:reason: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"Progressing"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:lastUpdateTime: {} [e2e-llm-inference-service] f:message: {} [e2e-llm-inference-service] f:reason: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:readyReplicas: {} [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] f:updatedReplicas: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] spec: [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] selector: [e2e-llm-inference-service] matchLabels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload-prefill [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: prefill [e2e-llm-inference-service] template: [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload-prefill [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: prefill [e2e-llm-inference-service] spec: [e2e-llm-inference-service] volumes: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] emptyDir: [e2e-llm-inference-service] medium: Memory [e2e-llm-inference-service] sizeLimit: 1Gi [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] secret: [e2e-llm-inference-service] secretName: scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-inference-sim:v0.8.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/llm-d-inference-sim [e2e-llm-inference-service] args: [e2e-llm-inference-service] - --port [e2e-llm-inference-service] - '8000' [e2e-llm-inference-service] - --model [e2e-llm-inference-service] - facebook/opt-125m [e2e-llm-inference-service] - --mode [e2e-llm-inference-service] - random [e2e-llm-inference-service] - --ssl-certfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.crt [e2e-llm-inference-service] - --ssl-keyfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.key [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - containerPort: 8000 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: HOME [e2e-llm-inference-service] value: /home [e2e-llm-inference-service] - name: VLLM_LOGGING_LEVEL [e2e-llm-inference-service] value: INFO [e2e-llm-inference-service] - name: HF_HUB_CACHE [e2e-llm-inference-service] value: /models [e2e-llm-inference-service] resources: [e2e-llm-inference-service] limits: [e2e-llm-inference-service] cpu: '1' [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] mountPath: /home [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] mountPath: /tmp [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] mountPath: /dev/shm [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] mountPath: /models [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 10 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 1 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 2 [e2e-llm-inference-service] startupProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 60 [e2e-llm-inference-service] lifecycle: [e2e-llm-inference-service] preStop: [e2e-llm-inference-service] exec: [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /bin/sleep [e2e-llm-inference-service] - '15' [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: File [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] terminationGracePeriodSeconds: 60 [e2e-llm-inference-service] dnsPolicy: ClusterFirst [e2e-llm-inference-service] securityContext: {} [e2e-llm-inference-service] schedulerName: default-scheduler [e2e-llm-inference-service] strategy: [e2e-llm-inference-service] type: RollingUpdate [e2e-llm-inference-service] rollingUpdate: [e2e-llm-inference-service] maxUnavailable: 25% [e2e-llm-inference-service] maxSurge: 25% [e2e-llm-inference-service] revisionHistoryLimit: 10 [e2e-llm-inference-service] progressDeadlineSeconds: 600 [e2e-llm-inference-service] status: [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] updatedReplicas: 1 [e2e-llm-inference-service] readyReplicas: 1 [e2e-llm-inference-service] availableReplicas: 1 [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] - type: Available [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastUpdateTime: '2026-07-08T17:35:30Z' [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:30Z' [e2e-llm-inference-service] reason: MinimumReplicasAvailable [e2e-llm-inference-service] message: Deployment has minimum availability. [e2e-llm-inference-service] - type: Progressing [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastUpdateTime: '2026-07-08T17:35:30Z' [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] reason: NewReplicaSetAvailable [e2e-llm-inference-service] message: ReplicaSet "scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847" [e2e-llm-inference-service] has successfully progressed. [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] kind: Deployment [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-router-scheduler [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: e9d01489-d175-4252-bdef-55ebfad7962b [e2e-llm-inference-service] resourceVersion: '64765' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] deployment.kubernetes.io/revision: '1' [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:progressDeadlineSeconds: {} [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] f:revisionHistoryLimit: {} [e2e-llm-inference-service] f:selector: {} [e2e-llm-inference-service] f:strategy: [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:template: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/version: {} [e2e-llm-inference-service] f:certificates.kserve.io/expiration-v2: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:containers: [e2e-llm-inference-service] k:{"name":"main"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:args: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"SSL_CERT_DIR"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:lifecycle: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:preStop: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:grpc: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:service: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":5557,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] k:{"containerPort":9002,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] k:{"containerPort":9003,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] k:{"containerPort":9090,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:grpc: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:service: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:requests: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:seccompProfile: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/tmp/tokenizer"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:dnsPolicy: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:schedulerName: {} [e2e-llm-inference-service] f:securityContext: {} [e2e-llm-inference-service] f:serviceAccount: {} [e2e-llm-inference-service] f:serviceAccountName: {} [e2e-llm-inference-service] f:terminationGracePeriodSeconds: {} [e2e-llm-inference-service] f:volumes: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"tls-certs"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:secret: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:defaultMode: {} [e2e-llm-inference-service] f:secretName: {} [e2e-llm-inference-service] k:{"name":"tokenizer-cache"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tokenizer-tmp"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tokenizer-uds"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:52Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/revision: {} [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:availableReplicas: {} [e2e-llm-inference-service] f:conditions: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"type":"Available"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:lastUpdateTime: {} [e2e-llm-inference-service] f:message: {} [e2e-llm-inference-service] f:reason: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"Progressing"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:lastUpdateTime: {} [e2e-llm-inference-service] f:message: {} [e2e-llm-inference-service] f:reason: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:readyReplicas: {} [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] f:updatedReplicas: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] spec: [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] selector: [e2e-llm-inference-service] matchLabels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] template: [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] app.kubernetes.io/version: 0.9.0 [e2e-llm-inference-service] certificates.kserve.io/expiration-v2: 'true' [e2e-llm-inference-service] spec: [e2e-llm-inference-service] volumes: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] secret: [e2e-llm-inference-service] secretName: scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] - name: tokenizer-uds [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tokenizer-tmp [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tokenizer-cache [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/epp [e2e-llm-inference-service] - --pool-name [e2e-llm-inference-service] - scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] - --pool-namespace [e2e-llm-inference-service] - kserve-ci-e2e-test [e2e-llm-inference-service] - --zap-encoder [e2e-llm-inference-service] - json [e2e-llm-inference-service] - --grpc-port [e2e-llm-inference-service] - '9002' [e2e-llm-inference-service] - --grpc-health-port [e2e-llm-inference-service] - '9003' [e2e-llm-inference-service] - --enable-cert-reload=true [e2e-llm-inference-service] - --secure-serving=true [e2e-llm-inference-service] - --model-server-metrics-scheme=https [e2e-llm-inference-service] - --cert-path=/var/run/kserve/tls [e2e-llm-inference-service] args: [e2e-llm-inference-service] - --config-text [e2e-llm-inference-service] - "apiVersion: inference.networking.x-k8s.io/v1alpha1\nkind: EndpointPickerConfig\n\ [e2e-llm-inference-service] plugins:\n- type: disagg-headers-handler\n- type: prefill-filter\n- type:\ [e2e-llm-inference-service] \ decode-filter\n- type: always-disagg-pd-decider\n- parameters:\n deciders:\n\ [e2e-llm-inference-service] \ prefill: always-disagg-pd-decider\n type: disagg-profile-handler\n\ [e2e-llm-inference-service] - type: prefix-cache-scorer\n- type: queue-scorer\n- type: max-score-picker\n\ [e2e-llm-inference-service] schedulingProfiles:\n- name: prefill\n plugins:\n - pluginRef: prefill-filter\n\ [e2e-llm-inference-service] \ - pluginRef: queue-scorer\n weight: 2\n - pluginRef: prefix-cache-scorer\n\ [e2e-llm-inference-service] \ weight: 3\n - pluginRef: max-score-picker\n- name: decode\n plugins:\n\ [e2e-llm-inference-service] \ - pluginRef: decode-filter\n - pluginRef: queue-scorer\n weight:\ [e2e-llm-inference-service] \ 2\n - pluginRef: prefix-cache-scorer\n weight: 3\n - pluginRef: max-score-picker\n" [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - name: grpc [e2e-llm-inference-service] containerPort: 9002 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: grpc-health [e2e-llm-inference-service] containerPort: 9003 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: metrics [e2e-llm-inference-service] containerPort: 9090 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: zmq [e2e-llm-inference-service] containerPort: 5557 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: SSL_CERT_DIR [e2e-llm-inference-service] value: /var/run/kserve/tls:/var/run/secrets/kubernetes.io/serviceaccount:/etc/pki/tls/certs [e2e-llm-inference-service] resources: [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 256m [e2e-llm-inference-service] memory: 500Mi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] - name: tokenizer-uds [e2e-llm-inference-service] mountPath: /tmp/tokenizer [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] grpc: [e2e-llm-inference-service] port: 9003 [e2e-llm-inference-service] service: liveness [e2e-llm-inference-service] initialDelaySeconds: 5 [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 3 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] grpc: [e2e-llm-inference-service] port: 9003 [e2e-llm-inference-service] service: readiness [e2e-llm-inference-service] initialDelaySeconds: 30 [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 3 [e2e-llm-inference-service] lifecycle: [e2e-llm-inference-service] preStop: [e2e-llm-inference-service] exec: [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /bin/sleep [e2e-llm-inference-service] - '15' [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: FallbackToLogsOnError [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] terminationGracePeriodSeconds: 60 [e2e-llm-inference-service] dnsPolicy: ClusterFirst [e2e-llm-inference-service] serviceAccountName: scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] serviceAccount: scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] securityContext: {} [e2e-llm-inference-service] schedulerName: default-scheduler [e2e-llm-inference-service] strategy: [e2e-llm-inference-service] type: Recreate [e2e-llm-inference-service] revisionHistoryLimit: 10 [e2e-llm-inference-service] progressDeadlineSeconds: 600 [e2e-llm-inference-service] status: [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] updatedReplicas: 1 [e2e-llm-inference-service] readyReplicas: 1 [e2e-llm-inference-service] availableReplicas: 1 [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] - type: Available [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastUpdateTime: '2026-07-08T17:35:52Z' [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:52Z' [e2e-llm-inference-service] reason: MinimumReplicasAvailable [e2e-llm-inference-service] message: Deployment has minimum availability. [e2e-llm-inference-service] - type: Progressing [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] lastUpdateTime: '2026-07-08T17:35:52Z' [e2e-llm-inference-service] lastTransitionTime: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] reason: NewReplicaSetAvailable [e2e-llm-inference-service] message: ReplicaSet "scheduler-v06-pd-migration-test-kserve-router-scheduler-59dc679cd" [e2e-llm-inference-service] has successfully progressed. [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] kind: Deployment [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-5c87756974 [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 9b80e29d-2ecd-4e16-87fc-95060c248006 [e2e-llm-inference-service] resourceVersion: '64493' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: decode [e2e-llm-inference-service] pod-template-hash: 5c87756974 [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] deployment.kubernetes.io/desired-replicas: '1' [e2e-llm-inference-service] deployment.kubernetes.io/max-replicas: '2' [e2e-llm-inference-service] deployment.kubernetes.io/revision: '1' [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: apps/v1 [e2e-llm-inference-service] kind: Deployment [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] uid: 1aed87da-69a2-4ebd-9328-c17b23bab1eb [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/desired-replicas: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/max-replicas: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/revision: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:pod-template-hash: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"1aed87da-69a2-4ebd-9328-c17b23bab1eb"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] f:selector: {} [e2e-llm-inference-service] f:template: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:pod-template-hash: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:containers: [e2e-llm-inference-service] k:{"name":"main"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:args: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"HF_HUB_CACHE"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"HOME"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"VLLM_LOGGING_LEVEL"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:lifecycle: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:preStop: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":8001,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:limits: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:requests: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:seccompProfile: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:startupProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/dev/shm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/models"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/tmp"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:dnsPolicy: {} [e2e-llm-inference-service] f:initContainers: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"llm-d-routing-sidecar"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"INFERENCE_POOL_NAME"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"INFERENCE_POOL_NAMESPACE"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:valueFrom: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:fieldRef: {} [e2e-llm-inference-service] k:{"name":"SSL_CERT_DIR"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":8000,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:schedulerName: {} [e2e-llm-inference-service] f:securityContext: {} [e2e-llm-inference-service] f:serviceAccount: {} [e2e-llm-inference-service] f:serviceAccountName: {} [e2e-llm-inference-service] f:terminationGracePeriodSeconds: {} [e2e-llm-inference-service] f:volumes: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"dshm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:medium: {} [e2e-llm-inference-service] f:sizeLimit: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"model-cache"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tls-certs"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:secret: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:defaultMode: {} [e2e-llm-inference-service] f:secretName: {} [e2e-llm-inference-service] k:{"name":"tmp-dir"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:31Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:availableReplicas: {} [e2e-llm-inference-service] f:fullyLabeledReplicas: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:readyReplicas: {} [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] spec: [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] selector: [e2e-llm-inference-service] matchLabels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: decode [e2e-llm-inference-service] pod-template-hash: 5c87756974 [e2e-llm-inference-service] template: [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: decode [e2e-llm-inference-service] pod-template-hash: 5c87756974 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] volumes: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] emptyDir: [e2e-llm-inference-service] medium: Memory [e2e-llm-inference-service] sizeLimit: 1Gi [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] secret: [e2e-llm-inference-service] secretName: scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] initContainers: [e2e-llm-inference-service] - name: llm-d-routing-sidecar [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/pd-sidecar [e2e-llm-inference-service] - --port=8000 [e2e-llm-inference-service] - --vllm-port=8001 [e2e-llm-inference-service] - --kv-connector=nixlv2 [e2e-llm-inference-service] - --enable-ssrf-protection=true [e2e-llm-inference-service] - --pool-group=inference.networking.x-k8s.io [e2e-llm-inference-service] - --inference-pool=kserve-ci-e2e-test/scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] - --secure-proxy=true [e2e-llm-inference-service] - --cert-path=/var/run/kserve/tls [e2e-llm-inference-service] - --decoder-use-tls=true [e2e-llm-inference-service] - --prefiller-use-tls=true [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - containerPort: 8000 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: INFERENCE_POOL_NAMESPACE [e2e-llm-inference-service] valueFrom: [e2e-llm-inference-service] fieldRef: [e2e-llm-inference-service] apiVersion: v1 [e2e-llm-inference-service] fieldPath: metadata.namespace [e2e-llm-inference-service] - name: SSL_CERT_DIR [e2e-llm-inference-service] value: /var/run/kserve/tls:/var/run/secrets/kubernetes.io/serviceaccount:/etc/pki/tls/certs [e2e-llm-inference-service] - name: INFERENCE_POOL_NAME [e2e-llm-inference-service] value: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] resources: {} [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] initialDelaySeconds: 10 [e2e-llm-inference-service] timeoutSeconds: 10 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 3 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] initialDelaySeconds: 10 [e2e-llm-inference-service] timeoutSeconds: 5 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 10 [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: FallbackToLogsOnError [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-inference-sim:v0.8.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/llm-d-inference-sim [e2e-llm-inference-service] args: [e2e-llm-inference-service] - --port [e2e-llm-inference-service] - '8001' [e2e-llm-inference-service] - --model [e2e-llm-inference-service] - facebook/opt-125m [e2e-llm-inference-service] - --mode [e2e-llm-inference-service] - random [e2e-llm-inference-service] - --ssl-certfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.crt [e2e-llm-inference-service] - --ssl-keyfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.key [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - containerPort: 8001 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: HOME [e2e-llm-inference-service] value: /home [e2e-llm-inference-service] - name: VLLM_LOGGING_LEVEL [e2e-llm-inference-service] value: INFO [e2e-llm-inference-service] - name: HF_HUB_CACHE [e2e-llm-inference-service] value: /models [e2e-llm-inference-service] resources: [e2e-llm-inference-service] limits: [e2e-llm-inference-service] cpu: '1' [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] mountPath: /home [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] mountPath: /tmp [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] mountPath: /dev/shm [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] mountPath: /models [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8001 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 10 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8001 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 1 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 2 [e2e-llm-inference-service] startupProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8001 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 60 [e2e-llm-inference-service] lifecycle: [e2e-llm-inference-service] preStop: [e2e-llm-inference-service] exec: [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /bin/sleep [e2e-llm-inference-service] - '15' [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: FallbackToLogsOnError [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] terminationGracePeriodSeconds: 60 [e2e-llm-inference-service] dnsPolicy: ClusterFirst [e2e-llm-inference-service] serviceAccountName: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] serviceAccount: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] securityContext: {} [e2e-llm-inference-service] schedulerName: default-scheduler [e2e-llm-inference-service] status: [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] fullyLabeledReplicas: 1 [e2e-llm-inference-service] readyReplicas: 1 [e2e-llm-inference-service] availableReplicas: 1 [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] kind: ReplicaSet [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847 [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 95aab951-0729-4253-8d67-3a3f6c3d079e [e2e-llm-inference-service] resourceVersion: '64473' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload-prefill [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: prefill [e2e-llm-inference-service] pod-template-hash: 78b7f4c847 [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] deployment.kubernetes.io/desired-replicas: '1' [e2e-llm-inference-service] deployment.kubernetes.io/max-replicas: '2' [e2e-llm-inference-service] deployment.kubernetes.io/revision: '1' [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: apps/v1 [e2e-llm-inference-service] kind: Deployment [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-prefill [e2e-llm-inference-service] uid: 738db50a-d55d-4d78-9dbf-ee805ccf5b04 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/desired-replicas: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/max-replicas: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/revision: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:pod-template-hash: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"738db50a-d55d-4d78-9dbf-ee805ccf5b04"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] f:selector: {} [e2e-llm-inference-service] f:template: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:llm-d.ai/role: {} [e2e-llm-inference-service] f:pod-template-hash: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:containers: [e2e-llm-inference-service] k:{"name":"main"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:args: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"HF_HUB_CACHE"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"HOME"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] k:{"name":"VLLM_LOGGING_LEVEL"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:lifecycle: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:preStop: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":8000,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:limits: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:requests: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:seccompProfile: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:startupProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:httpGet: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:path: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:scheme: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/dev/shm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/models"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/tmp"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:dnsPolicy: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:schedulerName: {} [e2e-llm-inference-service] f:securityContext: {} [e2e-llm-inference-service] f:terminationGracePeriodSeconds: {} [e2e-llm-inference-service] f:volumes: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"dshm"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:medium: {} [e2e-llm-inference-service] f:sizeLimit: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"home"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"model-cache"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tls-certs"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:secret: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:defaultMode: {} [e2e-llm-inference-service] f:secretName: {} [e2e-llm-inference-service] k:{"name":"tmp-dir"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:30Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:availableReplicas: {} [e2e-llm-inference-service] f:fullyLabeledReplicas: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:readyReplicas: {} [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] spec: [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] selector: [e2e-llm-inference-service] matchLabels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload-prefill [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: prefill [e2e-llm-inference-service] pod-template-hash: 78b7f4c847 [e2e-llm-inference-service] template: [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload-prefill [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: prefill [e2e-llm-inference-service] pod-template-hash: 78b7f4c847 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] volumes: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] emptyDir: [e2e-llm-inference-service] medium: Memory [e2e-llm-inference-service] sizeLimit: 1Gi [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] secret: [e2e-llm-inference-service] secretName: scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-inference-sim:v0.8.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/llm-d-inference-sim [e2e-llm-inference-service] args: [e2e-llm-inference-service] - --port [e2e-llm-inference-service] - '8000' [e2e-llm-inference-service] - --model [e2e-llm-inference-service] - facebook/opt-125m [e2e-llm-inference-service] - --mode [e2e-llm-inference-service] - random [e2e-llm-inference-service] - --ssl-certfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.crt [e2e-llm-inference-service] - --ssl-keyfile [e2e-llm-inference-service] - /var/run/kserve/tls/tls.key [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - containerPort: 8000 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: HOME [e2e-llm-inference-service] value: /home [e2e-llm-inference-service] - name: VLLM_LOGGING_LEVEL [e2e-llm-inference-service] value: INFO [e2e-llm-inference-service] - name: HF_HUB_CACHE [e2e-llm-inference-service] value: /models [e2e-llm-inference-service] resources: [e2e-llm-inference-service] limits: [e2e-llm-inference-service] cpu: '1' [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 200m [e2e-llm-inference-service] memory: 2Gi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: home [e2e-llm-inference-service] mountPath: /home [e2e-llm-inference-service] - name: tmp-dir [e2e-llm-inference-service] mountPath: /tmp [e2e-llm-inference-service] - name: dshm [e2e-llm-inference-service] mountPath: /dev/shm [e2e-llm-inference-service] - name: model-cache [e2e-llm-inference-service] mountPath: /models [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 10 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 1 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 2 [e2e-llm-inference-service] startupProbe: [e2e-llm-inference-service] httpGet: [e2e-llm-inference-service] path: /health [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] scheme: HTTPS [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 60 [e2e-llm-inference-service] lifecycle: [e2e-llm-inference-service] preStop: [e2e-llm-inference-service] exec: [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /bin/sleep [e2e-llm-inference-service] - '15' [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: File [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] terminationGracePeriodSeconds: 60 [e2e-llm-inference-service] dnsPolicy: ClusterFirst [e2e-llm-inference-service] securityContext: {} [e2e-llm-inference-service] schedulerName: default-scheduler [e2e-llm-inference-service] status: [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] fullyLabeledReplicas: 1 [e2e-llm-inference-service] readyReplicas: 1 [e2e-llm-inference-service] availableReplicas: 1 [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] kind: ReplicaSet [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-router-scheduler-59dc679cd [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 1d63b5a2-e983-4b49-b99e-0112c3012fc6 [e2e-llm-inference-service] resourceVersion: '64764' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] pod-template-hash: 59dc679cd [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] deployment.kubernetes.io/desired-replicas: '1' [e2e-llm-inference-service] deployment.kubernetes.io/max-replicas: '1' [e2e-llm-inference-service] deployment.kubernetes.io/revision: '1' [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: apps/v1 [e2e-llm-inference-service] kind: Deployment [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-router-scheduler [e2e-llm-inference-service] uid: e9d01489-d175-4252-bdef-55ebfad7962b [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/desired-replicas: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/max-replicas: {} [e2e-llm-inference-service] f:deployment.kubernetes.io/revision: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:pod-template-hash: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"e9d01489-d175-4252-bdef-55ebfad7962b"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] f:selector: {} [e2e-llm-inference-service] f:template: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/version: {} [e2e-llm-inference-service] f:certificates.kserve.io/expiration-v2: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:pod-template-hash: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] f:containers: [e2e-llm-inference-service] k:{"name":"main"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:args: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:env: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"SSL_CERT_DIR"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:image: {} [e2e-llm-inference-service] f:imagePullPolicy: {} [e2e-llm-inference-service] f:lifecycle: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:preStop: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:command: {} [e2e-llm-inference-service] f:livenessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:grpc: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:service: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:ports: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"containerPort":5557,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] k:{"containerPort":9002,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] k:{"containerPort":9003,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] k:{"containerPort":9090,"protocol":"TCP"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:containerPort: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:protocol: {} [e2e-llm-inference-service] f:readinessProbe: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureThreshold: {} [e2e-llm-inference-service] f:grpc: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:port: {} [e2e-llm-inference-service] f:service: {} [e2e-llm-inference-service] f:initialDelaySeconds: {} [e2e-llm-inference-service] f:periodSeconds: {} [e2e-llm-inference-service] f:successThreshold: {} [e2e-llm-inference-service] f:timeoutSeconds: {} [e2e-llm-inference-service] f:resources: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:requests: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:cpu: {} [e2e-llm-inference-service] f:memory: {} [e2e-llm-inference-service] f:securityContext: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:allowPrivilegeEscalation: {} [e2e-llm-inference-service] f:capabilities: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:drop: {} [e2e-llm-inference-service] f:readOnlyRootFilesystem: {} [e2e-llm-inference-service] f:runAsNonRoot: {} [e2e-llm-inference-service] f:seccompProfile: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:terminationMessagePath: {} [e2e-llm-inference-service] f:terminationMessagePolicy: {} [e2e-llm-inference-service] f:volumeMounts: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"mountPath":"/tmp/tokenizer"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"mountPath":"/var/run/kserve/tls"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:mountPath: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:readOnly: {} [e2e-llm-inference-service] f:dnsPolicy: {} [e2e-llm-inference-service] f:restartPolicy: {} [e2e-llm-inference-service] f:schedulerName: {} [e2e-llm-inference-service] f:securityContext: {} [e2e-llm-inference-service] f:serviceAccount: {} [e2e-llm-inference-service] f:serviceAccountName: {} [e2e-llm-inference-service] f:terminationGracePeriodSeconds: {} [e2e-llm-inference-service] f:volumes: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"name":"tls-certs"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:secret: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:defaultMode: {} [e2e-llm-inference-service] f:secretName: {} [e2e-llm-inference-service] k:{"name":"tokenizer-cache"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tokenizer-tmp"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] k:{"name":"tokenizer-uds"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:emptyDir: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:52Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:availableReplicas: {} [e2e-llm-inference-service] f:fullyLabeledReplicas: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] f:readyReplicas: {} [e2e-llm-inference-service] f:replicas: {} [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] spec: [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] selector: [e2e-llm-inference-service] matchLabels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] pod-template-hash: 59dc679cd [e2e-llm-inference-service] template: [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] pod-template-hash: 59dc679cd [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] app.kubernetes.io/version: 0.9.0 [e2e-llm-inference-service] certificates.kserve.io/expiration-v2: 'true' [e2e-llm-inference-service] spec: [e2e-llm-inference-service] volumes: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] secret: [e2e-llm-inference-service] secretName: scheduler-v06-pd-migration-test-kserve-self-signed-certs [e2e-llm-inference-service] defaultMode: 420 [e2e-llm-inference-service] - name: tokenizer-uds [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tokenizer-tmp [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] - name: tokenizer-cache [e2e-llm-inference-service] emptyDir: {} [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] image: ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2 [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /app/epp [e2e-llm-inference-service] - --pool-name [e2e-llm-inference-service] - scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] - --pool-namespace [e2e-llm-inference-service] - kserve-ci-e2e-test [e2e-llm-inference-service] - --zap-encoder [e2e-llm-inference-service] - json [e2e-llm-inference-service] - --grpc-port [e2e-llm-inference-service] - '9002' [e2e-llm-inference-service] - --grpc-health-port [e2e-llm-inference-service] - '9003' [e2e-llm-inference-service] - --enable-cert-reload=true [e2e-llm-inference-service] - --secure-serving=true [e2e-llm-inference-service] - --model-server-metrics-scheme=https [e2e-llm-inference-service] - --cert-path=/var/run/kserve/tls [e2e-llm-inference-service] args: [e2e-llm-inference-service] - --config-text [e2e-llm-inference-service] - "apiVersion: inference.networking.x-k8s.io/v1alpha1\nkind: EndpointPickerConfig\n\ [e2e-llm-inference-service] plugins:\n- type: disagg-headers-handler\n- type: prefill-filter\n- type:\ [e2e-llm-inference-service] \ decode-filter\n- type: always-disagg-pd-decider\n- parameters:\n deciders:\n\ [e2e-llm-inference-service] \ prefill: always-disagg-pd-decider\n type: disagg-profile-handler\n\ [e2e-llm-inference-service] - type: prefix-cache-scorer\n- type: queue-scorer\n- type: max-score-picker\n\ [e2e-llm-inference-service] schedulingProfiles:\n- name: prefill\n plugins:\n - pluginRef: prefill-filter\n\ [e2e-llm-inference-service] \ - pluginRef: queue-scorer\n weight: 2\n - pluginRef: prefix-cache-scorer\n\ [e2e-llm-inference-service] \ weight: 3\n - pluginRef: max-score-picker\n- name: decode\n plugins:\n\ [e2e-llm-inference-service] \ - pluginRef: decode-filter\n - pluginRef: queue-scorer\n weight:\ [e2e-llm-inference-service] \ 2\n - pluginRef: prefix-cache-scorer\n weight: 3\n - pluginRef: max-score-picker\n" [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - name: grpc [e2e-llm-inference-service] containerPort: 9002 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: grpc-health [e2e-llm-inference-service] containerPort: 9003 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: metrics [e2e-llm-inference-service] containerPort: 9090 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] - name: zmq [e2e-llm-inference-service] containerPort: 5557 [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] env: [e2e-llm-inference-service] - name: SSL_CERT_DIR [e2e-llm-inference-service] value: /var/run/kserve/tls:/var/run/secrets/kubernetes.io/serviceaccount:/etc/pki/tls/certs [e2e-llm-inference-service] resources: [e2e-llm-inference-service] requests: [e2e-llm-inference-service] cpu: 256m [e2e-llm-inference-service] memory: 500Mi [e2e-llm-inference-service] volumeMounts: [e2e-llm-inference-service] - name: tls-certs [e2e-llm-inference-service] readOnly: true [e2e-llm-inference-service] mountPath: /var/run/kserve/tls [e2e-llm-inference-service] - name: tokenizer-uds [e2e-llm-inference-service] mountPath: /tmp/tokenizer [e2e-llm-inference-service] livenessProbe: [e2e-llm-inference-service] grpc: [e2e-llm-inference-service] port: 9003 [e2e-llm-inference-service] service: liveness [e2e-llm-inference-service] initialDelaySeconds: 5 [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 3 [e2e-llm-inference-service] readinessProbe: [e2e-llm-inference-service] grpc: [e2e-llm-inference-service] port: 9003 [e2e-llm-inference-service] service: readiness [e2e-llm-inference-service] initialDelaySeconds: 30 [e2e-llm-inference-service] timeoutSeconds: 1 [e2e-llm-inference-service] periodSeconds: 10 [e2e-llm-inference-service] successThreshold: 1 [e2e-llm-inference-service] failureThreshold: 3 [e2e-llm-inference-service] lifecycle: [e2e-llm-inference-service] preStop: [e2e-llm-inference-service] exec: [e2e-llm-inference-service] command: [e2e-llm-inference-service] - /bin/sleep [e2e-llm-inference-service] - '15' [e2e-llm-inference-service] terminationMessagePath: /dev/termination-log [e2e-llm-inference-service] terminationMessagePolicy: FallbackToLogsOnError [e2e-llm-inference-service] imagePullPolicy: IfNotPresent [e2e-llm-inference-service] securityContext: [e2e-llm-inference-service] capabilities: [e2e-llm-inference-service] drop: [e2e-llm-inference-service] - ALL [e2e-llm-inference-service] runAsNonRoot: true [e2e-llm-inference-service] readOnlyRootFilesystem: true [e2e-llm-inference-service] allowPrivilegeEscalation: false [e2e-llm-inference-service] seccompProfile: [e2e-llm-inference-service] type: RuntimeDefault [e2e-llm-inference-service] restartPolicy: Always [e2e-llm-inference-service] terminationGracePeriodSeconds: 60 [e2e-llm-inference-service] dnsPolicy: ClusterFirst [e2e-llm-inference-service] serviceAccountName: scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] serviceAccount: scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] securityContext: {} [e2e-llm-inference-service] schedulerName: default-scheduler [e2e-llm-inference-service] status: [e2e-llm-inference-service] replicas: 1 [e2e-llm-inference-service] fullyLabeledReplicas: 1 [e2e-llm-inference-service] readyReplicas: 1 [e2e-llm-inference-service] availableReplicas: 1 [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] apiVersion: apps/v1 [e2e-llm-inference-service] kind: ReplicaSet [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-rb [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: f9b696fa-dc13-4a21-8bd9-e197997202b6 [e2e-llm-inference-service] resourceVersion: '64046' [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:roleRef: {} [e2e-llm-inference-service] f:subjects: {} [e2e-llm-inference-service] subjects: [e2e-llm-inference-service] - kind: ServiceAccount [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] roleRef: [e2e-llm-inference-service] apiGroup: rbac.authorization.k8s.io [e2e-llm-inference-service] kind: Role [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-role [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] kind: RoleBinding [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-rb [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: c05f0bf7-7df4-4cfb-9c9d-1aed38d0bc5d [e2e-llm-inference-service] resourceVersion: '63998' [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:roleRef: {} [e2e-llm-inference-service] f:subjects: {} [e2e-llm-inference-service] subjects: [e2e-llm-inference-service] - kind: ServiceAccount [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] roleRef: [e2e-llm-inference-service] apiGroup: rbac.authorization.k8s.io [e2e-llm-inference-service] kind: Role [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-role [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] kind: RoleBinding [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-role [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 748d3f43-9096-4f38-8ca2-60ef39895180 [e2e-llm-inference-service] resourceVersion: '64043' [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:rules: {} [e2e-llm-inference-service] rules: [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - '' [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - pods [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - inference.networking.k8s.io [e2e-llm-inference-service] - inference.networking.x-k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - inferencepools [e2e-llm-inference-service] - inferenceobjectives [e2e-llm-inference-service] - inferencemodels [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - inference.networking.x-k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - inferencemodelrewrites [e2e-llm-inference-service] - inferencepoolimports [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - discovery.k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - endpointslices [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] - create [e2e-llm-inference-service] - update [e2e-llm-inference-service] - patch [e2e-llm-inference-service] - delete [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - coordination.k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - leases [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] kind: Role [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-role [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 40c0a2c8-a319-43ea-96d4-02cbc9ab2a4f [e2e-llm-inference-service] resourceVersion: '63994' [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:rules: {} [e2e-llm-inference-service] rules: [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - '' [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - pods [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - inference.networking.x-k8s.io [e2e-llm-inference-service] - inference.networking.k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - inferencepools [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] kind: Role [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-service-pkqss [e2e-llm-inference-service] generateName: scheduler-v06-pd-migration-test-epp-service- [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: fda696c0-8017-49a2-9e91-5c4bbdf4d585 [e2e-llm-inference-service] resourceVersion: '64763' [e2e-llm-inference-service] generation: 3 [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] endpointslice.kubernetes.io/managed-by: endpointslice-controller.k8s.io [e2e-llm-inference-service] kubernetes.io/service-name: scheduler-v06-pd-migration-test-epp-service [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] endpoints.kubernetes.io/last-change-trigger-time: '2026-07-08T17:35:52Z' [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: v1 [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-service [e2e-llm-inference-service] uid: 855be77e-20b0-4dbd-81af-9c2611d8fdb1 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: discovery.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:52Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:addressType: {} [e2e-llm-inference-service] f:endpoints: {} [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:endpoints.kubernetes.io/last-change-trigger-time: {} [e2e-llm-inference-service] f:generateName: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:endpointslice.kubernetes.io/managed-by: {} [e2e-llm-inference-service] f:kubernetes.io/service-name: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"855be77e-20b0-4dbd-81af-9c2611d8fdb1"}: {} [e2e-llm-inference-service] f:ports: {} [e2e-llm-inference-service] addressType: IPv4 [e2e-llm-inference-service] endpoints: [e2e-llm-inference-service] - addresses: [e2e-llm-inference-service] - 10.133.0.84 [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] ready: true [e2e-llm-inference-service] serving: true [e2e-llm-inference-service] terminating: false [e2e-llm-inference-service] targetRef: [e2e-llm-inference-service] kind: Pod [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-router-scheduler-595ls74 [e2e-llm-inference-service] uid: c6e3eb6e-ca4d-41fd-a402-927efffc9858 [e2e-llm-inference-service] nodeName: ip-10-0-128-142.ec2.internal [e2e-llm-inference-service] zone: us-east-1a [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - name: grpc [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] port: 9002 [e2e-llm-inference-service] - name: grpc-health [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] port: 9003 [e2e-llm-inference-service] - name: metrics [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] port: 9090 [e2e-llm-inference-service] - name: zmq [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] port: 5557 [e2e-llm-inference-service] apiVersion: discovery.k8s.io/v1 [e2e-llm-inference-service] kind: EndpointSlice [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc-nsccs [e2e-llm-inference-service] generateName: scheduler-v06-pd-migration-test-kserve-workload-svc- [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: ed825386-65f4-4954-9db5-f977894c1c2c [e2e-llm-inference-service] resourceVersion: '64492' [e2e-llm-inference-service] generation: 5 [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] endpointslice.kubernetes.io/managed-by: endpointslice-controller.k8s.io [e2e-llm-inference-service] kubernetes.io/service-name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] endpoints.kubernetes.io/last-change-trigger-time: '2026-07-08T17:35:31Z' [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: v1 [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] uid: e63d0c38-0b5f-4d84-afd6-067ba906d418 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: kube-controller-manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: discovery.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:31Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:addressType: {} [e2e-llm-inference-service] f:endpoints: {} [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:endpoints.kubernetes.io/last-change-trigger-time: {} [e2e-llm-inference-service] f:generateName: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:endpointslice.kubernetes.io/managed-by: {} [e2e-llm-inference-service] f:kubernetes.io/service-name: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"e63d0c38-0b5f-4d84-afd6-067ba906d418"}: {} [e2e-llm-inference-service] f:ports: {} [e2e-llm-inference-service] addressType: IPv4 [e2e-llm-inference-service] endpoints: [e2e-llm-inference-service] - addresses: [e2e-llm-inference-service] - 10.134.0.33 [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] ready: true [e2e-llm-inference-service] serving: true [e2e-llm-inference-service] terminating: false [e2e-llm-inference-service] targetRef: [e2e-llm-inference-service] kind: Pod [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46 [e2e-llm-inference-service] uid: 6964cc10-b630-4b37-9005-73e5a9a47a08 [e2e-llm-inference-service] nodeName: ip-10-0-142-172.ec2.internal [e2e-llm-inference-service] zone: us-east-1a [e2e-llm-inference-service] - addresses: [e2e-llm-inference-service] - 10.132.0.68 [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] ready: true [e2e-llm-inference-service] serving: true [e2e-llm-inference-service] terminating: false [e2e-llm-inference-service] targetRef: [e2e-llm-inference-service] kind: Pod [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx [e2e-llm-inference-service] uid: 1eaa996a-363c-4232-abfd-bfcf8a0a1aa2 [e2e-llm-inference-service] nodeName: ip-10-0-130-182.ec2.internal [e2e-llm-inference-service] zone: us-east-1a [e2e-llm-inference-service] ports: [e2e-llm-inference-service] - name: https [e2e-llm-inference-service] protocol: TCP [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] appProtocol: https [e2e-llm-inference-service] apiVersion: discovery.k8s.io/v1 [e2e-llm-inference-service] kind: EndpointSlice [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-rb [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: f9b696fa-dc13-4a21-8bd9-e197997202b6 [e2e-llm-inference-service] resourceVersion: '64046' [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:roleRef: {} [e2e-llm-inference-service] f:subjects: {} [e2e-llm-inference-service] userNames: [e2e-llm-inference-service] - system:serviceaccount:kserve-ci-e2e-test:scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] groupNames: null [e2e-llm-inference-service] subjects: [e2e-llm-inference-service] - kind: ServiceAccount [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-sa [e2e-llm-inference-service] roleRef: [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-role [e2e-llm-inference-service] apiVersion: authorization.openshift.io/v1 [e2e-llm-inference-service] kind: RoleBinding [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-rb [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: c05f0bf7-7df4-4cfb-9c9d-1aed38d0bc5d [e2e-llm-inference-service] resourceVersion: '63998' [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:roleRef: {} [e2e-llm-inference-service] f:subjects: {} [e2e-llm-inference-service] userNames: [e2e-llm-inference-service] - system:serviceaccount:kserve-ci-e2e-test:scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] groupNames: null [e2e-llm-inference-service] subjects: [e2e-llm-inference-service] - kind: ServiceAccount [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve [e2e-llm-inference-service] roleRef: [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-role [e2e-llm-inference-service] apiVersion: authorization.openshift.io/v1 [e2e-llm-inference-service] kind: RoleBinding [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-role [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 748d3f43-9096-4f38-8ca2-60ef39895180 [e2e-llm-inference-service] resourceVersion: '64043' [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:rules: {} [e2e-llm-inference-service] rules: [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] attributeRestrictions: null [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - '' [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - pods [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] attributeRestrictions: null [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - inference.networking.k8s.io [e2e-llm-inference-service] - inference.networking.x-k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - inferencemodels [e2e-llm-inference-service] - inferenceobjectives [e2e-llm-inference-service] - inferencepools [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] attributeRestrictions: null [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - inference.networking.x-k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - inferencemodelrewrites [e2e-llm-inference-service] - inferencepoolimports [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] attributeRestrictions: null [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - discovery.k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - endpointslices [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - create [e2e-llm-inference-service] - delete [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - patch [e2e-llm-inference-service] - update [e2e-llm-inference-service] - watch [e2e-llm-inference-service] attributeRestrictions: null [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - coordination.k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - leases [e2e-llm-inference-service] apiVersion: authorization.openshift.io/v1 [e2e-llm-inference-service] kind: Role [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-role [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] uid: 40c0a2c8-a319-43ea-96d4-02cbc9ab2a4f [e2e-llm-inference-service] resourceVersion: '63994' [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] apiVersion: rbac.authorization.k8s.io/v1 [e2e-llm-inference-service] time: '2026-07-08T17:35:19Z' [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:rules: {} [e2e-llm-inference-service] rules: [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] attributeRestrictions: null [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - '' [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - pods [e2e-llm-inference-service] - verbs: [e2e-llm-inference-service] - get [e2e-llm-inference-service] - list [e2e-llm-inference-service] - watch [e2e-llm-inference-service] attributeRestrictions: null [e2e-llm-inference-service] apiGroups: [e2e-llm-inference-service] - inference.networking.x-k8s.io [e2e-llm-inference-service] - inference.networking.k8s.io [e2e-llm-inference-service] resources: [e2e-llm-inference-service] - inferencepools [e2e-llm-inference-service] apiVersion: authorization.openshift.io/v1 [e2e-llm-inference-service] kind: Role [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: gateway.networking.k8s.io/v1 [e2e-llm-inference-service] kind: HTTPRoute [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] serving.kserve.io/inference-pool-migrated: v1 [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] generation: 2 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: gateway.networking.k8s.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:serving.kserve.io/inference-pool-migrated: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:spec: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-08T17:35:34Z' [e2e-llm-inference-service] - apiVersion: gateway.networking.k8s.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:parents: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] time: '2026-07-08T17:35:35Z' [e2e-llm-inference-service] - apiVersion: gateway.networking.k8s.io/v1beta1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] manager: pilot-discovery [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] time: '2026-07-08T17:35:35Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-route [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] resourceVersion: '64550' [e2e-llm-inference-service] uid: 07cad434-cb2c-4176-bf60-7102b1dc9be7 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] parentRefs: [e2e-llm-inference-service] - group: gateway.networking.k8s.io [e2e-llm-inference-service] kind: Gateway [e2e-llm-inference-service] name: openshift-ai-inference [e2e-llm-inference-service] namespace: openshift-ingress [e2e-llm-inference-service] rules: [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: /v1/completions [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/completions [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/completions [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/completions/ [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: /v1/chat/completions [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/chat/completions [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/chat/completions [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/chat/completions/ [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: /v1/responses [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/responses [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/responses [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/responses/ [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: /v1/messages [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/messages [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/messages [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/messages/ [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: '' [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: / [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: '' [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: / [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] status: [e2e-llm-inference-service] parents: [e2e-llm-inference-service] - conditions: [e2e-llm-inference-service] - lastTransitionTime: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] message: Route was valid [e2e-llm-inference-service] observedGeneration: 2 [e2e-llm-inference-service] reason: Accepted [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: Accepted [e2e-llm-inference-service] - lastTransitionTime: '2026-07-08T17:35:35Z' [e2e-llm-inference-service] message: All references resolved [e2e-llm-inference-service] observedGeneration: 2 [e2e-llm-inference-service] reason: ResolvedRefs [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: ResolvedRefs [e2e-llm-inference-service] controllerName: openshift.io/gateway-controller/v1 [e2e-llm-inference-service] parentRef: [e2e-llm-inference-service] group: gateway.networking.k8s.io [e2e-llm-inference-service] kind: Gateway [e2e-llm-inference-service] name: openshift-ai-inference [e2e-llm-inference-service] namespace: openshift-ingress [e2e-llm-inference-service] - conditions: [e2e-llm-inference-service] - lastTransitionTime: '2026-07-08T17:35:21Z' [e2e-llm-inference-service] message: Object affected by AuthPolicy [kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route-authn [e2e-llm-inference-service] openshift-ingress/openshift-ai-inference-authn] [e2e-llm-inference-service] observedGeneration: 2 [e2e-llm-inference-service] reason: Accepted [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: kuadrant.io/AuthPolicyAffected [e2e-llm-inference-service] controllerName: kuadrant.io/policy-controller [e2e-llm-inference-service] parentRef: [e2e-llm-inference-service] group: gateway.networking.k8s.io [e2e-llm-inference-service] kind: Gateway [e2e-llm-inference-service] name: openshift-ai-inference [e2e-llm-inference-service] namespace: openshift-ingress [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: gateway.networking.k8s.io/v1beta1 [e2e-llm-inference-service] kind: HTTPRoute [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] annotations: [e2e-llm-inference-service] serving.kserve.io/inference-pool-migrated: v1 [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] generation: 2 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: gateway.networking.k8s.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:annotations: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:serving.kserve.io/inference-pool-migrated: {} [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:spec: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-08T17:35:34Z' [e2e-llm-inference-service] - apiVersion: gateway.networking.k8s.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] f:parents: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] time: '2026-07-08T17:35:35Z' [e2e-llm-inference-service] - apiVersion: gateway.networking.k8s.io/v1beta1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] manager: pilot-discovery [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] time: '2026-07-08T17:35:35Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-route [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] resourceVersion: '64550' [e2e-llm-inference-service] uid: 07cad434-cb2c-4176-bf60-7102b1dc9be7 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] parentRefs: [e2e-llm-inference-service] - group: gateway.networking.k8s.io [e2e-llm-inference-service] kind: Gateway [e2e-llm-inference-service] name: openshift-ai-inference [e2e-llm-inference-service] namespace: openshift-ingress [e2e-llm-inference-service] rules: [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: /v1/completions [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/completions [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/completions [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/completions/ [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: /v1/chat/completions [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/chat/completions [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/chat/completions [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/chat/completions/ [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: /v1/responses [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/responses [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/responses [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/responses/ [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: /v1/messages [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test/v1/messages [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: inference.networking.k8s.io [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/messages [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: /v1/messages/ [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: '' [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] filters: [e2e-llm-inference-service] - type: URLRewrite [e2e-llm-inference-service] urlRewrite: [e2e-llm-inference-service] path: [e2e-llm-inference-service] replacePrefixMatch: / [e2e-llm-inference-service] type: ReplacePrefixMatch [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: /kserve-ci-e2e-test/scheduler-v06-pd-migration-test [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] - backendRefs: [e2e-llm-inference-service] - group: '' [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] port: 8000 [e2e-llm-inference-service] weight: 1 [e2e-llm-inference-service] matches: [e2e-llm-inference-service] - headers: [e2e-llm-inference-service] - name: X-Gateway-Model-Name [e2e-llm-inference-service] type: Exact [e2e-llm-inference-service] value: publishers/kserve-ci-e2e-test/models/facebook/opt-125m [e2e-llm-inference-service] path: [e2e-llm-inference-service] type: PathPrefix [e2e-llm-inference-service] value: / [e2e-llm-inference-service] timeouts: [e2e-llm-inference-service] backendRequest: 0s [e2e-llm-inference-service] request: 0s [e2e-llm-inference-service] status: [e2e-llm-inference-service] parents: [e2e-llm-inference-service] - conditions: [e2e-llm-inference-service] - lastTransitionTime: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] message: Route was valid [e2e-llm-inference-service] observedGeneration: 2 [e2e-llm-inference-service] reason: Accepted [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: Accepted [e2e-llm-inference-service] - lastTransitionTime: '2026-07-08T17:35:35Z' [e2e-llm-inference-service] message: All references resolved [e2e-llm-inference-service] observedGeneration: 2 [e2e-llm-inference-service] reason: ResolvedRefs [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: ResolvedRefs [e2e-llm-inference-service] controllerName: openshift.io/gateway-controller/v1 [e2e-llm-inference-service] parentRef: [e2e-llm-inference-service] group: gateway.networking.k8s.io [e2e-llm-inference-service] kind: Gateway [e2e-llm-inference-service] name: openshift-ai-inference [e2e-llm-inference-service] namespace: openshift-ingress [e2e-llm-inference-service] - conditions: [e2e-llm-inference-service] - lastTransitionTime: '2026-07-08T17:35:21Z' [e2e-llm-inference-service] message: Object affected by AuthPolicy [kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route-authn [e2e-llm-inference-service] openshift-ingress/openshift-ai-inference-authn] [e2e-llm-inference-service] observedGeneration: 2 [e2e-llm-inference-service] reason: Accepted [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: kuadrant.io/AuthPolicyAffected [e2e-llm-inference-service] controllerName: kuadrant.io/policy-controller [e2e-llm-inference-service] parentRef: [e2e-llm-inference-service] group: gateway.networking.k8s.io [e2e-llm-inference-service] kind: Gateway [e2e-llm-inference-service] name: openshift-ai-inference [e2e-llm-inference-service] namespace: openshift-ingress [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: inference.networking.k8s.io/v1 [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: inference.networking.k8s.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:appProtocol: {} [e2e-llm-inference-service] f:endpointPickerRef: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureMode: {} [e2e-llm-inference-service] f:group: {} [e2e-llm-inference-service] f:kind: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:port: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:number: {} [e2e-llm-inference-service] f:selector: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:matchLabels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:targetPorts: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] - apiVersion: inference.networking.k8s.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:parents: {} [e2e-llm-inference-service] manager: pilot-discovery [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] time: '2026-07-08T17:35:34Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] resourceVersion: '64535' [e2e-llm-inference-service] uid: dd9520fa-8a5e-4ee5-a6a4-9224017b703e [e2e-llm-inference-service] spec: [e2e-llm-inference-service] appProtocol: http [e2e-llm-inference-service] endpointPickerRef: [e2e-llm-inference-service] failureMode: FailOpen [e2e-llm-inference-service] group: '' [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-service [e2e-llm-inference-service] port: [e2e-llm-inference-service] number: 9002 [e2e-llm-inference-service] selector: [e2e-llm-inference-service] matchLabels: [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] targetPorts: [e2e-llm-inference-service] - number: 8000 [e2e-llm-inference-service] status: [e2e-llm-inference-service] parents: [e2e-llm-inference-service] - conditions: [e2e-llm-inference-service] - lastTransitionTime: '2026-07-08T17:35:34Z' [e2e-llm-inference-service] message: Referenced by an HTTPRoute accepted by the parentRef Gateway [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] reason: Accepted [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: Accepted [e2e-llm-inference-service] - lastTransitionTime: '2026-07-08T17:35:34Z' [e2e-llm-inference-service] message: Referenced ExtensionRef resolved successfully [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] reason: ResolvedRefs [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: ResolvedRefs [e2e-llm-inference-service] parentRef: [e2e-llm-inference-service] group: networking.istio.io [e2e-llm-inference-service] kind: Gateway [e2e-llm-inference-service] name: openshift-ai-inference [e2e-llm-inference-service] namespace: openshift-ingress [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: kuadrant.io/v1 [e2e-llm-inference-service] kind: AuthPolicy [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:22Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-policies [e2e-llm-inference-service] app.kubernetes.io/managed-by: odh-model-controller [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: kuadrant.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/managed-by: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:rules: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:authentication: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:public: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:anonymous: {} [e2e-llm-inference-service] f:credentials: {} [e2e-llm-inference-service] f:metrics: {} [e2e-llm-inference-service] f:overrides: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:fairness: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:objective: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:value: {} [e2e-llm-inference-service] f:priority: {} [e2e-llm-inference-service] f:response: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:success: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:headers: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:x-gateway-inference-fairness-id: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:metrics: {} [e2e-llm-inference-service] f:plain: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:expression: {} [e2e-llm-inference-service] f:priority: {} [e2e-llm-inference-service] f:x-gateway-inference-objective: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:metrics: {} [e2e-llm-inference-service] f:plain: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:expression: {} [e2e-llm-inference-service] f:priority: {} [e2e-llm-inference-service] f:targetRef: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:group: {} [e2e-llm-inference-service] f:kind: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-08T17:35:22Z' [e2e-llm-inference-service] - apiVersion: kuadrant.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:status: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:conditions: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"type":"Accepted"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:message: {} [e2e-llm-inference-service] f:reason: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] k:{"type":"Enforced"}: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:lastTransitionTime: {} [e2e-llm-inference-service] f:message: {} [e2e-llm-inference-service] f:reason: {} [e2e-llm-inference-service] f:status: {} [e2e-llm-inference-service] f:type: {} [e2e-llm-inference-service] f:observedGeneration: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] subresource: status [e2e-llm-inference-service] time: '2026-07-08T17:35:23Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-route-authn [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] resourceVersion: '64226' [e2e-llm-inference-service] uid: 69c17641-0260-4445-8cec-9a6463955457 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] rules: [e2e-llm-inference-service] authentication: [e2e-llm-inference-service] public: [e2e-llm-inference-service] anonymous: {} [e2e-llm-inference-service] credentials: {} [e2e-llm-inference-service] metrics: false [e2e-llm-inference-service] overrides: [e2e-llm-inference-service] fairness: [e2e-llm-inference-service] value: unauthenticated [e2e-llm-inference-service] objective: [e2e-llm-inference-service] value: unauthenticated [e2e-llm-inference-service] priority: 0 [e2e-llm-inference-service] response: [e2e-llm-inference-service] success: [e2e-llm-inference-service] headers: [e2e-llm-inference-service] x-gateway-inference-fairness-id: [e2e-llm-inference-service] metrics: false [e2e-llm-inference-service] plain: [e2e-llm-inference-service] expression: auth.identity.fairness [e2e-llm-inference-service] priority: 0 [e2e-llm-inference-service] x-gateway-inference-objective: [e2e-llm-inference-service] metrics: false [e2e-llm-inference-service] plain: [e2e-llm-inference-service] expression: auth.identity.objective [e2e-llm-inference-service] priority: 0 [e2e-llm-inference-service] targetRef: [e2e-llm-inference-service] group: gateway.networking.k8s.io [e2e-llm-inference-service] kind: HTTPRoute [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-route [e2e-llm-inference-service] status: [e2e-llm-inference-service] conditions: [e2e-llm-inference-service] - lastTransitionTime: '2026-07-08T17:35:22Z' [e2e-llm-inference-service] message: AuthPolicy has been accepted [e2e-llm-inference-service] reason: Accepted [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: Accepted [e2e-llm-inference-service] - lastTransitionTime: '2026-07-08T17:35:23Z' [e2e-llm-inference-service] message: AuthPolicy has been successfully enforced [e2e-llm-inference-service] reason: Enforced [e2e-llm-inference-service] status: 'True' [e2e-llm-inference-service] type: Enforced [e2e-llm-inference-service] observedGeneration: 1 [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] kind: DestinationRule [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] llm-d.ai/managed: 'true' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:llm-d.ai/managed: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exportTo: {} [e2e-llm-inference-service] f:host: {} [e2e-llm-inference-service] f:trafficPolicy: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:tls: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:insecureSkipVerify: {} [e2e-llm-inference-service] f:mode: {} [e2e-llm-inference-service] f:sni: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-scheduler [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] resourceVersion: '64090' [e2e-llm-inference-service] uid: f7649796-f410-4f8e-87ff-196a786f3d17 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] exportTo: [e2e-llm-inference-service] - '*' [e2e-llm-inference-service] host: scheduler-v06-pd-migration-test-epp-service.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] trafficPolicy: [e2e-llm-inference-service] tls: [e2e-llm-inference-service] insecureSkipVerify: true [e2e-llm-inference-service] mode: SIMPLE [e2e-llm-inference-service] sni: scheduler-v06-pd-migration-test-epp-service.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] kind: DestinationRule [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:35Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-shadow-service [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] llm-d.ai/managed: 'true' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:llm-d.ai/managed: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exportTo: {} [e2e-llm-inference-service] f:host: {} [e2e-llm-inference-service] f:trafficPolicy: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:tls: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:insecureSkipVerify: {} [e2e-llm-inference-service] f:mode: {} [e2e-llm-inference-service] f:sni: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-08T17:35:35Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-shadow-svc [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] resourceVersion: '64544' [e2e-llm-inference-service] uid: 4c205d9f-5dae-4763-a542-8fbf16b121b1 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] exportTo: [e2e-llm-inference-service] - '*' [e2e-llm-inference-service] host: scheduler-v06-pd-migration-test-inference-pool-ip-2bbd07cf.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] trafficPolicy: [e2e-llm-inference-service] tls: [e2e-llm-inference-service] insecureSkipVerify: true [e2e-llm-inference-service] mode: SIMPLE [e2e-llm-inference-service] sni: scheduler-v06-pd-migration-test-kserve-workload-svc.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] kind: DestinationRule [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] llm-d.ai/managed: 'true' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:llm-d.ai/managed: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exportTo: {} [e2e-llm-inference-service] f:host: {} [e2e-llm-inference-service] f:trafficPolicy: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:tls: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:insecureSkipVerify: {} [e2e-llm-inference-service] f:mode: {} [e2e-llm-inference-service] f:sni: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] resourceVersion: '64095' [e2e-llm-inference-service] uid: 4dafa8b9-45a3-4ae1-a860-3f97d912c578 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] exportTo: [e2e-llm-inference-service] - '*' [e2e-llm-inference-service] host: scheduler-v06-pd-migration-test-kserve-workload-svc.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] trafficPolicy: [e2e-llm-inference-service] tls: [e2e-llm-inference-service] insecureSkipVerify: true [e2e-llm-inference-service] mode: SIMPLE [e2e-llm-inference-service] sni: scheduler-v06-pd-migration-test-kserve-workload-svc.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: networking.istio.io/v1beta1 [e2e-llm-inference-service] kind: DestinationRule [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] llm-d.ai/managed: 'true' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:llm-d.ai/managed: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exportTo: {} [e2e-llm-inference-service] f:host: {} [e2e-llm-inference-service] f:trafficPolicy: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:tls: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:insecureSkipVerify: {} [e2e-llm-inference-service] f:mode: {} [e2e-llm-inference-service] f:sni: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-scheduler [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] resourceVersion: '64090' [e2e-llm-inference-service] uid: f7649796-f410-4f8e-87ff-196a786f3d17 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] exportTo: [e2e-llm-inference-service] - '*' [e2e-llm-inference-service] host: scheduler-v06-pd-migration-test-epp-service.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] trafficPolicy: [e2e-llm-inference-service] tls: [e2e-llm-inference-service] insecureSkipVerify: true [e2e-llm-inference-service] mode: SIMPLE [e2e-llm-inference-service] sni: scheduler-v06-pd-migration-test-epp-service.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: networking.istio.io/v1beta1 [e2e-llm-inference-service] kind: DestinationRule [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:35Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-shadow-service [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] llm-d.ai/managed: 'true' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:llm-d.ai/managed: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exportTo: {} [e2e-llm-inference-service] f:host: {} [e2e-llm-inference-service] f:trafficPolicy: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:tls: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:insecureSkipVerify: {} [e2e-llm-inference-service] f:mode: {} [e2e-llm-inference-service] f:sni: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-08T17:35:35Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-shadow-svc [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] resourceVersion: '64544' [e2e-llm-inference-service] uid: 4c205d9f-5dae-4763-a542-8fbf16b121b1 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] exportTo: [e2e-llm-inference-service] - '*' [e2e-llm-inference-service] host: scheduler-v06-pd-migration-test-inference-pool-ip-2bbd07cf.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] trafficPolicy: [e2e-llm-inference-service] tls: [e2e-llm-inference-service] insecureSkipVerify: true [e2e-llm-inference-service] mode: SIMPLE [e2e-llm-inference-service] sni: scheduler-v06-pd-migration-test-kserve-workload-svc.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: networking.istio.io/v1beta1 [e2e-llm-inference-service] kind: DestinationRule [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] llm-d.ai/managed: 'true' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:llm-d.ai/managed: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exportTo: {} [e2e-llm-inference-service] f:host: {} [e2e-llm-inference-service] f:trafficPolicy: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:tls: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:insecureSkipVerify: {} [e2e-llm-inference-service] f:mode: {} [e2e-llm-inference-service] f:sni: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] resourceVersion: '64095' [e2e-llm-inference-service] uid: 4dafa8b9-45a3-4ae1-a860-3f97d912c578 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] exportTo: [e2e-llm-inference-service] - '*' [e2e-llm-inference-service] host: scheduler-v06-pd-migration-test-kserve-workload-svc.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] trafficPolicy: [e2e-llm-inference-service] tls: [e2e-llm-inference-service] insecureSkipVerify: true [e2e-llm-inference-service] mode: SIMPLE [e2e-llm-inference-service] sni: scheduler-v06-pd-migration-test-kserve-workload-svc.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: networking.istio.io/v1alpha3 [e2e-llm-inference-service] kind: DestinationRule [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] llm-d.ai/managed: 'true' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:llm-d.ai/managed: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exportTo: {} [e2e-llm-inference-service] f:host: {} [e2e-llm-inference-service] f:trafficPolicy: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:tls: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:insecureSkipVerify: {} [e2e-llm-inference-service] f:mode: {} [e2e-llm-inference-service] f:sni: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-scheduler [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] resourceVersion: '64090' [e2e-llm-inference-service] uid: f7649796-f410-4f8e-87ff-196a786f3d17 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] exportTo: [e2e-llm-inference-service] - '*' [e2e-llm-inference-service] host: scheduler-v06-pd-migration-test-epp-service.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] trafficPolicy: [e2e-llm-inference-service] tls: [e2e-llm-inference-service] insecureSkipVerify: true [e2e-llm-inference-service] mode: SIMPLE [e2e-llm-inference-service] sni: scheduler-v06-pd-migration-test-epp-service.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: networking.istio.io/v1alpha3 [e2e-llm-inference-service] kind: DestinationRule [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:35Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-shadow-service [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] llm-d.ai/managed: 'true' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:llm-d.ai/managed: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exportTo: {} [e2e-llm-inference-service] f:host: {} [e2e-llm-inference-service] f:trafficPolicy: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:tls: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:insecureSkipVerify: {} [e2e-llm-inference-service] f:mode: {} [e2e-llm-inference-service] f:sni: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-08T17:35:35Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-shadow-svc [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] resourceVersion: '64544' [e2e-llm-inference-service] uid: 4c205d9f-5dae-4763-a542-8fbf16b121b1 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] exportTo: [e2e-llm-inference-service] - '*' [e2e-llm-inference-service] host: scheduler-v06-pd-migration-test-inference-pool-ip-2bbd07cf.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] trafficPolicy: [e2e-llm-inference-service] tls: [e2e-llm-inference-service] insecureSkipVerify: true [e2e-llm-inference-service] mode: SIMPLE [e2e-llm-inference-service] sni: scheduler-v06-pd-migration-test-kserve-workload-svc.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: networking.istio.io/v1alpha3 [e2e-llm-inference-service] kind: DestinationRule [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] llm-d.ai/managed: 'true' [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: networking.istio.io/v1 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:llm-d.ai/managed: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:exportTo: {} [e2e-llm-inference-service] f:host: {} [e2e-llm-inference-service] f:trafficPolicy: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:tls: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:insecureSkipVerify: {} [e2e-llm-inference-service] f:mode: {} [e2e-llm-inference-service] f:sni: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-workload-svc [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] resourceVersion: '64095' [e2e-llm-inference-service] uid: 4dafa8b9-45a3-4ae1-a860-3f97d912c578 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] exportTo: [e2e-llm-inference-service] - '*' [e2e-llm-inference-service] host: scheduler-v06-pd-migration-test-kserve-workload-svc.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] trafficPolicy: [e2e-llm-inference-service] tls: [e2e-llm-inference-service] insecureSkipVerify: true [e2e-llm-inference-service] mode: SIMPLE [e2e-llm-inference-service] sni: scheduler-v06-pd-migration-test-kserve-workload-svc.kserve-ci-e2e-test.svc.cluster.local [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 apiVersion: inference.networking.x-k8s.io/v1alpha2 [e2e-llm-inference-service] kind: InferencePool [e2e-llm-inference-service] metadata: [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] generation: 1 [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] managedFields: [e2e-llm-inference-service] - apiVersion: inference.networking.x-k8s.io/v1alpha2 [e2e-llm-inference-service] fieldsType: FieldsV1 [e2e-llm-inference-service] fieldsV1: [e2e-llm-inference-service] f:metadata: [e2e-llm-inference-service] f:labels: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/component: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:ownerReferences: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] k:{"uid":"cbaca536-eb7a-4179-94ec-5cee56601d45"}: {} [e2e-llm-inference-service] f:spec: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:extensionRef: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:failureMode: {} [e2e-llm-inference-service] f:group: {} [e2e-llm-inference-service] f:kind: {} [e2e-llm-inference-service] f:name: {} [e2e-llm-inference-service] f:portNumber: {} [e2e-llm-inference-service] f:selector: [e2e-llm-inference-service] .: {} [e2e-llm-inference-service] f:app.kubernetes.io/name: {} [e2e-llm-inference-service] f:app.kubernetes.io/part-of: {} [e2e-llm-inference-service] f:kserve.io/component: {} [e2e-llm-inference-service] f:targetPortNumber: {} [e2e-llm-inference-service] manager: manager [e2e-llm-inference-service] operation: Update [e2e-llm-inference-service] time: '2026-07-08T17:35:20Z' [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-inference-pool [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] ownerReferences: [e2e-llm-inference-service] - apiVersion: serving.kserve.io/v1alpha2 [e2e-llm-inference-service] blockOwnerDeletion: true [e2e-llm-inference-service] controller: true [e2e-llm-inference-service] kind: LLMInferenceService [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] uid: cbaca536-eb7a-4179-94ec-5cee56601d45 [e2e-llm-inference-service] resourceVersion: '64062' [e2e-llm-inference-service] uid: c0adffc7-756d-4ef1-a9b3-2c77c7a66ea6 [e2e-llm-inference-service] spec: [e2e-llm-inference-service] extensionRef: [e2e-llm-inference-service] failureMode: FailOpen [e2e-llm-inference-service] group: '' [e2e-llm-inference-service] kind: Service [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-epp-service [e2e-llm-inference-service] portNumber: 9002 [e2e-llm-inference-service] selector: [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] targetPortNumber: 8000 [e2e-llm-inference-service] status: [e2e-llm-inference-service] parent: [e2e-llm-inference-service] - conditions: [e2e-llm-inference-service] - lastTransitionTime: '1970-01-01T00:00:00Z' [e2e-llm-inference-service] message: Waiting for controller [e2e-llm-inference-service] reason: Pending [e2e-llm-inference-service] status: Unknown [e2e-llm-inference-service] type: Accepted [e2e-llm-inference-service] parentRef: [e2e-llm-inference-service] group: gateway.networking.k8s.io [e2e-llm-inference-service] kind: Status [e2e-llm-inference-service] name: default [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:54:19Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: decode [e2e-llm-inference-service] pod-template-hash: 5c87756974 [e2e-llm-inference-service] timestamp: '2026-07-08T17:53:50Z' [e2e-llm-inference-service] window: 12.328s [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] usage: [e2e-llm-inference-service] cpu: 17180889n [e2e-llm-inference-service] memory: 24860Ki [e2e-llm-inference-service] - name: llm-d-routing-sidecar [e2e-llm-inference-service] usage: [e2e-llm-inference-service] cpu: 11034163n [e2e-llm-inference-service] memory: 19592Ki [e2e-llm-inference-service] apiVersion: metrics.k8s.io/v1beta1 [e2e-llm-inference-service] kind: PodMetrics [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46 [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:54:19Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-workload-prefill [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] kserve.io/component: workload [e2e-llm-inference-service] llm-d.ai/role: prefill [e2e-llm-inference-service] pod-template-hash: 78b7f4c847 [e2e-llm-inference-service] timestamp: '2026-07-08T17:54:00Z' [e2e-llm-inference-service] window: 17.858s [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] usage: [e2e-llm-inference-service] cpu: 18802609n [e2e-llm-inference-service] memory: 26316Ki [e2e-llm-inference-service] apiVersion: metrics.k8s.io/v1beta1 [e2e-llm-inference-service] kind: PodMetrics [e2e-llm-inference-service] [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1254 --- [e2e-llm-inference-service] INFO e2e.llmisvc.logging:test_llm_inference_service.py:1255 metadata: [e2e-llm-inference-service] name: scheduler-v06-pd-migration-test-kserve-router-scheduler-595ls74 [e2e-llm-inference-service] namespace: kserve-ci-e2e-test [e2e-llm-inference-service] creationTimestamp: '2026-07-08T17:54:19Z' [e2e-llm-inference-service] labels: [e2e-llm-inference-service] app.kubernetes.io/component: llminferenceservice-router-scheduler [e2e-llm-inference-service] app.kubernetes.io/name: scheduler-v06-pd-migration-test [e2e-llm-inference-service] app.kubernetes.io/part-of: llminferenceservice [e2e-llm-inference-service] pod-template-hash: 59dc679cd [e2e-llm-inference-service] timestamp: '2026-07-08T17:53:56Z' [e2e-llm-inference-service] window: 17.436s [e2e-llm-inference-service] containers: [e2e-llm-inference-service] - name: main [e2e-llm-inference-service] usage: [e2e-llm-inference-service] cpu: 17023571n [e2e-llm-inference-service] memory: 32220Ki [e2e-llm-inference-service] apiVersion: metrics.k8s.io/v1beta1 [e2e-llm-inference-service] kind: PodMetrics [e2e-llm-inference-service] [e2e-llm-inference-service] ERROR e2e.llmisvc.logging:logging.py:48 [test_llm_inference_service] [2026-07-08T17:54:19.416476] end - ❌ 1157.754s: Service returned 502: [e2e-llm-inference-service] =============================== warnings summary =============================== [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-precise-prefix-cache-inline-config-workload-llmd-simulator-kvcache] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-gateway-ref-router-with-managed-route-model-fb-opt-125m-workload-llmd-simulator] [e2e-llm-inference-service] /workspace/source/python/kserve/.venv/lib64/python3.11/site-packages/pytest_asyncio/plugin.py:761: DeprecationWarning: The event_loop fixture provided by pytest-asyncio has been redefined in [e2e-llm-inference-service] /workspace/source/test/e2e/conftest.py:43 [e2e-llm-inference-service] Replacing the event_loop fixture with a custom implementation is deprecated [e2e-llm-inference-service] and will lead to errors in the future. [e2e-llm-inference-service] If you want to request an asyncio event loop with a scope other than function [e2e-llm-inference-service] scope, use the "scope" argument to the asyncio mark when marking the tests. [e2e-llm-inference-service] If you want to return different types of event loops, use the event_loop_policy [e2e-llm-inference-service] fixture. [e2e-llm-inference-service] [e2e-llm-inference-service] warnings.warn( [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-precise-prefix-cache-inline-config-workload-llmd-simulator-kvcache] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator0] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator1] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator2] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m-with-lora-hf0] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m-with-lora-hf1] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-gateway-ref-router-with-managed-route-model-fb-opt-125m-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-pvc] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-pd-cpu-model-pvc] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-custom-route-timeout-scheduler-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-refs-scheduler-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_multi_node-router-managed-workload-simulated-dp-ep-cpu-model-pvc] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-custom-route-timeout-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service_stop.py::test_llm_stop_feature[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service_stop.py:40: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-with-refs-pd-scheduler-managed-workload-pd-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-no-scheduler-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_tls.py::test_llm_tls_resources[cluster_cpu-cluster_single_node-router-managed-workload-single-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_tls.py:93: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_multi_node-router-managed-workload-simulated-dp-ep-cpu-model-fb-opt-125m] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-inline-config-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-workload-llmd-simulator-model-qwen2.5-0.5b] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-configmap-ref-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-replicas-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-with-custom-template-workload-llmd-simulator] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-v06-pd-config-migration-workload-llmd-simulator-pd] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-v06-nonzero-threshold-migration-workload-llmd-simulator-pd] [e2e-llm-inference-service] llmisvc/test_llm_inference_service.py:245: PytestWarning: The test is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'. [e2e-llm-inference-service] @pytest.mark.llminferenceservice [e2e-llm-inference-service] [e2e-llm-inference-service] -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html [e2e-llm-inference-service] ---------- generated xml file: /workspace/artifacts-dir/junit_e2e.xml ---------- [e2e-llm-inference-service] --------------------------------- JSON report ---------------------------------- [e2e-llm-inference-service] report saved to: /workspace/artifacts-dir/e2e_results.json [e2e-llm-inference-service] =========================== short test summary info ============================ [e2e-llm-inference-service] FAILED llmisvc/test_llm_inference_service.py::test_llm_inference_service[cluster_cpu-cluster_single_node-router-managed-scheduler-v06-pd-config-migration-workload-llmd-simulator-pd] [e2e-llm-inference-service] ====== 1 failed, 41 passed, 3 skipped, 29 warnings in 4158.96s (1:09:18) ======= [must-gather] [must-gather ] OUT 2026-07-08T17:55:22.603905746Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 [must-gather] When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: [must-gather] ClusterID: fbdb0928-57e1-433e-b0d4-f6cf1e5b45cb [must-gather] ClientVersion: 4.21.10 [must-gather] ClusterVersion: Stable at "4.21.23" [must-gather] ClusterOperators: [must-gather] clusteroperator/authentication is missing [must-gather] clusteroperator/cloud-credential is missing [must-gather] clusteroperator/cluster-autoscaler is missing [must-gather] clusteroperator/config-operator is missing [must-gather] clusteroperator/etcd is missing [must-gather] clusteroperator/machine-api is missing [must-gather] clusteroperator/machine-approver is missing [must-gather] clusteroperator/machine-config is missing [must-gather] clusteroperator/marketplace is missing [must-gather] [must-gather] [must-gather] [must-gather ] OUT 2026-07-08T17:55:22.689195879Z namespace/openshift-must-gather-kv6x7 created [must-gather] [must-gather ] OUT 2026-07-08T17:55:22.695882771Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-ltw8h created [must-gather] [must-gather ] OUT 2026-07-08T17:55:22.739613101Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:29.405406653Z [disk usage checker] Started [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:29.409100154Z [disk usage checker] Volume usage percentage: current = 23 ; allowed = 70 [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:29.689029087Z Error from server (NotFound): namespaces "redhat-ods-operator" not found [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:29.863843714Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:29.863873990Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:29.863873990Z namespaces "redhat-ods-operator" not found [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:29.866520808Z Error getting logs from redhat-ods-operator [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.047020747Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.047048695Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.047048695Z namespaces "redhat-ods-monitoring" not found [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.049672800Z Error getting logs from redhat-ods-monitoring [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.223609188Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.223715106Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.223715106Z namespaces "redhat-ods-applications" not found [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.226653682Z Error getting logs from redhat-ods-applications [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.403551332Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.403600523Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.403600523Z namespaces "rhods-notebooks" not found [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.406528960Z Error getting logs from rhods-notebooks [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.573222312Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.573314491Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.573314491Z namespaces "rhoai-model-registries" not found [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.576023493Z Error getting logs from rhoai-model-registries [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.742609845Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.742637933Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.742637933Z namespaces "istio-system" not found [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.745186074Z Error getting logs from istio-system [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.915643741Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.915744226Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.915744226Z namespaces "knative-serving" not found [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:30.918417901Z Error getting logs from knative-serving [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:31.081192922Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:31.081246852Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:31.081246852Z namespaces "redhat-ods-applications-auth-provider" not found [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:31.084030396Z Error getting logs from redhat-ods-applications-auth-provider [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:31.371866624Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:31.663925975Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:31.804328469Z error: the server doesn't have a resource type "auths" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:31.888157181Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:31.890448715Z Error collecting info from [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:32.030538778Z error: the server doesn't have a resource type "monitorings" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:32.117073000Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:32.119658622Z Error collecting info from [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:32.255397706Z error: the server doesn't have a resource type "featuretrackers" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:32.338009098Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:32.340448887Z Error collecting info from [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:32.480828752Z error: the server doesn't have a resource type "codeflares" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:32.565042551Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:32.567372499Z Error collecting info from [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:32.706030924Z error: the server doesn't have a resource type "dashboards" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:32.788382852Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:32.790854806Z Error collecting info from [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:32.920883854Z error: the server doesn't have a resource type "datasciencepipelines" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:33.003133231Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:33.005768790Z Error collecting info from [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:33.141984333Z error: the server doesn't have a resource type "feastoperators" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:33.222401352Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:33.224666203Z Error collecting info from [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:33.359619522Z error: the server doesn't have a resource type "kserves" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:33.441759745Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:33.444302436Z Error collecting info from [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:33.578316371Z error: the server doesn't have a resource type "kueues" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:33.661731776Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:33.664382781Z Error collecting info from [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:33.802121762Z error: the server doesn't have a resource type "modelcontrollers" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:33.885689841Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:33.888279113Z Error collecting info from [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:34.022409387Z error: the server doesn't have a resource type "modelmeshservings" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:34.104598991Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:34.106952090Z Error collecting info from [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:34.241720375Z error: the server doesn't have a resource type "modelregistries" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:34.334465942Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:34.336829013Z Error collecting info from [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:34.413805178Z [disk usage checker] Volume usage percentage: current = 23 ; allowed = 70 [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:34.478169965Z error: the server doesn't have a resource type "rays" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:34.563019546Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:34.565242852Z Error collecting info from [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:34.716820524Z error: the server doesn't have a resource type "trainingoperators" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:34.806847733Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:34.809465704Z Error collecting info from [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:34.946764880Z error: the server doesn't have a resource type "trustyais" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:35.030980786Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:35.033451127Z Error collecting info from [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:35.166491335Z error: the server doesn't have a resource type "workbenches" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:35.248142866Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:35.251428583Z Error collecting info from [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:35.386974858Z error: the server doesn't have a resource type "hardwareprofiles" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:35.474371026Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:35.476894254Z Error collecting info from [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:35.622601379Z error: the server doesn't have a resource type "llamastackoperators" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:35.715425953Z error: arguments in resource/name form must have a single resource and name [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:35.717952260Z Error collecting info from [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:36.459397839Z error: the server doesn't have a resource type "predictors" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:36.587199334Z error: the server doesn't have a resource type "localmodelnodegroups" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:36.721017679Z error: the server doesn't have a resource type "smcp" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:36.855705881Z error: the server doesn't have a resource type "smm" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:36.992673213Z error: the server doesn't have a resource type "smmr" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:37.599280293Z error: the server doesn't have a resource type "knativeservings" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:37.733421441Z error: the server doesn't have a resource type "configurations" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:37.871918815Z error: the server doesn't have a resource type "routes" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:38.004315447Z error: the server doesn't have a resource type "services" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:38.138462096Z error: the server doesn't have a resource type "revisions" [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:38.688267097Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:39.098859854Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:39.418598122Z [disk usage checker] Volume usage percentage: current = 23 ; allowed = 70 [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:39.847689385Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:40.223098950Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:40.391069126Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:40.762410051Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:41.500287674Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:41.864828059Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:42.032117970Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:42.399619670Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:43.131299093Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:43.488819773Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:43.662026750Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:44.012370084Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:44.423335207Z [disk usage checker] Volume usage percentage: current = 23 ; allowed = 70 [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:44.733630777Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:45.092473672Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:45.262737185Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:45.640918343Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:46.364298808Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:46.715420644Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:46.885332431Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:47.407492204Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:48.162081944Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:48.540220630Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:48.710915631Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:49.077444306Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:49.428216825Z [disk usage checker] Volume usage percentage: current = 23 ; allowed = 70 [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:49.820084298Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:50.289797054Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:50.462353021Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:50.847075869Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:51.616433990Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:51.986106621Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:52.160129445Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:52.571713538Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:53.307162753Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:53.678046235Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:53.848537884Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:54.198179780Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:54.432952296Z [disk usage checker] Volume usage percentage: current = 23 ; allowed = 70 [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:54.915488502Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:55.290975451Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:55.474896845Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:55.855186426Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:56.567992043Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:56.927821689Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:57.097674330Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:57.454947651Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:58.167360685Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:58.517175176Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:58.694017829Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:59.058660970Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:59.440339749Z [disk usage checker] Volume usage percentage: current = 23 ; allowed = 70 [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:55:59.773150733Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:00.149883850Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:00.315789016Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:00.661387395Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:01.375372522Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:01.767198321Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:01.939174523Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:02.300203525Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:03.032300067Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:03.379182549Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:03.546790806Z Gathering data for ns/kserve-ci-e2e-test... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:03.932056805Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:04.448807267Z [disk usage checker] Volume usage percentage: current = 23 ; allowed = 70 [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:04.638229797Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:04.988399847Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:05.157161256Z Gathering data for ns/openshift-ingress... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:05.876889401Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:06.048024449Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:06.429768529Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:06.599315440Z Gathering data for ns/openshift-ingress... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:07.299190250Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:07.477939890Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:07.864463733Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:08.037032760Z Gathering data for ns/openshift-ingress... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:08.816503818Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:09.007406576Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:09.397363572Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:09.453946797Z [disk usage checker] Volume usage percentage: current = 23 ; allowed = 70 [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:09.575734921Z Gathering data for ns/openshift-ingress... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:10.310623393Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:10.502962430Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:10.906861984Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:11.078816544Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:11.708995026Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:11.923006650Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:12.338224921Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:12.520071377Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:13.133946942Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:13.351811145Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:13.767454570Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:13.936880378Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:14.458923888Z [disk usage checker] Volume usage percentage: current = 23 ; allowed = 70 [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:14.633733416Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:14.845183008Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:15.266895811Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:15.448493113Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:16.193036142Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:16.422103318Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:16.834778747Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:17.021308037Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:17.793487738Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:17.995677130Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:18.413979418Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:18.591113284Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:19.191827321Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:19.381946954Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:19.466034845Z [disk usage checker] Volume usage percentage: current = 23 ; allowed = 70 [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:19.805759794Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:19.976657016Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:20.572218954Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:20.760368148Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:21.172987716Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:21.350723706Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:21.934992387Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:22.146054366Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:22.571546767Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:22.745772569Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:23.320220564Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:23.518176330Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:23.926951808Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:24.101738060Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:24.471180339Z [disk usage checker] Volume usage percentage: current = 23 ; allowed = 70 [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:24.672601321Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:24.863758815Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:25.273321894Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:25.445502420Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:26.014252769Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:26.209316985Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:26.625187208Z Wrote inspect data to must-gather. [must-gather] [must-gather-xgt5x] POD 2026-07-08T17:56:26.655914265Z Caches written to disk [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.663657492Z waiting for gather to complete [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.666683876Z downloading gather output [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.952628868Z receiving incremental file list [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.970821763Z ./ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.970921339Z aggregated-discovery-api.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.974100661Z aggregated-discovery-apis.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.975185139Z event-filter.html [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.977932548Z timestamp [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.978081756Z version [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.978537681Z cluster-scoped-resources/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.978552652Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.978558612Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.978588524Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.978671908Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.978689679Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.978714681Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.978801675Z namespaces/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.978811386Z namespaces/kserve-ci-e2e-test/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.978857548Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.978936133Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.978991186Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.979060539Z namespaces/kserve-ci-e2e-test/apps/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.979104872Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.979241489Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.97962915Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.980017951Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.980058203Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.980090845Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.980144398Z namespaces/kserve-ci-e2e-test/batch/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.980214002Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.980291736Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.98036429Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.980415033Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.980496087Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.98054324Z namespaces/kserve-ci-e2e-test/core/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.980593982Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.980717319Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.980813864Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.986213137Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.986303501Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.986665431Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.986798228Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.987053602Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.987127266Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.987174248Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.987281064Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.987326497Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.987365559Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.987405331Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.987500546Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.987543348Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.987632693Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.98776288Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.987819554Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.987882987Z namespaces/kserve-ci-e2e-test/pods/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.987890317Z namespaces/kserve-ci-e2e-test/pods/e2e-pvc-model-download-bsd5v/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.98794406Z namespaces/kserve-ci-e2e-test/pods/e2e-pvc-model-download-bsd5v/e2e-pvc-model-download-bsd5v.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.988097559Z namespaces/kserve-ci-e2e-test/pods/e2e-pvc-model-download-bsd5v/storage-initializer/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.988107149Z namespaces/kserve-ci-e2e-test/pods/e2e-pvc-model-download-bsd5v/storage-initializer/storage-initializer/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.988111709Z namespaces/kserve-ci-e2e-test/pods/e2e-pvc-model-download-bsd5v/storage-initializer/storage-initializer/logs/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.988145021Z namespaces/kserve-ci-e2e-test/pods/e2e-pvc-model-download-bsd5v/storage-initializer/storage-initializer/logs/current.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.9883047Z namespaces/kserve-ci-e2e-test/pods/e2e-pvc-model-download-bsd5v/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.988404485Z namespaces/kserve-ci-e2e-test/pods/e2e-pvc-model-download-bsd5v/storage-initializer/storage-initializer/logs/previous.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.988435337Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-54c47cdfc7-rxfpz/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.988502691Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-54c47cdfc7-rxfpz/router-gateway-1-openshift-default-54c47cdfc7-rxfpz.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.988635948Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-54c47cdfc7-rxfpz/istio-proxy/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.988647088Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-54c47cdfc7-rxfpz/istio-proxy/istio-proxy/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.988651969Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-54c47cdfc7-rxfpz/istio-proxy/istio-proxy/logs/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.98867224Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-54c47cdfc7-rxfpz/istio-proxy/istio-proxy/logs/current.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.988913683Z namespaces/kserve-ci-e2e-test/pods/router-gateway-1-openshift-default-54c47cdfc7-rxfpz/istio-proxy/istio-proxy/logs/previous.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.989015818Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-684dc9b4b9-h2x2d/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.989065791Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-684dc9b4b9-h2x2d/router-gateway-2-openshift-default-684dc9b4b9-h2x2d.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.989193328Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-684dc9b4b9-h2x2d/istio-proxy/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.989205779Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-684dc9b4b9-h2x2d/istio-proxy/istio-proxy/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.989210489Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-684dc9b4b9-h2x2d/istio-proxy/istio-proxy/logs/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.989258092Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-684dc9b4b9-h2x2d/istio-proxy/istio-proxy/logs/current.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.989396539Z namespaces/kserve-ci-e2e-test/pods/router-gateway-2-openshift-default-684dc9b4b9-h2x2d/istio-proxy/istio-proxy/logs/previous.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.989490844Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.989530136Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx/scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.989663223Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx/llm-d-routing-sidecar/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.989675504Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx/llm-d-routing-sidecar/llm-d-routing-sidecar/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.989682064Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx/llm-d-routing-sidecar/llm-d-routing-sidecar/logs/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.989702856Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx/llm-d-routing-sidecar/llm-d-routing-sidecar/logs/current.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.990005632Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx/llm-d-routing-sidecar/llm-d-routing-sidecar/logs/previous.insecure.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.990080986Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx/llm-d-routing-sidecar/llm-d-routing-sidecar/logs/previous.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.990103867Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx/main/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.990112788Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx/main/main/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.990123138Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx/main/main/logs/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.990185542Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx/main/main/logs/current.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.990560362Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx/main/main/logs/previous.insecure.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.990632906Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-5c87756974-tqwvx/main/main/logs/previous.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.990665078Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.990705Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.990793725Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46/main/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.990802325Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46/main/main/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.990806895Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46/main/main/logs/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.990832837Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46/main/main/logs/current.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.990958453Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46/main/main/logs/previous.insecure.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.991024137Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46/main/main/logs/previous.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.991065969Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-router-scheduler-595ls74/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.991095761Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-router-scheduler-595ls74/scheduler-v06-pd-migration-test-kserve-router-scheduler-595ls74.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.991228668Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-router-scheduler-595ls74/main/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.991244919Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-router-scheduler-595ls74/main/main/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.991251409Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-router-scheduler-595ls74/main/main/logs/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.99126639Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-router-scheduler-595ls74/main/main/logs/current.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.991836621Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-router-scheduler-595ls74/main/main/logs/previous.insecure.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.991908425Z namespaces/kserve-ci-e2e-test/pods/scheduler-v06-pd-migration-test-kserve-router-scheduler-595ls74/main/main/logs/previous.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.991962348Z namespaces/kserve-ci-e2e-test/policy/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.992016591Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.992078774Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.992132537Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.992219792Z namespaces/kuadrant-system/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.992294486Z namespaces/kuadrant-system/kuadrant-system.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.99236472Z namespaces/kuadrant-system/apps.openshift.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.992421233Z namespaces/kuadrant-system/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.992461285Z namespaces/kuadrant-system/apps/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.992517458Z namespaces/kuadrant-system/apps/daemonsets.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.992606293Z namespaces/kuadrant-system/apps/deployments.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.992954922Z namespaces/kuadrant-system/apps/replicasets.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.99328884Z namespaces/kuadrant-system/apps/statefulsets.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.993365614Z namespaces/kuadrant-system/autoscaling/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.993414246Z namespaces/kuadrant-system/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.9934842Z namespaces/kuadrant-system/batch/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.993534943Z namespaces/kuadrant-system/batch/cronjobs.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.993643329Z namespaces/kuadrant-system/batch/jobs.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.993695072Z namespaces/kuadrant-system/build.openshift.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.993756855Z namespaces/kuadrant-system/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.993857361Z namespaces/kuadrant-system/build.openshift.io/builds.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.993916094Z namespaces/kuadrant-system/core/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.993968196Z namespaces/kuadrant-system/core/configmaps.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.994155477Z namespaces/kuadrant-system/core/endpoints.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.994361398Z namespaces/kuadrant-system/core/events.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.994889236Z namespaces/kuadrant-system/core/persistentvolumeclaims.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.994988622Z namespaces/kuadrant-system/core/pods.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.995400694Z namespaces/kuadrant-system/core/replicationcontrollers.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.995542172Z namespaces/kuadrant-system/core/secrets.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.995774904Z namespaces/kuadrant-system/core/services.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.995917662Z namespaces/kuadrant-system/discovery.k8s.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.995970235Z namespaces/kuadrant-system/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.996093562Z namespaces/kuadrant-system/image.openshift.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.996144434Z namespaces/kuadrant-system/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.996225619Z namespaces/kuadrant-system/k8s.ovn.org/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.996282242Z namespaces/kuadrant-system/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.996379847Z namespaces/kuadrant-system/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.99643866Z namespaces/kuadrant-system/monitoring.coreos.com/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.996497213Z namespaces/kuadrant-system/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.996566957Z namespaces/kuadrant-system/networking.k8s.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.996608679Z namespaces/kuadrant-system/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.996676273Z namespaces/kuadrant-system/pods/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.996683614Z namespaces/kuadrant-system/pods/authorino-7c77957575-lkzck/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.996726846Z namespaces/kuadrant-system/pods/authorino-7c77957575-lkzck/authorino-7c77957575-lkzck.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.996820331Z namespaces/kuadrant-system/pods/authorino-7c77957575-lkzck/authorino/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.996832042Z namespaces/kuadrant-system/pods/authorino-7c77957575-lkzck/authorino/authorino/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.996837052Z namespaces/kuadrant-system/pods/authorino-7c77957575-lkzck/authorino/authorino/logs/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:27.996865264Z namespaces/kuadrant-system/pods/authorino-7c77957575-lkzck/authorino/authorino/logs/current.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.000628367Z namespaces/kuadrant-system/pods/authorino-7c77957575-lkzck/authorino/authorino/logs/previous.insecure.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.000713932Z namespaces/kuadrant-system/pods/authorino-7c77957575-lkzck/authorino/authorino/logs/previous.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.000754824Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-hp27q/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.000805397Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-hp27q/authorino-operator-6d85f6564-hp27q.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.000921403Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-hp27q/manager/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.000931134Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-hp27q/manager/manager/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.000936194Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-hp27q/manager/manager/logs/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.000990497Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-hp27q/manager/manager/logs/current.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.001258801Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-hp27q/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.001356757Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-hp27q/manager/manager/logs/previous.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.001379818Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-dx5b4/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.001456262Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-dx5b4/dns-operator-controller-manager-65b49595d7-dx5b4.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.001559107Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-dx5b4/manager/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.001568468Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-dx5b4/manager/manager/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.001573738Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-dx5b4/manager/manager/logs/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.001629231Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-dx5b4/manager/manager/logs/current.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.001760689Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-dx5b4/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.001836982Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-dx5b4/manager/manager/logs/previous.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.001881475Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-28qld/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.001931608Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-28qld/kuadrant-console-plugin-85fd4b8b9d-28qld.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.002021352Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-28qld/kuadrant-console-plugin/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.002029633Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-28qld/kuadrant-console-plugin/kuadrant-console-plugin/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.002033733Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-28qld/kuadrant-console-plugin/kuadrant-console-plugin/logs/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.002091646Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-28qld/kuadrant-console-plugin/kuadrant-console-plugin/logs/current.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.002201812Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-28qld/kuadrant-console-plugin/kuadrant-console-plugin/logs/previous.insecure.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.002316939Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-28qld/kuadrant-console-plugin/kuadrant-console-plugin/logs/previous.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.002356251Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-tldlw/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.002429845Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-tldlw/kuadrant-operator-controller-manager-bb7ddb7d7-tldlw.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.002551121Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-tldlw/manager/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.002559342Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-tldlw/manager/manager/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.002563342Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-tldlw/manager/manager/logs/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.002616615Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-tldlw/manager/manager/logs/current.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.009587592Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-tldlw/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.009671347Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-tldlw/manager/manager/logs/previous.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.009720749Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-gxr6q/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.009780573Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-gxr6q/limitador-limitador-69574b596d-gxr6q.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.009874758Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-gxr6q/limitador/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.009884898Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-gxr6q/limitador/limitador/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.009890269Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-gxr6q/limitador/limitador/logs/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.009936641Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-gxr6q/limitador/limitador/logs/current.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.010044917Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-gxr6q/limitador/limitador/logs/previous.insecure.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.010152803Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-gxr6q/limitador/limitador/logs/previous.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.010218607Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-kh4pg/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.01027962Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-kh4pg/limitador-operator-controller-manager-6f9f468797-kh4pg.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.010420557Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-kh4pg/manager/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.010428968Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-kh4pg/manager/manager/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.010433038Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-kh4pg/manager/manager/logs/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.010488121Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-kh4pg/manager/manager/logs/current.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.010636249Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-kh4pg/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.010719814Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-kh4pg/manager/manager/logs/previous.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.010773197Z namespaces/kuadrant-system/policy/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.01083488Z namespaces/kuadrant-system/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.010906114Z namespaces/kuadrant-system/route.openshift.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.010965547Z namespaces/kuadrant-system/route.openshift.io/routes.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.01102738Z namespaces/openshift-ingress/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.011095924Z namespaces/openshift-ingress/openshift-ingress.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.011181759Z namespaces/openshift-ingress/apps.openshift.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.011242972Z namespaces/openshift-ingress/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.011308075Z namespaces/openshift-ingress/apps/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.011357828Z namespaces/openshift-ingress/apps/daemonsets.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.011457603Z namespaces/openshift-ingress/apps/deployments.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.011730328Z namespaces/openshift-ingress/apps/replicasets.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.011931359Z namespaces/openshift-ingress/apps/statefulsets.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.011994203Z namespaces/openshift-ingress/autoscaling/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.012049055Z namespaces/openshift-ingress/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.01212705Z namespaces/openshift-ingress/batch/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.012213574Z namespaces/openshift-ingress/batch/cronjobs.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.012343141Z namespaces/openshift-ingress/batch/jobs.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.012401654Z namespaces/openshift-ingress/build.openshift.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.012469008Z namespaces/openshift-ingress/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.012566574Z namespaces/openshift-ingress/build.openshift.io/builds.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.012629347Z namespaces/openshift-ingress/core/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.01269022Z namespaces/openshift-ingress/core/configmaps.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.01324505Z namespaces/openshift-ingress/core/endpoints.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.013384348Z namespaces/openshift-ingress/core/events.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.013643652Z namespaces/openshift-ingress/core/persistentvolumeclaims.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.013745537Z namespaces/openshift-ingress/core/pods.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.014074135Z namespaces/openshift-ingress/core/replicationcontrollers.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.014272186Z namespaces/openshift-ingress/core/secrets.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.014472197Z namespaces/openshift-ingress/core/services.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.014555741Z namespaces/openshift-ingress/discovery.k8s.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.014601794Z namespaces/openshift-ingress/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.014673018Z namespaces/openshift-ingress/image.openshift.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.01470963Z namespaces/openshift-ingress/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.014785824Z namespaces/openshift-ingress/k8s.ovn.org/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.014800255Z namespaces/openshift-ingress/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.014891949Z namespaces/openshift-ingress/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.014935802Z namespaces/openshift-ingress/monitoring.coreos.com/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.014979084Z namespaces/openshift-ingress/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.015052568Z namespaces/openshift-ingress/networking.k8s.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.015108101Z namespaces/openshift-ingress/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.015290101Z namespaces/openshift-ingress/pods/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.015303162Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.015341694Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/istiod-openshift-gateway-94bb8fbfd-5kc7r.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.015471131Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/discovery/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.015478411Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/discovery/discovery/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.015482921Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/discovery/discovery/logs/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.015529504Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/discovery/discovery/logs/current.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.031450276Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/discovery/discovery/logs/previous.insecure.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.03151608Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/discovery/discovery/logs/previous.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.031540341Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.031608134Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.031742392Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/istio-proxy/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.031771123Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/istio-proxy/istio-proxy/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.031778244Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/istio-proxy/istio-proxy/logs/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.031793925Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/istio-proxy/istio-proxy/logs/current.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.032708494Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/istio-proxy/istio-proxy/logs/previous.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.032788118Z namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.032831351Z namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router-default-5658d689b9-4zvzx.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.032948387Z namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.032956978Z namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router/router/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.032965238Z namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router/router/logs/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.032992029Z namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router/router/logs/current.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.033100875Z namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router/router/logs/previous.insecure.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.03319128Z namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router/router/logs/previous.log [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.033216372Z namespaces/openshift-ingress/policy/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.033267074Z namespaces/openshift-ingress/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.033322317Z namespaces/openshift-ingress/route.openshift.io/ [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.033382521Z namespaces/openshift-ingress/route.openshift.io/routes.yaml [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.039885553Z [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.039904454Z sent 3,439 bytes received 1,064,236 bytes 711,783.33 bytes/sec [must-gather] [must-gather-xgt5x] OUT 2026-07-08T17:56:28.039910354Z total size is 13,712,382 speedup is 12.84 [must-gather] [must-gather ] OUT 2026-07-08T17:56:28.292536342Z namespace/openshift-must-gather-kv6x7 deleted [must-gather] [must-gather] [must-gather] Reprinting Cluster State: [must-gather] When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: [must-gather] ClusterID: fbdb0928-57e1-433e-b0d4-f6cf1e5b45cb [must-gather] ClientVersion: 4.21.10 [must-gather] ClusterVersion: Stable at "4.21.23" [must-gather] ClusterOperators: [must-gather] clusteroperator/authentication is missing [must-gather] clusteroperator/cloud-credential is missing [must-gather] clusteroperator/cluster-autoscaler is missing [must-gather] clusteroperator/config-operator is missing [must-gather] clusteroperator/etcd is missing [must-gather] clusteroperator/machine-api is missing [must-gather] clusteroperator/machine-approver is missing [must-gather] clusteroperator/machine-config is missing [must-gather] clusteroperator/marketplace is missing [must-gather] [must-gather] [must-gather] [must-gather ] OUT 2026-07-08T17:56:28.408156823Z Using must-gather plug-in image: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ba272a129f91bab6ed70a10b041d49836b63538fa2cbaa919e53a4a13fe3dcde [must-gather] When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: [must-gather] ClusterID: fbdb0928-57e1-433e-b0d4-f6cf1e5b45cb [must-gather] ClientVersion: 4.21.10 [must-gather] ClusterVersion: Stable at "4.21.23" [must-gather] ClusterOperators: [must-gather] clusteroperator/authentication is missing [must-gather] clusteroperator/cloud-credential is missing [must-gather] clusteroperator/cluster-autoscaler is missing [must-gather] clusteroperator/config-operator is missing [must-gather] clusteroperator/etcd is missing [must-gather] clusteroperator/machine-api is missing [must-gather] clusteroperator/machine-approver is missing [must-gather] clusteroperator/machine-config is missing [must-gather] clusteroperator/marketplace is missing [must-gather] [must-gather] [must-gather] [must-gather ] OUT 2026-07-08T17:56:28.429959233Z namespace/openshift-must-gather-wf794 created [must-gather] [must-gather ] OUT 2026-07-08T17:56:28.438362758Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-28kw9 created [must-gather] [must-gather ] OUT 2026-07-08T17:56:28.461834059Z pod for plug-in image quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ba272a129f91bab6ed70a10b041d49836b63538fa2cbaa919e53a4a13fe3dcde created [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:29.828858715Z [disk usage checker] Started [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:29.832464373Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:30.058749072Z Gathering data for ns/openshift-cluster-version... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:30.250049536Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:30.368261613Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:30.474080557Z Gathering data for ns/default... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:30.851738778Z Gathering data for ns/openshift... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:31.354516884Z Gathering data for ns/kube-system... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.221774088Z Gathering data for ns/openshift-etcd... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.622299435Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.622450397Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.622450397Z namespaces "assisted-installer" not found [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.762250825Z Waiting on subprocesses to finish execution. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.771177865Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.771970096Z INFO: Gathering HAProxy config files [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.780597662Z INFO: Gathering machine config daemon's old logs from all nodes [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.785077366Z Executing Istio gather script [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.798292694Z INFO: Gathering on-disk MachineConfig from degraded nodes [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.807848242Z INFO: Collecting host service logs for crio [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.808161376Z INFO: Collecting host service logs for kubelet [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.808467794Z INFO: Collecting host service logs for rpm-ostreed [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.808869817Z INFO: Collecting host service logs for ostree-finalize-staged [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.809174648Z INFO: Collecting host service logs for machine-config-daemon-firstboot [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.809468006Z INFO: Collecting host service logs for machine-config-daemon-host [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.809812838Z INFO: Collecting host service logs for NetworkManager [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.810343967Z INFO: Collecting host service logs for openvswitch [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.814749113Z INFO: Collecting host service logs for ovs-configuration [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.815096796Z INFO: Collecting host service logs for ovsdb-server [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.815428356Z INFO: Collecting host service logs for ovs-vswitchd [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:32.815839153Z INFO: Waiting for worker host service log collection to complete ... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:33.092933193Z INFO: Waiting for node performance related collection to complete ... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:33.420792783Z No resources found in openshift-etcd namespace. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:33.781638170Z INFO: "metallb-operator" not detected. Skipping. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:33.816410531Z INFO: Found 1 replicas - prometheus-k8s-0 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:33.837089229Z INFO: "sriov-network-operator" not detected. Skipping. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:34.170248747Z No resources found [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:34.327533008Z INFO: namespace openshift-frr-k8s not detected. Skipping. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:34.395736202Z INFO: Waiting for on-disk MachineConfig collection to complete ... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:34.395826017Z INFO: on-disk MachineConfig config collection complete. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:34.423251416Z INFO: Collecting Insights Archives from insights-operator-5c847dcfc4-jcfjt [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:34.423292821Z insights-runtime-extractor-24ccq [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:34.423312979Z insights-runtime-extractor-nk8jb [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:34.423342919Z insights-runtime-extractor-t9d9h [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:34.665859518Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:34.723973405Z error: the server doesn't have a resource type "performanceprofile" [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:34.805863142Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:34.835526552Z INFO: Getting alertmanagers from prometheus-k8s-0 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:34.976576937Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:35.149964515Z INFO: Worker host service log collection to complete. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:35.186077045Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:35.193979705Z Gathering data for ns/kuadrant-system... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:35.239615274Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:35.239615274Z See 'oc rsync -h' for help and examples [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:35.280317942Z Inspecting resource clusterrole.rbac.authorization.k8s.io/istio-reader-clusterrole-openshift-gateway-openshift-ingress [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:35.391157730Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:35.439007336Z INFO: Waiting for HAProxy config collection to complete ... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:35.445410711Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:35.560954464Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:35.908844007Z error: the server doesn't have a resource type "multi-networkpolicy" [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:36.088989721Z ERROR: No running kube-apiserver pods found [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:36.154008788Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:36.188983186Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:36.248667705Z INFO: 'previous-logs' folder not found on ip-10-0-128-142.ec2.internal, skipping... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:36.264461629Z No resources found [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:36.402417925Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:36.406184911Z Inspecting resource clusterrole.rbac.authorization.k8s.io/istiod-clusterrole-openshift-gateway-openshift-ingress [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:36.425819145Z INFO: Getting rules from prometheus-k8s-0 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:36.497399550Z tar: Removing leading `/' from member names [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:36.504360254Z INFO: HAProxy config collection complete. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:36.527331053Z error: the server doesn't have a resource type "machineconfigs" [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:36.570650376Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:36.794961776Z INFO: 'previous-logs' folder not found on ip-10-0-130-182.ec2.internal, skipping... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:36.809902540Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:36.855079643Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:36.873211821Z Inspecting resource clusterrole.rbac.authorization.k8s.io/istiod-gateway-controller-openshift-gateway-openshift-ingress [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:36.881990478Z error: the server doesn't have a resource type "machineconfigpools" [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:37.063265426Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:37.196086331Z INFO: Getting status/config from prometheus-k8s-0 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:37.323198861Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:37.332442329Z Inspecting resource clusterrolebinding.rbac.authorization.k8s.io/istio-reader-clusterrole-openshift-gateway-openshift-ingress [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:37.462131033Z INFO: 'previous-logs' folder not found on ip-10-0-142-172.ec2.internal, skipping... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:37.462243873Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:37.462294678Z INFO: Machine Config Daemon termination log collection complete. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:37.483194269Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:37.498802692Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:37.501276443Z Gathering data for ns/openshift-monitoring... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:37.544974930Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:37.748068787Z error: the server doesn't have a resource type "kubeletconfigs" [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:37.803140868Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:37.816733664Z Inspecting resource clusterrolebinding.rbac.authorization.k8s.io/istiod-clusterrole-openshift-gateway-openshift-ingress [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:37.843645804Z INFO: Getting status/flags from prometheus-k8s-0 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:37.940856109Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.102482497Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.154334394Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.163065715Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.166240115Z Inspecting resource clusterrolebinding.rbac.authorization.k8s.io/istiod-gateway-controller-openshift-gateway-openshift-ingress [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.341825151Z INFO: INTERCONNECT MODE [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.341908273Z INFO: Gathering ovn-kubernetes DBs [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.431850877Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.465113020Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.481289107Z INFO: Getting targets?state=active from prometheus-k8s-0 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.532802806Z INFO: Gathering OVN_Northbound from ovnkube-node-gb8xd... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.533277345Z INFO: Gathering OVN_Northbound from ovnkube-node-jxfhc... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.533557202Z INFO: Gathering OVN_Northbound from ovnkube-node-rqpfq... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.533881809Z INFO: Gathering OVN_Southbound from ovnkube-node-gb8xd... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.534155381Z INFO: Gathering OVN_Southbound from ovnkube-node-jxfhc... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.534535352Z INFO: Gathering OVN_Southbound from ovnkube-node-rqpfq... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.838784308Z tar: Removing leading `/' from member names [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.868531617Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.927811850Z tar: Removing leading `/' from member names [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.939820727Z tar: Removing leading `/' from member names [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.963587494Z tar: Removing leading `/' from member names [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.964574724Z INFO: Getting status/tsdb from prometheus-k8s-0 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:38.978469385Z tar: Removing leading `/' from member names [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:39.012396343Z tar: Removing leading `/' from member names [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:39.208486417Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:39.534863486Z INFO: Getting status from alertmanager-main-0 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:39.591011345Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:39.656236542Z INFO: Waiting for network log collection to complete ... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:39.656281805Z INFO: Waiting for ovnk database copies to complete ... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:39.656877537Z INFO: Copying ovnk databases complete. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:39.660070190Z 7.1M must-gather/network_logs/ovnk_database_store [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:39.664273214Z ovnk_database_store/ [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:39.664341472Z ovnk_database_store/ovnkube-node-rqpfq_nbdb [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:39.684227756Z ovnk_database_store/ovnkube-node-gb8xd_sbdb [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:39.741034730Z ovnk_database_store/ovnkube-node-jxfhc_nbdb [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:39.754846157Z ovnk_database_store/ovnkube-node-jxfhc_sbdb [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:39.792109305Z ovnk_database_store/ovnkube-node-rqpfq_sbdb [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:39.838476251Z ovnk_database_store/ovnkube-node-gb8xd_nbdb [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:39.841946225Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:39.860326620Z INFO: Network log collection complete. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:39.925424208Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:39.995612621Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:40.195096744Z W0708 17:56:40.195046 1624 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:40.207030412Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:40.448061791Z Gathering data for ns/openshift-network-console... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:40.484331827Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:40.486706454Z INFO: Fallback to identify the container image from release info [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:40.883185338Z Inspecting resource crd/authorizationpolicies.security.istio.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:40.973120485Z Gathering data for ns/openshift-console-operator... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:41.090485035Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:41.305492918Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:41.308197246Z Inspecting resource crd/destinationrules.networking.istio.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:41.455371894Z Gathering data for ns/openshift-console... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:41.560838250Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:41.778832978Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:41.782374678Z Inspecting resource crd/envoyfilters.networking.istio.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:41.984981993Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:42.084247414Z Gathering data for ns/openshift-cluster-storage-operator... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:42.228948215Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:42.231852760Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:42.410216274Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:42.622633609Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5be8cdcf34f35a89a70b6bfa49e66897641871237570b3e09766f83a0a473e6a [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:42.664462764Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:42.667337132Z Inspecting resource crd/gateways.gateway.networking.k8s.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:42.762210887Z Gathering data for ns/openshift-dns-operator... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:42.776525771Z daemonset.apps/perf-node-gather-daemonset created [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:42.924729659Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:42.948074350Z Waiting for performance profile collector pods to become ready: 1 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:43.159014386Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:43.163604877Z Inspecting resource crd/gateways.networking.istio.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:43.179249563Z Gathering data for ns/openshift-dns... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:43.365546520Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:43.578409297Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:43.580753434Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:43.777705910Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:43.943289098Z Gathering data for ns/openshift-image-registry... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:44.005271899Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:44.008161118Z Inspecting resource crd/httproutes.gateway.networking.k8s.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:44.074151276Z Waiting for performance profile collector pods to become ready: 2 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:44.244464724Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:44.461273597Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:44.463876850Z Inspecting resource crd/inferencemodelrewrites.inference.networking.x-k8s.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:44.566665578Z Gathering data for ns/openshift-ingress-operator... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:44.676511271Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:44.891762029Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:44.894347958Z Inspecting resource crd/inferenceobjectives.inference.networking.x-k8s.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:45.002646602Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:45.023201492Z Gathering data for ns/openshift-ingress... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:45.088054677Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:45.245815081Z Waiting for performance profile collector pods to become ready: 3 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:45.359334807Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:45.362420391Z Inspecting resource crd/inferencepoolimports.inference.networking.x-k8s.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:45.577468920Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:45.795414585Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:45.798014963Z Inspecting resource crd/inferencepools.inference.networking.k8s.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:45.983344461Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:46.160524921Z Gathering data for ns/openshift-ingress-canary... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:46.204909338Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:46.207926599Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:46.423112527Z Waiting for performance profile collector pods to become ready: 4 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:46.424469729Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:46.646324462Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:46.649264079Z Inspecting resource crd/peerauthentications.security.istio.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:46.706652445Z Gathering data for ns/openshift-insights... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:46.840696510Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:47.033792388Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:47.036894613Z Inspecting resource crd/proxyconfigs.networking.istio.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:47.230771658Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:47.452430367Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:47.460055688Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:47.578703954Z Waiting for performance profile collector pods to become ready: 5 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:47.669485421Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:47.876269908Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:47.879051908Z Inspecting resource crd/requestauthentications.security.istio.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:48.065667316Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:48.257836439Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:48.260414807Z Inspecting resource crd/serviceentries.networking.istio.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:48.443942327Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:48.653532347Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:48.656488023Z Inspecting resource crd/sidecars.networking.istio.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:48.725602856Z Waiting for performance profile collector pods to become ready: 6 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:48.870589023Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:49.084901131Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:49.087202875Z Inspecting resource crd/telemetries.telemetry.istio.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:49.280443074Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:49.475823230Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:49.478127246Z Inspecting resource crd/virtualservices.networking.istio.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:49.683353068Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:49.843196234Z Gathering data for ns/openshift-lws-operator... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:49.860703169Z Waiting for performance profile collector pods to become ready: 7 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:49.922376500Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:49.925064622Z Inspecting resource crd/wasmplugins.extensions.istio.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:50.010374218Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:50.119606423Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:50.364751581Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:50.368458553Z Inspecting resource crd/workloadentries.networking.istio.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:50.523480192Z Gathering data for ns/kserve... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:50.551939856Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:50.788344555Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:50.791507033Z Inspecting resource crd/workloadgroups.networking.istio.io [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:51.028166020Z Waiting for performance profile collector pods to become ready: 8 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:51.038719741Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:51.306736717Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:51.464922315Z Inspecting resource mutatingwebhookconfiguration.admissionregistration.k8s.io/istio-sidecar-injector-openshift-gateway-openshift-ingress [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:51.702168789Z Gathering data for ns/openshift-ingress... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:52.219377993Z Daemonset perf-node-gather-daemonset ready 3 out of 3 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:52.483293276Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:52.527831358Z Collecting performance related data for node ip-10-0-128-142.ec2.internal [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:52.535342789Z Collecting performance related data for node ip-10-0-130-182.ec2.internal [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:52.543689822Z Collecting performance related data for node ip-10-0-142-172.ec2.internal [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:52.705345764Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:52.878143998Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:53.027690785Z Inspecting resource validatingwebhookconfiguration.admissionregistration.k8s.io/istio-validator-openshift-gateway-openshift-ingress [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:53.293499073Z Gathering data for ns/openshift-ingress... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:53.555999907Z Gathering data for ns/openshift-config... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:54.099094168Z Gathering data for ns/openshift-config-managed... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:54.103865672Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:54.370126501Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:54.538581981Z Wrote inspect data to /must-gather/istio. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:54.719795026Z Gathering data for ns/openshift-kube-apiserver-operator... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:55.021695262Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:55.041310014Z Done executing Istio gather script [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:55.115279773Z Gathering data for ns/openshift-kube-apiserver... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:55.540958143Z Gathering data for ns/openshift-kube-controller-manager... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:55.962270229Z Gathering data for ns/openshift-kube-controller-manager-operator... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:56.352245790Z Gathering data for ns/openshift-kube-scheduler... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:56.700014610Z Gathering data for ns/openshift-kube-scheduler-operator... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:57.113860380Z Gathering data for ns/openshift-kube-storage-version-migrator... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:57.554451350Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:57.960293276Z Gathering data for ns/openshift-user-workload-monitoring... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:56:58.583787202Z Gathering data for ns/openshift-multus... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:00.027302333Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:00.251517975Z Gathering data for ns/openshift-ovn-kubernetes... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:01.150307909Z Collecting kubelet logs for node ip-10-0-128-142.ec2.internal [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:01.152354171Z Collecting kubelet logs for node ip-10-0-130-182.ec2.internal [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:01.154548163Z Collecting kubelet logs for node ip-10-0-142-172.ec2.internal [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:01.653183619Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-wf794 namespace [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:01.658536016Z INFO: Node performance data collection complete. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:01.948486867Z Gathering data for ns/openshift-host-network... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:02.335293705Z Gathering data for ns/openshift-network-diagnostics... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:02.937315339Z Gathering data for ns/openshift-network-node-identity... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:03.410020827Z Gathering data for ns/openshift-network-operator... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:03.851261987Z Gathering data for ns/openshift-cloud-network-config-controller... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:04.164073199Z Gathering data for ns/openshift-cluster-node-tuning-operator... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:04.811463362Z Gathering data for ns/openshift-apiserver-operator... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:05.032595632Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70 [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:05.169740338Z Gathering data for ns/openshift-apiserver... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:05.646422347Z Gathering data for ns/openshift-controller-manager-operator... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:05.970340655Z Gathering data for ns/openshift-controller-manager... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:06.293993851Z Gathering data for ns/openshift-cluster-samples-operator... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:06.998724478Z Gathering data for ns/openshift-operator-lifecycle-manager... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:07.369015594Z Gathering data for ns/openshift-service-ca-operator... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:07.733324399Z Gathering data for ns/openshift-service-ca... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:08.170660158Z Gathering data for ns/openshift-cluster-csi-drivers... [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:09.197224260Z Wrote inspect data to must-gather. [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:09.197279627Z error: inspection completed with the errors occurred while gathering data: [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:09.197279627Z skipping gathering secrets/support due to error: secrets "support" not found [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:09.329255127Z error: the server doesn't have a resource type "clusters" [must-gather] [must-gather-4m7rl] POD 2026-07-08T17:57:09.505527618Z Caches written to disk [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.51771774Z waiting for gather to complete [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.520981747Z downloading gather output [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.798883048Z receiving incremental file list [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.81883Z ./ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.818913114Z aggregated-discovery-api.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.819545409Z aggregated-discovery-apis.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.82085285Z event-filter.html [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.823648501Z timestamp [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.823892204Z version [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.830354415Z cluster-scoped-resources/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.830379836Z cluster-scoped-resources/admissionregistration.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.830412538Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicies/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.830465741Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicies/default-network-annotation.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.830595378Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicies/servicecidrs.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.830713225Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicies/user-defined-networks-namespace-label.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.830799809Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicybindings/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.830868313Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicybindings/default-network-annotation-binding.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.830967778Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicybindings/servicecidrs-binding.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.831081185Z cluster-scoped-resources/admissionregistration.k8s.io/validatingadmissionpolicybindings/user-defined-networks-namespace-label-binding.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.831270805Z cluster-scoped-resources/admissionregistration.k8s.io/validatingwebhookconfigurations/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.831320018Z cluster-scoped-resources/admissionregistration.k8s.io/validatingwebhookconfigurations/multus.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.831449654Z cluster-scoped-resources/admissionregistration.k8s.io/validatingwebhookconfigurations/network-node-identity.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.831524629Z cluster-scoped-resources/apiextensions.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.831933541Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.831967642Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/accounts.nim.opendatahub.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.832148902Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/adminnetworkpolicies.policy.networking.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.832410577Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/adminpolicybasedexternalroutes.k8s.ovn.org.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.832606827Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/alertingrules.monitoring.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.832735754Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/alertmanagerconfigs.monitoring.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.836411323Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/alertmanagers.monitoring.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.837935386Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/alertrelabelconfigs.monitoring.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.838063603Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/apikeyapprovals.devportal.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.838232142Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/apikeyrequests.devportal.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.838353009Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/apikeys.devportal.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.838473965Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/apiproducts.devportal.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.838941141Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/apirequestcounts.apiserver.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.839083588Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/apiservers.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.839269209Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/appliedmanifestworks.work.open-cluster-management.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.839391035Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/authconfigs.authorino.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.84021519Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/authentications.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.840487755Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/authorinos.operator.authorino.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.840615611Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/authorizationpolicies.security.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.840818842Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/authpolicies.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.842095072Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/baselineadminnetworkpolicies.policy.networking.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.842347465Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/builds.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.842515305Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/bundles.trust.cert-manager.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.842673923Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/catalogsources.operators.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.84298256Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/certificaterequests.cert-manager.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.843119227Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/certificates.cert-manager.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.84335335Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/certmanagers.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.84372516Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/challenges.acme.cert-manager.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.844439079Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/cloudcredentials.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.844552435Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/cloudeventsources.eventing.keda.sh.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.844673262Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/cloudprivateipconfigs.cloud.network.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.844792218Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterclaims.cluster.open-cluster-management.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.844887683Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clustercloudeventsources.eventing.keda.sh.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.844999929Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clustercsidrivers.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.845149937Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterimagepolicies.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.845410202Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterissuers.cert-manager.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.846368683Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusteroperators.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.846532442Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterresourcequotas.quota.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.846684721Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterserviceversions.operators.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.848739052Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterstoragecontainers.serving.kserve.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.848910491Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clustertriggerauthentications.keda.sh.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.849184396Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusteruserdefinednetworks.k8s.ovn.org.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.849461661Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterversions.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.849784439Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/configs.imageregistry.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.850272275Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/configs.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.850400202Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/configs.samples.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.85054197Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consoleclidownloads.console.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.850660176Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consoleexternalloglinks.console.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.850784813Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consolelinks.console.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.85092339Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consolenotifications.console.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.851043797Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consoleplugins.console.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.851255688Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consolequickstarts.console.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.851386266Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consoles.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.851493151Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consoles.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.851754995Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consolesamples.console.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.851904134Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/consoleyamlsamples.console.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.85201667Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/controllerconfigs.machineconfiguration.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.852586121Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/credentialsrequests.cloudcredential.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.852709447Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/csisnapshotcontrollers.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.852826374Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/datascienceclusters.datasciencecluster.opendatahub.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.853038435Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/destinationrules.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.85387173Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dnses.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.854013378Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dnses.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.854246881Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dnshealthcheckprobes.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.854366417Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dnspolicies.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.854544787Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dnsrecords.ingress.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.854689955Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dnsrecords.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.854869024Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dscinitializations.dscinitialization.opendatahub.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.855012062Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/egressfirewalls.k8s.ovn.org.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.855145799Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/egressips.k8s.ovn.org.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.855302838Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/egressqoses.k8s.ovn.org.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.855441226Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/egressrouters.network.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.855590874Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/egressservices.k8s.ovn.org.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.855731911Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/envoyfilters.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.85588245Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/etcds.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.856024317Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/featuregates.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.856203267Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/gatewayclasses.gateway.networking.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.856391037Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/gateways.gateway.networking.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.856899535Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/gateways.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.857079824Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/grpcroutes.gateway.networking.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.857510638Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/helmchartrepositories.helm.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.857659616Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/httproutes.gateway.networking.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.858568905Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/httpscaledobjects.http.keda.sh.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.858712473Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/imagecontentpolicies.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.85884345Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/imagecontentsourcepolicies.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.858957926Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/imagedigestmirrorsets.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.859087203Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/imagepolicies.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.859316556Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/imagepruners.imageregistry.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.85957123Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/images.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.859713287Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/imagetagmirrorsets.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.859840974Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencegraphs.serving.kserve.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.860050896Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencemodelrewrites.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.860219985Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferenceobjectives.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.860352492Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencepoolimports.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.86049535Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencepools.inference.networking.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.860650918Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencepools.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.860801076Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferenceservices.serving.kserve.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.863023517Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/infrastructures.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.863543765Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ingresscontrollers.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.864152738Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ingresses.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.86436731Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/insightsoperators.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.8645489Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/installplans.operators.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.864700428Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/interceptorroutes.http.keda.sh.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.864837095Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ipamclaims.k8s.cni.cncf.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.864959062Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ippools.whereabouts.cni.cncf.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.865081338Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/issuers.cert-manager.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.86603265Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/istiocsrs.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.866391769Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/kedacontrollers.keda.sh.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.869386202Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/kuadrants.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.869525029Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/kubeapiservers.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.869676078Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/kubecontrollermanagers.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.870723724Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/kubeschedulers.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.870856491Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/kubestorageversionmigrators.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.870986629Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/leaderworkersetoperators.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.871117436Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/leaderworkersets.leaderworkerset.x-k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.874074646Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/limitadors.limitador.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.874414504Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/llminferenceserviceconfigs.serving.kserve.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.880874475Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/llminferenceservices.serving.kserve.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.885270373Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/machineconfignodes.machineconfiguration.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.885445643Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/machineconfigurations.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.885718068Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/machineosbuilds.machineconfiguration.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.885900198Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/machineosconfigs.machineconfiguration.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.886046125Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/network-attachment-definitions.k8s.cni.cncf.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.886151561Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/networks.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.886326861Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/networks.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.886579054Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/nodes.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.886729572Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/nodeslicepools.whereabouts.cni.cncf.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.886852529Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/oauths.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.88705051Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/oidcpolicies.extensions.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.887209509Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/olmconfigs.operators.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.887336845Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/openshiftapiservers.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.887457202Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/openshiftcontrollermanagers.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.887582219Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/operatorconditions.operators.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.887716846Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/operatorgroups.operators.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.887861064Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/operatorhubs.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.888005332Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/operatorpkis.network.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.888127508Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/operators.operators.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.888329739Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/orders.acme.cert-manager.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.888493938Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/overlappingrangeipreservations.whereabouts.cni.cncf.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.888627205Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/peerauthentications.security.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.888771593Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/pinnedimagesets.machineconfiguration.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.888916511Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/planpolicies.extensions.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.889054409Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/podmonitors.monitoring.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.889645661Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/podnetworkconnectivitychecks.controlplane.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.889798859Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/probes.monitoring.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.890052713Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/profiles.tuned.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.890237173Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/projecthelmchartrepositories.helm.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.89037911Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/projects.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.890500457Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/prometheuses.monitoring.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.892615562Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/prometheusrules.monitoring.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.892748579Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/proxies.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.892882506Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/proxyconfigs.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.893016403Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/rangeallocations.security.internal.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.8931487Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ratelimitpolicies.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.893359902Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/referencegrants.gateway.networking.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.893543582Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/requestauthentications.security.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.893736743Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/rolebindingrestrictions.authorization.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.893944414Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/scaledjobs.keda.sh.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.895694979Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/scaledobjects.keda.sh.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.895842827Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/schedulers.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.895960083Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/securitycontextconstraints.security.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.896103961Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/servicecas.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.896242068Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/serviceentries.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.896418028Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/servicemonitors.monitoring.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.896671182Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/servingruntimes.serving.kserve.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.89718951Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/sidecars.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.897471305Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/storages.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.897599482Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/storagestates.migration.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.897715218Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/storageversionmigrations.migration.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.897837605Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/subscriptions.operators.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.89867458Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/telemetries.telemetry.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.898882731Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/telemetrypolicies.extensions.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.899015259Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/thanosrulers.monitoring.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.900574513Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/tlspolicies.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.900743503Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/tokenratelimitpolicies.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.900914772Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/trainedmodels.serving.kserve.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.901036218Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/triggerauthentications.keda.sh.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.901302243Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/trustmanagers.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.90161622Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/tuneds.tuned.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.901759698Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/userdefinednetworks.k8s.ovn.org.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.901941067Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/virtualservices.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.902369491Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/volumepopulators.populator.storage.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.902471916Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/volumesnapshotclasses.snapshot.storage.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.902626074Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/volumesnapshotcontents.snapshot.storage.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.902778833Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/volumesnapshots.snapshot.storage.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.902942692Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/wasmplugins.extensions.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.903062018Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/workloadentries.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.903232018Z cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/workloadgroups.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.903376535Z cluster-scoped-resources/apiregistration.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.903682772Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.903742645Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1..yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.90384132Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.acme.cert-manager.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.903923875Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.admissionregistration.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.90401163Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.apiextensions.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.904094084Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.apiserver.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.904292535Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.apps.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.904400151Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.apps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.904480945Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.authentication.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.90456444Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.authorization.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.904659465Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.authorization.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.904779461Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.autoscaling.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.904870236Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.batch.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.905050946Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.build.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.905142341Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.cert-manager.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.905263937Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.certificates.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.905364413Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.cloud.network.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.905454368Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.cloudcredential.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.905540473Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.config.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.905626877Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.console.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.905713802Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.coordination.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.905801327Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.datasciencecluster.opendatahub.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.905888242Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.discovery.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.905975806Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.dscinitialization.opendatahub.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.906064511Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.events.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.906149076Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.flowcontrol.apiserver.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.906286173Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.gateway.networking.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.906372548Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.image.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.906461233Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.imageregistry.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.906547617Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.inference.networking.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.906632282Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.ingress.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.906721197Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.k8s.cni.cncf.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.906806031Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.k8s.ovn.org.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.906893386Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.906983141Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.leaderworkerset.x-k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.907069675Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.machineconfiguration.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.90715801Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.monitoring.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.907290798Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.monitoring.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.907374602Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.network.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.907454647Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.907553532Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.networking.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.907628536Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.nim.opendatahub.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.907721041Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.node.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.907810496Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.oauth.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.907936622Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.908041528Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.operators.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.908127383Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.packages.operators.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.90825626Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.policy.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.908369546Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.project.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.908459691Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.quota.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.908554136Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.rbac.authorization.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.908645431Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.resource.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.908732186Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.route.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.908823791Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.samples.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.908914826Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.scheduling.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.90899617Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.security.internal.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.909092985Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.security.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.909214242Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.security.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.909340089Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.snapshot.storage.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.909425943Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.storage.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.909514908Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.telemetry.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.909606323Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.template.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.909698178Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.tuned.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.909787893Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.user.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.909881098Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1.work.open-cluster-management.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.909989594Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.cluster.open-cluster-management.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.910080219Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.controlplane.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.910198745Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.devportal.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.910301191Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.eventing.keda.sh.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.910394426Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.extensions.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.910481271Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.extensions.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.910566615Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.http.keda.sh.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.91066064Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.910750185Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.k8s.cni.cncf.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.91084017Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.keda.sh.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.910928735Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.91101781Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.limitador.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.911218271Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.migration.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.911343457Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.monitoring.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.911469784Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.operator.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.911587391Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.operators.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.911680776Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.policy.networking.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.911774431Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.serving.kserve.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.911892097Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.telemetry.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.911991702Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.trust.cert-manager.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.912087518Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha1.whereabouts.cni.cncf.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.912199164Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha2.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.912327521Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha2.operators.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.912434726Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha2.serving.kserve.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.912519181Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1alpha3.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.912617047Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.admissionregistration.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.912729282Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.external.metrics.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.912840328Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.gateway.networking.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.912938374Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.helm.openshift.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.9130447Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.http.keda.sh.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.913125194Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.913282472Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.metrics.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.913401249Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.monitoring.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.913546467Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.913683964Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.operator.authorino.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.91379255Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.populator.storage.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.913887935Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.security.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.91397512Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.serving.kserve.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.914071855Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta1.storage.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.914184861Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v1beta3.authorino.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.914291947Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v2.autoscaling.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.914381072Z cluster-scoped-resources/apiregistration.k8s.io/apiservices/v2.operators.coreos.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.914434885Z cluster-scoped-resources/certificates.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.914445586Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.914494458Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/system:openshift:openshift-monitoring-5qj7d.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.914627865Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/system:openshift:openshift-monitoring-7zf94.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.91471019Z cluster-scoped-resources/certificates.k8s.io/certificatesigningrequests/system:openshift:openshift-monitoring-qjnh2.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.914905071Z cluster-scoped-resources/config.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.914957493Z cluster-scoped-resources/config.openshift.io/apiservers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.915123662Z cluster-scoped-resources/config.openshift.io/authentications.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.915278221Z cluster-scoped-resources/config.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.915465441Z cluster-scoped-resources/config.openshift.io/clusterimagepolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.915552326Z cluster-scoped-resources/config.openshift.io/clusteroperators.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.915955377Z cluster-scoped-resources/config.openshift.io/clusterversions.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.916116146Z cluster-scoped-resources/config.openshift.io/consoles.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.916249783Z cluster-scoped-resources/config.openshift.io/dnses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.916336828Z cluster-scoped-resources/config.openshift.io/featuregates.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.916457105Z cluster-scoped-resources/config.openshift.io/imagecontentpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.916537949Z cluster-scoped-resources/config.openshift.io/imagedigestmirrorsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.916654895Z cluster-scoped-resources/config.openshift.io/imagepolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.91674061Z cluster-scoped-resources/config.openshift.io/images.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.917195165Z cluster-scoped-resources/config.openshift.io/imagetagmirrorsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.917313561Z cluster-scoped-resources/config.openshift.io/infrastructures.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.917416947Z cluster-scoped-resources/config.openshift.io/ingresses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.917503901Z cluster-scoped-resources/config.openshift.io/networks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.917602397Z cluster-scoped-resources/config.openshift.io/nodes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.917687001Z cluster-scoped-resources/config.openshift.io/oauths.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.917770306Z cluster-scoped-resources/config.openshift.io/operatorhubs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.917853371Z cluster-scoped-resources/config.openshift.io/projects.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.917936485Z cluster-scoped-resources/config.openshift.io/proxies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.91802917Z cluster-scoped-resources/config.openshift.io/schedulers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.918129215Z cluster-scoped-resources/config.openshift.io/clusteroperators/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.918192489Z cluster-scoped-resources/config.openshift.io/clusteroperators/console.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.918300725Z cluster-scoped-resources/config.openshift.io/clusteroperators/csi-snapshot-controller.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.9183987Z cluster-scoped-resources/config.openshift.io/clusteroperators/dns.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.918486185Z cluster-scoped-resources/config.openshift.io/clusteroperators/image-registry.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.91857415Z cluster-scoped-resources/config.openshift.io/clusteroperators/ingress.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.918666884Z cluster-scoped-resources/config.openshift.io/clusteroperators/insights.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.91876076Z cluster-scoped-resources/config.openshift.io/clusteroperators/kube-apiserver.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.918915058Z cluster-scoped-resources/config.openshift.io/clusteroperators/kube-controller-manager.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.919012013Z cluster-scoped-resources/config.openshift.io/clusteroperators/kube-scheduler.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.919109048Z cluster-scoped-resources/config.openshift.io/clusteroperators/kube-storage-version-migrator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.919225595Z cluster-scoped-resources/config.openshift.io/clusteroperators/monitoring.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.91931652Z cluster-scoped-resources/config.openshift.io/clusteroperators/network.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.919448747Z cluster-scoped-resources/config.openshift.io/clusteroperators/node-tuning.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.919537812Z cluster-scoped-resources/config.openshift.io/clusteroperators/openshift-apiserver.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.919637317Z cluster-scoped-resources/config.openshift.io/clusteroperators/openshift-controller-manager.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.919737422Z cluster-scoped-resources/config.openshift.io/clusteroperators/openshift-samples.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.919836338Z cluster-scoped-resources/config.openshift.io/clusteroperators/operator-lifecycle-manager-catalog.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.919922383Z cluster-scoped-resources/config.openshift.io/clusteroperators/operator-lifecycle-manager-packageserver.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.920009117Z cluster-scoped-resources/config.openshift.io/clusteroperators/operator-lifecycle-manager.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.920100922Z cluster-scoped-resources/config.openshift.io/clusteroperators/service-ca.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.920214828Z cluster-scoped-resources/config.openshift.io/clusteroperators/storage.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.920277322Z cluster-scoped-resources/config.openshift.io/clusterversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.920325124Z cluster-scoped-resources/config.openshift.io/clusterversions/version.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.920397458Z cluster-scoped-resources/config.openshift.io/consoles/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.920441371Z cluster-scoped-resources/config.openshift.io/consoles/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.920498674Z cluster-scoped-resources/config.openshift.io/featuregates/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.920540756Z cluster-scoped-resources/config.openshift.io/featuregates/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.920624821Z cluster-scoped-resources/config.openshift.io/infrastructures/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.920751948Z cluster-scoped-resources/config.openshift.io/infrastructures/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.920806371Z cluster-scoped-resources/config.openshift.io/oauths/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.920840652Z cluster-scoped-resources/config.openshift.io/oauths/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.920902936Z cluster-scoped-resources/config.openshift.io/proxies/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.920949158Z cluster-scoped-resources/config.openshift.io/proxies/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.921017242Z cluster-scoped-resources/console.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.921036933Z cluster-scoped-resources/console.openshift.io/consoleplugins/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.921098056Z cluster-scoped-resources/console.openshift.io/consoleplugins/kuadrant-console-plugin.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.921213533Z cluster-scoped-resources/console.openshift.io/consoleplugins/monitoring-plugin.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.921304387Z cluster-scoped-resources/console.openshift.io/consoleplugins/networking-console-plugin.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.92135556Z cluster-scoped-resources/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.921372761Z cluster-scoped-resources/core/nodes/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.921422124Z cluster-scoped-resources/core/nodes/ip-10-0-128-142.ec2.internal.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.921614404Z cluster-scoped-resources/core/nodes/ip-10-0-130-182.ec2.internal.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.921743581Z cluster-scoped-resources/core/nodes/ip-10-0-142-172.ec2.internal.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.921843477Z cluster-scoped-resources/core/persistentvolumes/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.921883739Z cluster-scoped-resources/core/persistentvolumes/pvc-6394c2ef-5d09-4573-b34c-dae5966e5434.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.921961723Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.922030477Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.922069259Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/catch-all.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.922159544Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/exempt.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.922467811Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/global-default.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.922628669Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/kube-controller-manager.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.922746446Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/kube-scheduler.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.922865122Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/kube-system-service-accounts.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.923082554Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-apiserver-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.923259033Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-apiserver-sar.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.923401461Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-apiserver.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.923494886Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-authentication-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.923589251Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-controller-manager.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.923683717Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-kube-apiserver-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.923789302Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-monitoring-metrics.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.923878577Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-oauth-apiserver-sar.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.923967932Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-oauth-apiserver.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.924060607Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/openshift-oauth-server.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.924150162Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/probes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.924286249Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/service-accounts.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.924375084Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/system-leader-election.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.924467299Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/system-node-high.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.924555044Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/flowschemas/system-nodes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.92465796Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.924744774Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/catch-all.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.924841269Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/exempt.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.924926524Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/global-default.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.925014999Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/leader-election.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.925102184Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/node-high.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.92521919Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/openshift-control-plane-operators.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.925881536Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/system.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.925921448Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/workload-high.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.925928268Z cluster-scoped-resources/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/workload-low.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.925934739Z cluster-scoped-resources/gateway.networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.925940799Z cluster-scoped-resources/gateway.networking.k8s.io/gatewayclasses/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.925946139Z cluster-scoped-resources/gateway.networking.k8s.io/gatewayclasses/openshift-default.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.92595137Z cluster-scoped-resources/imageregistry.operator.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.9259568Z cluster-scoped-resources/imageregistry.operator.openshift.io/configs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.925974811Z cluster-scoped-resources/imageregistry.operator.openshift.io/configs/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.926003662Z cluster-scoped-resources/imageregistry.operator.openshift.io/imagepruners/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.926085667Z cluster-scoped-resources/imageregistry.operator.openshift.io/imagepruners/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.926206563Z cluster-scoped-resources/migration.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.926236495Z cluster-scoped-resources/migration.k8s.io/storageversionmigrations/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.926410335Z cluster-scoped-resources/migration.k8s.io/storageversionmigrations/console-plugin-storage-version-migration.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.926526591Z cluster-scoped-resources/migration.k8s.io/storageversionmigrations/machineconfiguration-controllerconfig-storage-version-migration.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.92670494Z cluster-scoped-resources/migration.k8s.io/storageversionmigrations/machineconfiguration-machineconfigpool-storage-version-migration.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.927042079Z cluster-scoped-resources/oauth.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.927047729Z cluster-scoped-resources/oauth.openshift.io/oauthclients/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.92706053Z cluster-scoped-resources/oauth.openshift.io/oauthclients/console.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.927074411Z cluster-scoped-resources/operator.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.927080641Z cluster-scoped-resources/operator.openshift.io/clustercsidrivers/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.927086741Z cluster-scoped-resources/operator.openshift.io/clustercsidrivers/ebs.csi.aws.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.927111393Z cluster-scoped-resources/operator.openshift.io/consoles/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.927199377Z cluster-scoped-resources/operator.openshift.io/consoles/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.927327984Z cluster-scoped-resources/operator.openshift.io/csisnapshotcontrollers/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.927355756Z cluster-scoped-resources/operator.openshift.io/csisnapshotcontrollers/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.927465462Z cluster-scoped-resources/operator.openshift.io/dnses/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.927504474Z cluster-scoped-resources/operator.openshift.io/dnses/default.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.92761086Z cluster-scoped-resources/operator.openshift.io/insightsoperators/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.927669453Z cluster-scoped-resources/operator.openshift.io/insightsoperators/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.927831301Z cluster-scoped-resources/operator.openshift.io/kubeapiservers/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.927895625Z cluster-scoped-resources/operator.openshift.io/kubeapiservers/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.927969419Z cluster-scoped-resources/operator.openshift.io/kubecontrollermanagers/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.928020722Z cluster-scoped-resources/operator.openshift.io/kubecontrollermanagers/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.928098016Z cluster-scoped-resources/operator.openshift.io/kubeschedulers/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.928115417Z cluster-scoped-resources/operator.openshift.io/kubeschedulers/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.928219483Z cluster-scoped-resources/operator.openshift.io/kubestorageversionmigrators/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.928244974Z cluster-scoped-resources/operator.openshift.io/kubestorageversionmigrators/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.928339509Z cluster-scoped-resources/operator.openshift.io/networks/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.928364461Z cluster-scoped-resources/operator.openshift.io/networks/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.928455005Z cluster-scoped-resources/operator.openshift.io/openshiftapiservers/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.928476987Z cluster-scoped-resources/operator.openshift.io/openshiftapiservers/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.928566092Z cluster-scoped-resources/operator.openshift.io/openshiftcontrollermanagers/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.928584382Z cluster-scoped-resources/operator.openshift.io/openshiftcontrollermanagers/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.928654306Z cluster-scoped-resources/operator.openshift.io/servicecas/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.928681628Z cluster-scoped-resources/operator.openshift.io/servicecas/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.928741581Z cluster-scoped-resources/operator.openshift.io/storages/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.928796284Z cluster-scoped-resources/operator.openshift.io/storages/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.928895599Z cluster-scoped-resources/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.92890331Z cluster-scoped-resources/operators.coreos.com/olmconfigs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.928933051Z cluster-scoped-resources/operators.coreos.com/olmconfigs/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.929020206Z cluster-scoped-resources/operators.coreos.com/operators/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.929062758Z cluster-scoped-resources/operators.coreos.com/operators/authorino-operator.kuadrant-system.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.929192835Z cluster-scoped-resources/operators.coreos.com/operators/dns-operator.kuadrant-system.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.929341803Z cluster-scoped-resources/operators.coreos.com/operators/leader-worker-set.openshift-lws-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.929503222Z cluster-scoped-resources/operators.coreos.com/operators/limitador-operator.kuadrant-system.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.929608698Z cluster-scoped-resources/operators.coreos.com/operators/openshift-cert-manager-operator.cert-manager-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.929725594Z cluster-scoped-resources/operators.coreos.com/operators/openshift-custom-metrics-autoscaler-operator.openshift-keda.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.92982705Z cluster-scoped-resources/operators.coreos.com/operators/rhcl-operator.kuadrant-system.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.929906794Z cluster-scoped-resources/rbac.authorization.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.929982068Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.930031151Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/aws-ebs-csi-driver-operator-clusterrolebinding.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.930121906Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/cloud-network-config-controller.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.930242402Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/cluster-node-tuning-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.930395411Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/cluster-storage-operator-role.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.930521458Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/csi-snapshot-controller-operator-clusterrole.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.930602912Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/csi-snapshot-controller-runner-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.930732859Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/metrics-daemon-sa-rolebinding.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.930854036Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/multus-admission-controller-webhook.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.930975302Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/multus-ancillary-tools.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.931094569Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/multus-cluster-readers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.931232516Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/multus-group.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.931345252Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/multus-transient.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.931452678Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/multus-whereabouts.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.931583235Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/network-diagnostics.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.931702631Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/network-node-identity.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.931821498Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/openshift-image-registry-pruner.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.931947655Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/openshift-iptables-alerter.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.932061231Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/openshift-ovn-kubernetes-control-plane-limited.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.932193898Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/openshift-ovn-kubernetes-node-identity-limited.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.932335446Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/openshift-ovn-kubernetes-node-kube-rbac-proxy.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.932489824Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/registry-registry-role.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.932629242Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.932688595Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/aws-ebs-csi-driver-operator-clusterrole.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.932819842Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/cloud-network-config-controller.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.932925958Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/cluster-node-tuning-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.933050764Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/console-extensions-reader.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.933259846Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/console-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.933399223Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/console.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.93352038Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/csi-snapshot-controller-operator-clusterrole.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.933636966Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/helm-chartrepos-viewer.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.933747542Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/metrics-daemon-role.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.933866839Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/multus-admission-controller-webhook.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.933980045Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/multus-ancillary-tools.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.934097161Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/multus.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.934229428Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/net-attach-def-project.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.934348945Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/network-diagnostics.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.934464431Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/network-node-identity.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.934576327Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-csi-snapshot-controller-runner.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.934696934Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-iptables-alerter.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.9348135Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-ovn-kubernetes-cluster-reader.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.934926506Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-ovn-kubernetes-control-plane-limited.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.935048463Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-ovn-kubernetes-kube-rbac-proxy.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.935202721Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-ovn-kubernetes-node-limited.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.935313637Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-ovn-kubernetes-udn-editor.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.935426044Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/openshift-ovn-kubernetes-udn-viewer.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.935556091Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/project-helm-chartrepository-editor.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.935671557Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/system:openshift:aggregate-snapshots-to-admin.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.935793653Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/system:openshift:aggregate-snapshots-to-basic-user.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.935894829Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/system:openshift:aggregate-snapshots-to-storage-admin.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.936022316Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/system:openshift:aggregate-snapshots-to-view.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.936140522Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/system:registry.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.93629213Z cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/whereabouts-cni.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.936356164Z cluster-scoped-resources/samples.operator.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.936370825Z cluster-scoped-resources/samples.operator.openshift.io/configs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.936406707Z cluster-scoped-resources/samples.operator.openshift.io/configs/cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.936504932Z cluster-scoped-resources/snapshot.storage.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.936517973Z cluster-scoped-resources/snapshot.storage.k8s.io/volumesnapshotclasses/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.936536334Z cluster-scoped-resources/snapshot.storage.k8s.io/volumesnapshotclasses/csi-aws-vsc.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.93664998Z cluster-scoped-resources/storage.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.936663891Z cluster-scoped-resources/storage.k8s.io/csidrivers/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.936706533Z cluster-scoped-resources/storage.k8s.io/csidrivers/ebs.csi.aws.com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.936793118Z cluster-scoped-resources/storage.k8s.io/csinodes/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.93684653Z cluster-scoped-resources/storage.k8s.io/csinodes/ip-10-0-128-142.ec2.internal.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.936969247Z cluster-scoped-resources/storage.k8s.io/csinodes/ip-10-0-130-182.ec2.internal.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.937090044Z cluster-scoped-resources/storage.k8s.io/csinodes/ip-10-0-142-172.ec2.internal.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.937191939Z cluster-scoped-resources/storage.k8s.io/storageclasses/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.937260443Z cluster-scoped-resources/storage.k8s.io/storageclasses/gp2-csi.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.937416901Z cluster-scoped-resources/storage.k8s.io/storageclasses/gp3-csi.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.937493485Z host_service_logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.937523037Z host_service_logs/masters/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.93758236Z host_service_logs/masters/NetworkManager_service.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.937677366Z host_service_logs/masters/crio_service.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.93775587Z host_service_logs/masters/kubelet_service.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.937845184Z host_service_logs/masters/machine-config-daemon-firstboot_service.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.938025354Z host_service_logs/masters/machine-config-daemon-host_service.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.938189733Z host_service_logs/masters/openvswitch_service.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.938290519Z host_service_logs/masters/ostree-finalize-staged_service.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.938374783Z host_service_logs/masters/ovs-configuration_service.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.938469258Z host_service_logs/masters/ovs-vswitchd_service.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.938555623Z host_service_logs/masters/ovsdb-server_service.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.938643018Z host_service_logs/masters/rpm-ostreed_service.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.93868832Z ingress_controllers/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.938698201Z ingress_controllers/default/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.938704891Z ingress_controllers/default/router-default-5658d689b9-4zvzx/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.938779095Z ingress_controllers/default/router-default-5658d689b9-4zvzx/haproxy.config [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.939256541Z insights-data/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.939284763Z istio/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.939347336Z istio/aggregated-discovery-api.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.939462412Z istio/aggregated-discovery-apis.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.940067675Z istio/event-filter.html [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.940283627Z istio/timestamp [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.940452926Z istio/cluster-scoped-resources/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.940478407Z istio/cluster-scoped-resources/admissionregistration.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.940484808Z istio/cluster-scoped-resources/admissionregistration.k8s.io/mutatingwebhookconfigurations/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.94052633Z istio/cluster-scoped-resources/admissionregistration.k8s.io/mutatingwebhookconfigurations/istio-sidecar-injector-openshift-gateway-openshift-ingress.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.940656547Z istio/cluster-scoped-resources/admissionregistration.k8s.io/validatingwebhookconfigurations/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.940695129Z istio/cluster-scoped-resources/admissionregistration.k8s.io/validatingwebhookconfigurations/istio-validator-openshift-gateway-openshift-ingress.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.940796935Z istio/cluster-scoped-resources/apiextensions.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.94089588Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.940938642Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/authorizationpolicies.security.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.941157474Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/destinationrules.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.942026151Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/envoyfilters.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.942317797Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/gatewayclasses.gateway.networking.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.942523869Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/gateways.gateway.networking.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.942969473Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/gateways.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.943181014Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/grpcroutes.gateway.networking.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.943593656Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/httproutes.gateway.networking.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.944611322Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencemodelrewrites.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.94475829Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferenceobjectives.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.944897337Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencepoolimports.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.945068396Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencepools.inference.networking.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.945252596Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/inferencepools.inference.networking.x-k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.945399534Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/peerauthentications.security.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.945553903Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/proxyconfigs.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.94569606Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/referencegrants.gateway.networking.k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.945840078Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/requestauthentications.security.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.946028808Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/serviceentries.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.946263201Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/sidecars.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.946569118Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/telemetries.telemetry.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.946776929Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/virtualservices.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.947267986Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/wasmplugins.extensions.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.947424624Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/workloadentries.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.947587143Z istio/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/workloadgroups.networking.istio.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.947753212Z istio/cluster-scoped-resources/gateway.networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.947762102Z istio/cluster-scoped-resources/gateway.networking.k8s.io/gatewayclasses/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.947792454Z istio/cluster-scoped-resources/gateway.networking.k8s.io/gatewayclasses/openshift-default.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.94790108Z istio/cluster-scoped-resources/rbac.authorization.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.947911841Z istio/cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.947984234Z istio/cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/istio-reader-clusterrole-openshift-gateway-openshift-ingress.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.948107481Z istio/cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/istiod-clusterrole-openshift-gateway-openshift-ingress.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.948410308Z istio/cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/istiod-gateway-controller-openshift-gateway-openshift-ingress.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.948500622Z istio/cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.948548425Z istio/cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/istio-reader-clusterrole-openshift-gateway-openshift-ingress.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.948666062Z istio/cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/istiod-clusterrole-openshift-gateway-openshift-ingress.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.948857662Z istio/cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/istiod-gateway-controller-openshift-gateway-openshift-ingress.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.948919685Z istio/namespaces/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.948948427Z istio/namespaces/kserve-ci-e2e-test/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.948957377Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.948971208Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/gateways/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.949035471Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/gateways/router-gateway-1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.949159338Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/gateways/router-gateway-2.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.949332288Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/httproutes/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.94938457Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/httproutes/router-route-1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.949500817Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/httproutes/router-route-2.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.949596662Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/httproutes/router-route-3.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.949698458Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/httproutes/router-route-4.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.949794063Z istio/namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/httproutes/scheduler-v06-pd-migration-test-kserve-route.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.94993337Z istio/namespaces/kserve-ci-e2e-test/inference.networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.949945731Z istio/namespaces/kserve-ci-e2e-test/inference.networking.k8s.io/inferencepools/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.950005924Z istio/namespaces/kserve-ci-e2e-test/inference.networking.k8s.io/inferencepools/scheduler-v06-pd-migration-test-inference-pool.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.950074568Z istio/namespaces/kserve-ci-e2e-test/inference.networking.x-k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.950086559Z istio/namespaces/kserve-ci-e2e-test/inference.networking.x-k8s.io/inferencepools/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.95011416Z istio/namespaces/kserve-ci-e2e-test/inference.networking.x-k8s.io/inferencepools/scheduler-v06-pd-migration-test-inference-pool.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.950243747Z istio/namespaces/kserve-ci-e2e-test/networking.istio.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.950281569Z istio/namespaces/kserve-ci-e2e-test/networking.istio.io/destinationrules/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.950326481Z istio/namespaces/kserve-ci-e2e-test/networking.istio.io/destinationrules/scheduler-v06-pd-migration-test-kserve-scheduler.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.950451738Z istio/namespaces/kserve-ci-e2e-test/networking.istio.io/destinationrules/scheduler-v06-pd-migration-test-kserve-shadow-svc.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.950627448Z istio/namespaces/kserve-ci-e2e-test/networking.istio.io/destinationrules/scheduler-v06-pd-migration-test-kserve-workload-svc.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.950715883Z istio/namespaces/openshift-ingress/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.950763775Z istio/namespaces/openshift-ingress/openshift-ingress.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.950889952Z istio/namespaces/openshift-ingress/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.950954455Z istio/namespaces/openshift-ingress/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.951015669Z istio/namespaces/openshift-ingress/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.951069142Z istio/namespaces/openshift-ingress/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.951192319Z istio/namespaces/openshift-ingress/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.951693586Z istio/namespaces/openshift-ingress/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.951916108Z istio/namespaces/openshift-ingress/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.951975931Z istio/namespaces/openshift-ingress/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.952080997Z istio/namespaces/openshift-ingress/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.952155801Z istio/namespaces/openshift-ingress/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.952233675Z istio/namespaces/openshift-ingress/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.9523277Z istio/namespaces/openshift-ingress/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.952380603Z istio/namespaces/openshift-ingress/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.952426906Z istio/namespaces/openshift-ingress/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.95252196Z istio/namespaces/openshift-ingress/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.952592084Z istio/namespaces/openshift-ingress/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.952646907Z istio/namespaces/openshift-ingress/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.953085891Z istio/namespaces/openshift-ingress/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.953225049Z istio/namespaces/openshift-ingress/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.953484733Z istio/namespaces/openshift-ingress/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.953577018Z istio/namespaces/openshift-ingress/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.953843632Z istio/namespaces/openshift-ingress/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.95398822Z istio/namespaces/openshift-ingress/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.954229333Z istio/namespaces/openshift-ingress/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.954320998Z istio/namespaces/openshift-ingress/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.954373771Z istio/namespaces/openshift-ingress/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.954455165Z istio/namespaces/openshift-ingress/gateway.networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.954466316Z istio/namespaces/openshift-ingress/gateway.networking.k8s.io/gateways/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.954498448Z istio/namespaces/openshift-ingress/gateway.networking.k8s.io/gateways/openshift-ai-inference.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.954575772Z istio/namespaces/openshift-ingress/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.954610024Z istio/namespaces/openshift-ingress/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.954687998Z istio/namespaces/openshift-ingress/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.95473087Z istio/namespaces/openshift-ingress/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.954828136Z istio/namespaces/openshift-ingress/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.95490805Z istio/namespaces/openshift-ingress/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.954984004Z istio/namespaces/openshift-ingress/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.955033917Z istio/namespaces/openshift-ingress/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.95508953Z istio/namespaces/openshift-ingress/networking.istio.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.95509904Z istio/namespaces/openshift-ingress/networking.istio.io/envoyfilters/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.955202516Z istio/namespaces/openshift-ingress/networking.istio.io/envoyfilters/kuadrant-auth-openshift-ai-inference.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.955307572Z istio/namespaces/openshift-ingress/networking.istio.io/envoyfilters/kuadrant-openshift-ai-inference.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.955435298Z istio/namespaces/openshift-ingress/networking.istio.io/envoyfilters/openshift-ai-inference-authn-ssl.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.955545735Z istio/namespaces/openshift-ingress/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.955593687Z istio/namespaces/openshift-ingress/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.955671271Z istio/namespaces/openshift-ingress/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.955680682Z istio/namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.955741985Z istio/namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/istiod-openshift-gateway-94bb8fbfd-5kc7r.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.955856521Z istio/namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/discovery/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.955863712Z istio/namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/discovery/discovery/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.955884313Z istio/namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/discovery/discovery/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.955931545Z istio/namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/discovery/discovery/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.965824152Z istio/namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/discovery/discovery/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.965889605Z istio/namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/discovery/discovery/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.965945879Z istio/namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.96596962Z istio/namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.966194712Z istio/namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/istio-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.966212773Z istio/namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/istio-proxy/istio-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.966218143Z istio/namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/istio-proxy/istio-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.966268376Z istio/namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/istio-proxy/istio-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.966960304Z istio/namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/istio-proxy/istio-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.967061169Z istio/namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.967103431Z istio/namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router-default-5658d689b9-4zvzx.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.967232678Z istio/namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.967248489Z istio/namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router/router/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.96725289Z istio/namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router/router/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.967301512Z istio/namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router/router/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.967412518Z istio/namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router/router/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.967484362Z istio/namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router/router/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.967536055Z istio/namespaces/openshift-ingress/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.967577847Z istio/namespaces/openshift-ingress/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.96763088Z istio/namespaces/openshift-ingress/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.967677122Z istio/namespaces/openshift-ingress/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.967716545Z machine_config_ondisk/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.967722605Z machine_config_termination_logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.967732505Z monitoring/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.967740146Z monitoring/alertmanager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.967781768Z monitoring/alertmanager/status.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.967878904Z monitoring/alertmanager/status.stderr [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.967953457Z monitoring/prometheus/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.967989039Z monitoring/prometheus/alertmanagers.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.968099416Z monitoring/prometheus/alertmanagers.stderr [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.968159089Z monitoring/prometheus/rules.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.968815204Z monitoring/prometheus/rules.stderr [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.968868837Z monitoring/prometheus/prometheus-k8s-0/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.96891525Z monitoring/prometheus/prometheus-k8s-0/active-targets.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.969802878Z monitoring/prometheus/prometheus-k8s-0/active-targets.stderr [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.969857131Z monitoring/prometheus/prometheus-k8s-0/status/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.969902123Z monitoring/prometheus/prometheus-k8s-0/status/runtimeinfo.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.969989488Z monitoring/prometheus/prometheus-k8s-0/status/runtimeinfo.stderr [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.970056591Z monitoring/prometheus/prometheus-k8s-0/status/tsdb.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.970145336Z monitoring/prometheus/prometheus-k8s-0/status/tsdb.stderr [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.97020862Z monitoring/prometheus/status/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.970264593Z monitoring/prometheus/status/config.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.970696116Z monitoring/prometheus/status/config.stderr [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.97076317Z monitoring/prometheus/status/flags.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.970856545Z monitoring/prometheus/status/flags.stderr [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.971054476Z namespaces/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.971061886Z namespaces/cert-manager-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.971065986Z namespaces/cert-manager-operator/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.971070106Z namespaces/cert-manager-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.971103218Z namespaces/cert-manager-operator/coordination.k8s.io/leases/cert-manager-operator-lock.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.971192533Z namespaces/cert-manager-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.971262387Z namespaces/cert-manager-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.97131713Z namespaces/cert-manager-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.971545302Z namespaces/cert-manager-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.971857259Z namespaces/cert-manager-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.972008408Z namespaces/cert-manager-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.972260881Z namespaces/cert-manager-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.972495864Z namespaces/cert-manager-operator/operators.coreos.com/installplans/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.972535246Z namespaces/cert-manager-operator/operators.coreos.com/installplans/install-kghtr.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.972687894Z namespaces/cert-manager-operator/operators.coreos.com/operatorconditions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.972706955Z namespaces/cert-manager-operator/operators.coreos.com/operatorconditions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.972916587Z namespaces/cert-manager-operator/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.97297349Z namespaces/cert-manager-operator/operators.coreos.com/operatorgroups/openshift-cert-manager-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.973050564Z namespaces/cert-manager-operator/operators.coreos.com/subscriptions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.973110847Z namespaces/cert-manager-operator/operators.coreos.com/subscriptions/openshift-cert-manager-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.973187661Z namespaces/cert-manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.973209553Z namespaces/cert-manager/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.973225433Z namespaces/cert-manager/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.973271016Z namespaces/cert-manager/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.973442315Z namespaces/cert-manager/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.973673598Z namespaces/cert-manager/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.973815355Z namespaces/cert-manager/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.974012516Z namespaces/cert-manager/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.97426769Z namespaces/default/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.974327023Z namespaces/default/default.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.974406138Z namespaces/default/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.974433549Z namespaces/default/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.974518744Z namespaces/default/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.974554315Z namespaces/default/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.97464197Z namespaces/default/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.974717004Z namespaces/default/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.974805009Z namespaces/default/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.974844191Z namespaces/default/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.974900194Z namespaces/default/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.974943737Z namespaces/default/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.974981189Z namespaces/default/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.975049702Z namespaces/default/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.975126277Z namespaces/default/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.97519156Z namespaces/default/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.975292895Z namespaces/default/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.97537295Z namespaces/default/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.975414122Z namespaces/default/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.975530439Z namespaces/default/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.975634494Z namespaces/default/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.975837345Z namespaces/default/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.975936641Z namespaces/default/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.976027595Z namespaces/default/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.976155742Z namespaces/default/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.976402906Z namespaces/default/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.976461609Z namespaces/default/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.976499801Z namespaces/default/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.976584396Z namespaces/default/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.976622018Z namespaces/default/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.976701792Z namespaces/default/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.976730113Z namespaces/default/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.976822009Z namespaces/default/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.976899443Z namespaces/default/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.976947635Z namespaces/default/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.976976397Z namespaces/default/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.9770302Z namespaces/default/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.977071212Z namespaces/default/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.977107344Z namespaces/default/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.977115224Z namespaces/default/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.977153326Z namespaces/default/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.977523207Z namespaces/default/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.977696016Z namespaces/default/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.977829333Z namespaces/default/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.978044915Z namespaces/default/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.978263567Z namespaces/default/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.978292248Z namespaces/default/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.978349991Z namespaces/default/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.978383873Z namespaces/default/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.978443846Z namespaces/kserve-ci-e2e-test/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.978452447Z namespaces/kserve-ci-e2e-test/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.978468758Z namespaces/kserve-ci-e2e-test/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.97851107Z namespaces/kserve-ci-e2e-test/coordination.k8s.io/leases/epp-kserve-ci-e2e-test-scheduler-ha-replicas-test-inference-pool.llm-d.ai.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.978579744Z namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.978591745Z namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/gateways/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.978606405Z namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/gateways/router-gateway-1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.978719701Z namespaces/kserve-ci-e2e-test/gateway.networking.k8s.io/gateways/router-gateway-2.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.978784825Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.978797586Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/podmonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.978845488Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/podmonitors/kserve-llm-isvc-vllm-engine-default.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.978939403Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/podmonitors/kserve-llm-isvc-vllm-engine.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.978999917Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.979051019Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors/kserve-llm-isvc-scheduler-default.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.979142064Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors/kserve-llm-isvc-scheduler.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.97923928Z namespaces/kserve-ci-e2e-test/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.97925779Z namespaces/kserve-ci-e2e-test/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.979277982Z namespaces/kserve-ci-e2e-test/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.979452311Z namespaces/kserve-ci-e2e-test/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.979631891Z namespaces/kserve-ci-e2e-test/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.979767318Z namespaces/kserve-ci-e2e-test/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.979971009Z namespaces/kserve-ci-e2e-test/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.980216582Z namespaces/kserve/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.980256585Z namespaces/kserve/kserve.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.98034292Z namespaces/kserve/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.980371291Z namespaces/kserve/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.980452415Z namespaces/kserve/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.980482087Z namespaces/kserve/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.980570662Z namespaces/kserve/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.980779653Z namespaces/kserve/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.980993765Z namespaces/kserve/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.981052188Z namespaces/kserve/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.981102341Z namespaces/kserve/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.981192926Z namespaces/kserve/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.981251799Z namespaces/kserve/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.981358584Z namespaces/kserve/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.981436089Z namespaces/kserve/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.981491432Z namespaces/kserve/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.981606478Z namespaces/kserve/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.98163257Z namespaces/kserve/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.98164545Z namespaces/kserve/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.981712464Z namespaces/kserve/coordination.k8s.io/leases/kserve-controller-manager-leader-lock.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.981910765Z namespaces/kserve/coordination.k8s.io/leases/llminferenceservice-kserve-controller-manager.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.98200167Z namespaces/kserve/coordination.k8s.io/leases/odh-model-controller.opendatahub.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.982117536Z namespaces/kserve/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.982183049Z namespaces/kserve/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.982650234Z namespaces/kserve/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.982799763Z namespaces/kserve/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.983184234Z namespaces/kserve/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.983286869Z namespaces/kserve/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.983691921Z namespaces/kserve/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.983842759Z namespaces/kserve/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.984129075Z namespaces/kserve/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.984280123Z namespaces/kserve/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.984325535Z namespaces/kserve/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.984470513Z namespaces/kserve/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.984491034Z namespaces/kserve/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.98459396Z namespaces/kserve/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.984667524Z namespaces/kserve/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.984747268Z namespaces/kserve/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.984843993Z namespaces/kserve/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.984921578Z namespaces/kserve/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.98496034Z namespaces/kserve/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.985216134Z namespaces/kserve/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.985314099Z namespaces/kserve/monitoring.coreos.com/servicemonitors/model-serving-api-metrics.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.985426255Z namespaces/kserve/monitoring.coreos.com/servicemonitors/odh-model-controller-metrics-monitor.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.985480478Z namespaces/kserve/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.98551466Z namespaces/kserve/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.985591804Z namespaces/kserve/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.985615935Z namespaces/kserve/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.985711991Z namespaces/kserve/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.98588392Z namespaces/kserve/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.986078911Z namespaces/kserve/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.986271751Z namespaces/kserve/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.986502814Z namespaces/kserve/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.986732676Z namespaces/kserve/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.986749247Z namespaces/kserve/pods/kserve-controller-manager-687b7449bc-w4q6g/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.986793279Z namespaces/kserve/pods/kserve-controller-manager-687b7449bc-w4q6g/kserve-controller-manager-687b7449bc-w4q6g.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.986932337Z namespaces/kserve/pods/kserve-controller-manager-687b7449bc-w4q6g/manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.986940047Z namespaces/kserve/pods/kserve-controller-manager-687b7449bc-w4q6g/manager/manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.986955748Z namespaces/kserve/pods/kserve-controller-manager-687b7449bc-w4q6g/manager/manager/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.987006311Z namespaces/kserve/pods/kserve-controller-manager-687b7449bc-w4q6g/manager/manager/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.987429174Z namespaces/kserve/pods/kserve-controller-manager-687b7449bc-w4q6g/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.987505618Z namespaces/kserve/pods/kserve-controller-manager-687b7449bc-w4q6g/manager/manager/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.987584152Z namespaces/kserve/pods/llmisvc-controller-manager-76d8d77597-mztr2/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.987627575Z namespaces/kserve/pods/llmisvc-controller-manager-76d8d77597-mztr2/llmisvc-controller-manager-76d8d77597-mztr2.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.987753391Z namespaces/kserve/pods/llmisvc-controller-manager-76d8d77597-mztr2/manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.987765562Z namespaces/kserve/pods/llmisvc-controller-manager-76d8d77597-mztr2/manager/manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.987776432Z namespaces/kserve/pods/llmisvc-controller-manager-76d8d77597-mztr2/manager/manager/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.987841686Z namespaces/kserve/pods/llmisvc-controller-manager-76d8d77597-mztr2/manager/manager/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.990418656Z namespaces/kserve/pods/llmisvc-controller-manager-76d8d77597-mztr2/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.990486139Z namespaces/kserve/pods/llmisvc-controller-manager-76d8d77597-mztr2/manager/manager/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.990562174Z namespaces/kserve/pods/model-serving-api-fd65d7d6-qrsqp/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.990622217Z namespaces/kserve/pods/model-serving-api-fd65d7d6-qrsqp/model-serving-api-fd65d7d6-qrsqp.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.990754244Z namespaces/kserve/pods/model-serving-api-fd65d7d6-qrsqp/server/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.990767025Z namespaces/kserve/pods/model-serving-api-fd65d7d6-qrsqp/server/server/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.990786776Z namespaces/kserve/pods/model-serving-api-fd65d7d6-qrsqp/server/server/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.990852589Z namespaces/kserve/pods/model-serving-api-fd65d7d6-qrsqp/server/server/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.990943494Z namespaces/kserve/pods/model-serving-api-fd65d7d6-qrsqp/server/server/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.991009468Z namespaces/kserve/pods/model-serving-api-fd65d7d6-qrsqp/server/server/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.991031999Z namespaces/kserve/pods/odh-model-controller-84b54b7f97-ps8wt/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.991088102Z namespaces/kserve/pods/odh-model-controller-84b54b7f97-ps8wt/odh-model-controller-84b54b7f97-ps8wt.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.991186728Z namespaces/kserve/pods/odh-model-controller-84b54b7f97-ps8wt/manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.991211869Z namespaces/kserve/pods/odh-model-controller-84b54b7f97-ps8wt/manager/manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.991217289Z namespaces/kserve/pods/odh-model-controller-84b54b7f97-ps8wt/manager/manager/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:10.991251611Z namespaces/kserve/pods/odh-model-controller-84b54b7f97-ps8wt/manager/manager/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.010256062Z namespaces/kserve/pods/odh-model-controller-84b54b7f97-ps8wt/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.010294784Z namespaces/kserve/pods/odh-model-controller-84b54b7f97-ps8wt/manager/manager/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.010343396Z namespaces/kserve/pods/s3-init-mc5rq/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.010386549Z namespaces/kserve/pods/s3-init-mc5rq/s3-init-mc5rq.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.010507796Z namespaces/kserve/pods/s3-init-mc5rq/download-hf-model/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.010523066Z namespaces/kserve/pods/s3-init-mc5rq/download-hf-model/download-hf-model/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.010530637Z namespaces/kserve/pods/s3-init-mc5rq/download-hf-model/download-hf-model/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.010551278Z namespaces/kserve/pods/s3-init-mc5rq/download-hf-model/download-hf-model/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.010663884Z namespaces/kserve/pods/s3-init-mc5rq/download-hf-model/download-hf-model/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.010766419Z namespaces/kserve/pods/s3-init-mc5rq/download-hf-model/download-hf-model/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.010805721Z namespaces/kserve/pods/s3-init-mc5rq/s3-init/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.010815282Z namespaces/kserve/pods/s3-init-mc5rq/s3-init/s3-init/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.010851604Z namespaces/kserve/pods/s3-init-mc5rq/s3-init/s3-init/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.010903577Z namespaces/kserve/pods/s3-init-mc5rq/s3-init/s3-init/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.011193683Z namespaces/kserve/pods/s3-init-mc5rq/s3-init/s3-init/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.011280987Z namespaces/kserve/pods/s3-init-mc5rq/s3-init/s3-init/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.01132218Z namespaces/kserve/pods/seaweedfs-64568bcd49-jkjfv/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.011386803Z namespaces/kserve/pods/seaweedfs-64568bcd49-jkjfv/seaweedfs-64568bcd49-jkjfv.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.011466707Z namespaces/kserve/pods/seaweedfs-64568bcd49-jkjfv/seaweedfs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.011477078Z namespaces/kserve/pods/seaweedfs-64568bcd49-jkjfv/seaweedfs/seaweedfs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.011490729Z namespaces/kserve/pods/seaweedfs-64568bcd49-jkjfv/seaweedfs/seaweedfs/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.011542772Z namespaces/kserve/pods/seaweedfs-64568bcd49-jkjfv/seaweedfs/seaweedfs/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.011750363Z namespaces/kserve/pods/seaweedfs-64568bcd49-jkjfv/seaweedfs/seaweedfs/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.011863169Z namespaces/kserve/pods/seaweedfs-64568bcd49-jkjfv/seaweedfs/seaweedfs/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.01188882Z namespaces/kserve/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.011957604Z namespaces/kserve/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.012108942Z namespaces/kserve/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.012181126Z namespaces/kserve/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.012302673Z namespaces/kuadrant-system/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.012380197Z namespaces/kuadrant-system/kuadrant-system.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.012476782Z namespaces/kuadrant-system/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.012548856Z namespaces/kuadrant-system/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.01261616Z namespaces/kuadrant-system/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.012676133Z namespaces/kuadrant-system/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.012784529Z namespaces/kuadrant-system/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.013099496Z namespaces/kuadrant-system/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.013469486Z namespaces/kuadrant-system/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.01355319Z namespaces/kuadrant-system/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.013611094Z namespaces/kuadrant-system/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.01372016Z namespaces/kuadrant-system/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.013744231Z namespaces/kuadrant-system/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.013870168Z namespaces/kuadrant-system/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.01391044Z namespaces/kuadrant-system/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.013960693Z namespaces/kuadrant-system/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.014063708Z namespaces/kuadrant-system/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.014117281Z namespaces/kuadrant-system/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.014125572Z namespaces/kuadrant-system/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.014195436Z namespaces/kuadrant-system/coordination.k8s.io/leases/3745a16e.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.014337583Z namespaces/kuadrant-system/coordination.k8s.io/leases/a3f98d6c.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.014445449Z namespaces/kuadrant-system/coordination.k8s.io/leases/aac3a15d.authorino.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.014557185Z namespaces/kuadrant-system/coordination.k8s.io/leases/f139389e.kuadrant.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.014605348Z namespaces/kuadrant-system/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.014666801Z namespaces/kuadrant-system/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.014859251Z namespaces/kuadrant-system/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.014994569Z namespaces/kuadrant-system/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.015630053Z namespaces/kuadrant-system/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.015744529Z namespaces/kuadrant-system/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.016115069Z namespaces/kuadrant-system/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.01631001Z namespaces/kuadrant-system/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.016566494Z namespaces/kuadrant-system/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.016722522Z namespaces/kuadrant-system/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.016766275Z namespaces/kuadrant-system/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.016916273Z namespaces/kuadrant-system/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.016959315Z namespaces/kuadrant-system/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.017027299Z namespaces/kuadrant-system/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.017108013Z namespaces/kuadrant-system/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.017258682Z namespaces/kuadrant-system/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.017380228Z namespaces/kuadrant-system/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.017440381Z namespaces/kuadrant-system/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.017502025Z namespaces/kuadrant-system/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.017532056Z namespaces/kuadrant-system/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.017617391Z namespaces/kuadrant-system/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.017705146Z namespaces/kuadrant-system/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.017714436Z namespaces/kuadrant-system/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.017760109Z namespaces/kuadrant-system/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.01797262Z namespaces/kuadrant-system/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.018240225Z namespaces/kuadrant-system/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.018415024Z namespaces/kuadrant-system/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.018643097Z namespaces/kuadrant-system/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.018908291Z namespaces/kuadrant-system/operators.coreos.com/installplans/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.018953563Z namespaces/kuadrant-system/operators.coreos.com/installplans/install-k99lh.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.019503613Z namespaces/kuadrant-system/operators.coreos.com/operatorconditions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.019564796Z namespaces/kuadrant-system/operators.coreos.com/operatorconditions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.019664602Z namespaces/kuadrant-system/operators.coreos.com/operatorconditions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.019776718Z namespaces/kuadrant-system/operators.coreos.com/operatorconditions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.019875933Z namespaces/kuadrant-system/operators.coreos.com/operatorconditions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.019949027Z namespaces/kuadrant-system/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.020008451Z namespaces/kuadrant-system/operators.coreos.com/operatorgroups/kuadrant.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.020108026Z namespaces/kuadrant-system/operators.coreos.com/subscriptions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.020154919Z namespaces/kuadrant-system/operators.coreos.com/subscriptions/authorino-operator-stable-redhat-operators-openshift-marketplace.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.020312597Z namespaces/kuadrant-system/operators.coreos.com/subscriptions/dns-operator-stable-redhat-operators-openshift-marketplace.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.020502747Z namespaces/kuadrant-system/operators.coreos.com/subscriptions/limitador-operator-stable-redhat-operators-openshift-marketplace.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.020608603Z namespaces/kuadrant-system/operators.coreos.com/subscriptions/rhcl-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.02072387Z namespaces/kuadrant-system/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.02073383Z namespaces/kuadrant-system/pods/authorino-7c77957575-lkzck/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.020751831Z namespaces/kuadrant-system/pods/authorino-7c77957575-lkzck/authorino-7c77957575-lkzck.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.020865077Z namespaces/kuadrant-system/pods/authorino-7c77957575-lkzck/authorino/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.020877578Z namespaces/kuadrant-system/pods/authorino-7c77957575-lkzck/authorino/authorino/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.020885548Z namespaces/kuadrant-system/pods/authorino-7c77957575-lkzck/authorino/authorino/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.020940241Z namespaces/kuadrant-system/pods/authorino-7c77957575-lkzck/authorino/authorino/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.024470143Z namespaces/kuadrant-system/pods/authorino-7c77957575-lkzck/authorino/authorino/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.024525466Z namespaces/kuadrant-system/pods/authorino-7c77957575-lkzck/authorino/authorino/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.024582199Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-hp27q/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.024628971Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-hp27q/authorino-operator-6d85f6564-hp27q.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.024735907Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-hp27q/manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.024744168Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-hp27q/manager/manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.024751258Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-hp27q/manager/manager/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.02479396Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-hp27q/manager/manager/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.025012882Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-hp27q/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.025217693Z namespaces/kuadrant-system/pods/authorino-operator-6d85f6564-hp27q/manager/manager/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.025267326Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-dx5b4/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.02533898Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-dx5b4/dns-operator-controller-manager-65b49595d7-dx5b4.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.025438795Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-dx5b4/manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.025447416Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-dx5b4/manager/manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.025461226Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-dx5b4/manager/manager/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.025518339Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-dx5b4/manager/manager/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.025675268Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-dx5b4/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.025753062Z namespaces/kuadrant-system/pods/dns-operator-controller-manager-65b49595d7-dx5b4/manager/manager/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.025794225Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-28qld/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.025864128Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-28qld/kuadrant-console-plugin-85fd4b8b9d-28qld.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.025942902Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-28qld/kuadrant-console-plugin/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.025950863Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-28qld/kuadrant-console-plugin/kuadrant-console-plugin/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.025959343Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-28qld/kuadrant-console-plugin/kuadrant-console-plugin/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.026015297Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-28qld/kuadrant-console-plugin/kuadrant-console-plugin/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.026109951Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-28qld/kuadrant-console-plugin/kuadrant-console-plugin/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.026221257Z namespaces/kuadrant-system/pods/kuadrant-console-plugin-85fd4b8b9d-28qld/kuadrant-console-plugin/kuadrant-console-plugin/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.02627319Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-tldlw/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.026345194Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-tldlw/kuadrant-operator-controller-manager-bb7ddb7d7-tldlw.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.026492122Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-tldlw/manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.026503033Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-tldlw/manager/manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.026507233Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-tldlw/manager/manager/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.026550706Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-tldlw/manager/manager/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.033888563Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-tldlw/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.033943806Z namespaces/kuadrant-system/pods/kuadrant-operator-controller-manager-bb7ddb7d7-tldlw/manager/manager/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.034033951Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-gxr6q/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.034084654Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-gxr6q/limitador-limitador-69574b596d-gxr6q.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.034245433Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-gxr6q/limitador/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.034264574Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-gxr6q/limitador/limitador/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.034272194Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-gxr6q/limitador/limitador/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.034283675Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-gxr6q/limitador/limitador/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.034399351Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-gxr6q/limitador/limitador/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.034491936Z namespaces/kuadrant-system/pods/limitador-limitador-69574b596d-gxr6q/limitador/limitador/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.034538929Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-kh4pg/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.034608663Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-kh4pg/limitador-operator-controller-manager-6f9f468797-kh4pg.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.034720289Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-kh4pg/manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.034729209Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-kh4pg/manager/manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.034733349Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-kh4pg/manager/manager/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.034790662Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-kh4pg/manager/manager/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.034943611Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-kh4pg/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.035240397Z namespaces/kuadrant-system/pods/limitador-operator-controller-manager-6f9f468797-kh4pg/manager/manager/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.035387435Z namespaces/kuadrant-system/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.03549087Z namespaces/kuadrant-system/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.035556744Z namespaces/kuadrant-system/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.035624508Z namespaces/kuadrant-system/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.035684771Z namespaces/kube-node-lease/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.035692131Z namespaces/kube-node-lease/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.035717123Z namespaces/kube-node-lease/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.035781136Z namespaces/kube-node-lease/coordination.k8s.io/leases/ip-10-0-128-142.ec2.internal.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.035923614Z namespaces/kube-node-lease/coordination.k8s.io/leases/ip-10-0-130-182.ec2.internal.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.03604099Z namespaces/kube-node-lease/coordination.k8s.io/leases/ip-10-0-142-172.ec2.internal.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.036114154Z namespaces/kube-node-lease/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.036141066Z namespaces/kube-node-lease/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.036206009Z namespaces/kube-node-lease/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.036441512Z namespaces/kube-node-lease/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.036727027Z namespaces/kube-node-lease/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.036870175Z namespaces/kube-node-lease/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.037102318Z namespaces/kube-node-lease/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.037351501Z namespaces/kube-public/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.037366112Z namespaces/kube-public/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.037375522Z namespaces/kube-public/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.037461267Z namespaces/kube-public/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.037608295Z namespaces/kube-public/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.037795175Z namespaces/kube-public/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.037945463Z namespaces/kube-public/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.038389297Z namespaces/kube-public/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.038656822Z namespaces/kube-system/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.038695724Z namespaces/kube-system/kube-system.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.038778178Z namespaces/kube-system/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.038817591Z namespaces/kube-system/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.038887264Z namespaces/kube-system/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.038924837Z namespaces/kube-system/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.039082135Z namespaces/kube-system/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.039188131Z namespaces/kube-system/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.039342479Z namespaces/kube-system/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.039385011Z namespaces/kube-system/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.039416013Z namespaces/kube-system/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.039491307Z namespaces/kube-system/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.03953349Z namespaces/kube-system/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.039618994Z namespaces/kube-system/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.039663667Z namespaces/kube-system/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.039709349Z namespaces/kube-system/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.039810365Z namespaces/kube-system/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.039863757Z namespaces/kube-system/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.039885749Z namespaces/kube-system/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.039940182Z namespaces/kube-system/coordination.k8s.io/leases/apiserver-fmz3fhlh4ljkroroahlctxfgoq.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.040028256Z namespaces/kube-system/coordination.k8s.io/leases/cert-manager-cainjector-leader-election.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.040135362Z namespaces/kube-system/coordination.k8s.io/leases/cert-manager-controller.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.040258349Z namespaces/kube-system/coordination.k8s.io/leases/kube-controller-manager.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.040409517Z namespaces/kube-system/coordination.k8s.io/leases/kube-scheduler.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.040493402Z namespaces/kube-system/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.040545834Z namespaces/kube-system/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.040724244Z namespaces/kube-system/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.041317406Z namespaces/kube-system/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.041660375Z namespaces/kube-system/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.041708357Z namespaces/kube-system/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.042030745Z namespaces/kube-system/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.042186714Z namespaces/kube-system/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.042545613Z namespaces/kube-system/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.042614317Z namespaces/kube-system/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.042658469Z namespaces/kube-system/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.042745294Z namespaces/kube-system/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.042776646Z namespaces/kube-system/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.042841709Z namespaces/kube-system/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.042890052Z namespaces/kube-system/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.042979366Z namespaces/kube-system/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.043080972Z namespaces/kube-system/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.043119174Z namespaces/kube-system/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.043176847Z namespaces/kube-system/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.043255152Z namespaces/kube-system/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.043299004Z namespaces/kube-system/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.043350397Z namespaces/kube-system/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.043364367Z namespaces/kube-system/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.04341993Z namespaces/kube-system/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.043586799Z namespaces/kube-system/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.04378553Z namespaces/kube-system/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.043928218Z namespaces/kube-system/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.044498919Z namespaces/kube-system/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.044764223Z namespaces/kube-system/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.044780714Z namespaces/kube-system/pods/global-pull-secret-syncer-6gvmb/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.044830417Z namespaces/kube-system/pods/global-pull-secret-syncer-6gvmb/global-pull-secret-syncer-6gvmb.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.044922912Z namespaces/kube-system/pods/global-pull-secret-syncer-6gvmb/global-pull-secret-syncer/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.044933052Z namespaces/kube-system/pods/global-pull-secret-syncer-6gvmb/global-pull-secret-syncer/global-pull-secret-syncer/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.044939683Z namespaces/kube-system/pods/global-pull-secret-syncer-6gvmb/global-pull-secret-syncer/global-pull-secret-syncer/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.044948183Z namespaces/kube-system/pods/global-pull-secret-syncer-6gvmb/global-pull-secret-syncer/global-pull-secret-syncer/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.045310803Z namespaces/kube-system/pods/global-pull-secret-syncer-6gvmb/global-pull-secret-syncer/global-pull-secret-syncer/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.045384297Z namespaces/kube-system/pods/global-pull-secret-syncer-6gvmb/global-pull-secret-syncer/global-pull-secret-syncer/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.045457151Z namespaces/kube-system/pods/global-pull-secret-syncer-sxzrc/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.045495093Z namespaces/kube-system/pods/global-pull-secret-syncer-sxzrc/global-pull-secret-syncer-sxzrc.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.045602179Z namespaces/kube-system/pods/global-pull-secret-syncer-sxzrc/global-pull-secret-syncer/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.045609069Z namespaces/kube-system/pods/global-pull-secret-syncer-sxzrc/global-pull-secret-syncer/global-pull-secret-syncer/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.045613309Z namespaces/kube-system/pods/global-pull-secret-syncer-sxzrc/global-pull-secret-syncer/global-pull-secret-syncer/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.045655162Z namespaces/kube-system/pods/global-pull-secret-syncer-sxzrc/global-pull-secret-syncer/global-pull-secret-syncer/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.04598756Z namespaces/kube-system/pods/global-pull-secret-syncer-sxzrc/global-pull-secret-syncer/global-pull-secret-syncer/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.046060004Z namespaces/kube-system/pods/global-pull-secret-syncer-sxzrc/global-pull-secret-syncer/global-pull-secret-syncer/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.046078965Z namespaces/kube-system/pods/global-pull-secret-syncer-v4744/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.046279625Z namespaces/kube-system/pods/global-pull-secret-syncer-v4744/global-pull-secret-syncer-v4744.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.046350959Z namespaces/kube-system/pods/global-pull-secret-syncer-v4744/global-pull-secret-syncer/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.04636302Z namespaces/kube-system/pods/global-pull-secret-syncer-v4744/global-pull-secret-syncer/global-pull-secret-syncer/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.046374811Z namespaces/kube-system/pods/global-pull-secret-syncer-v4744/global-pull-secret-syncer/global-pull-secret-syncer/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.046420253Z namespaces/kube-system/pods/global-pull-secret-syncer-v4744/global-pull-secret-syncer/global-pull-secret-syncer/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.046767162Z namespaces/kube-system/pods/global-pull-secret-syncer-v4744/global-pull-secret-syncer/global-pull-secret-syncer/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.046824785Z namespaces/kube-system/pods/global-pull-secret-syncer-v4744/global-pull-secret-syncer/global-pull-secret-syncer/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.046880708Z namespaces/kube-system/pods/konnectivity-agent-6qgmf/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.046895879Z namespaces/kube-system/pods/konnectivity-agent-6qgmf/konnectivity-agent-6qgmf.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.047011485Z namespaces/kube-system/pods/konnectivity-agent-6qgmf/konnectivity-agent/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.047021236Z namespaces/kube-system/pods/konnectivity-agent-6qgmf/konnectivity-agent/konnectivity-agent/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.047032046Z namespaces/kube-system/pods/konnectivity-agent-6qgmf/konnectivity-agent/konnectivity-agent/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.047072488Z namespaces/kube-system/pods/konnectivity-agent-6qgmf/konnectivity-agent/konnectivity-agent/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.048082373Z namespaces/kube-system/pods/konnectivity-agent-6qgmf/konnectivity-agent/konnectivity-agent/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.048150917Z namespaces/kube-system/pods/konnectivity-agent-6qgmf/konnectivity-agent/konnectivity-agent/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.048256343Z namespaces/kube-system/pods/konnectivity-agent-bbnng/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.048274914Z namespaces/kube-system/pods/konnectivity-agent-bbnng/konnectivity-agent-bbnng.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.048374769Z namespaces/kube-system/pods/konnectivity-agent-bbnng/konnectivity-agent/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.04838705Z namespaces/kube-system/pods/konnectivity-agent-bbnng/konnectivity-agent/konnectivity-agent/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.04839267Z namespaces/kube-system/pods/konnectivity-agent-bbnng/konnectivity-agent/konnectivity-agent/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.048402271Z namespaces/kube-system/pods/konnectivity-agent-bbnng/konnectivity-agent/konnectivity-agent/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.049205854Z namespaces/kube-system/pods/konnectivity-agent-bbnng/konnectivity-agent/konnectivity-agent/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.049283988Z namespaces/kube-system/pods/konnectivity-agent-bbnng/konnectivity-agent/konnectivity-agent/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.049399825Z namespaces/kube-system/pods/konnectivity-agent-plbcq/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.049558333Z namespaces/kube-system/pods/konnectivity-agent-plbcq/konnectivity-agent-plbcq.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.04969209Z namespaces/kube-system/pods/konnectivity-agent-plbcq/konnectivity-agent/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.049705151Z namespaces/kube-system/pods/konnectivity-agent-plbcq/konnectivity-agent/konnectivity-agent/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.049710662Z namespaces/kube-system/pods/konnectivity-agent-plbcq/konnectivity-agent/konnectivity-agent/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.049753784Z namespaces/kube-system/pods/konnectivity-agent-plbcq/konnectivity-agent/konnectivity-agent/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.050916277Z namespaces/kube-system/pods/konnectivity-agent-plbcq/konnectivity-agent/konnectivity-agent/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.051001592Z namespaces/kube-system/pods/konnectivity-agent-plbcq/konnectivity-agent/konnectivity-agent/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.051024773Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-128-142.ec2.internal/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.051097837Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-128-142.ec2.internal/kube-apiserver-proxy-ip-10-0-128-142.ec2.internal.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.051180121Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-128-142.ec2.internal/haproxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.051246965Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-128-142.ec2.internal/haproxy/haproxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.051262326Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-128-142.ec2.internal/haproxy/haproxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.051272666Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-128-142.ec2.internal/haproxy/haproxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.05152673Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-128-142.ec2.internal/haproxy/haproxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.051590544Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-128-142.ec2.internal/haproxy/haproxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.051641256Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.051688299Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.051788144Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal/haproxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.051797885Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal/haproxy/haproxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.051802065Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal/haproxy/haproxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.051863698Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal/haproxy/haproxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.052135583Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal/haproxy/haproxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.052251529Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal/haproxy/haproxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.052283171Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.052332254Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.052404048Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal/haproxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.052411118Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal/haproxy/haproxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.052414948Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal/haproxy/haproxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.052469021Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal/haproxy/haproxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.052913685Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal/haproxy/haproxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.053049333Z namespaces/kube-system/pods/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal/haproxy/haproxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.053133607Z namespaces/kube-system/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.053209761Z namespaces/kube-system/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.053268624Z namespaces/kube-system/rbac.authorization.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.053275995Z namespaces/kube-system/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.05336755Z namespaces/kube-system/rbac.authorization.k8s.io/rolebindings/csi-snapshot-controller-operator-authentication-reader.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.053484046Z namespaces/kube-system/rbac.authorization.k8s.io/rolebindings/network-diagnostics.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.053597592Z namespaces/kube-system/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.053658126Z namespaces/kube-system/rbac.authorization.k8s.io/roles/extension-apiserver-authentication-reader.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.05373857Z namespaces/kube-system/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.053795283Z namespaces/kube-system/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.053867937Z namespaces/open-cluster-management-agent-addon/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.053883278Z namespaces/open-cluster-management-agent-addon/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.053887648Z namespaces/open-cluster-management-agent-addon/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.053952381Z namespaces/open-cluster-management-agent-addon/coordination.k8s.io/leases/cluster-proxy.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.054118341Z namespaces/open-cluster-management-agent-addon/coordination.k8s.io/leases/work-manager.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.054235337Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.054251418Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.054300351Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.05466825Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.054919034Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.055097374Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.055450313Z namespaces/open-cluster-management-agent-addon/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.055706757Z namespaces/open-cluster-management-ca20abe1-5548-4ad5-9c4c-15adf1b57/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.055715177Z namespaces/open-cluster-management-ca20abe1-5548-4ad5-9c4c-15adf1b57/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.055747889Z namespaces/open-cluster-management-ca20abe1-5548-4ad5-9c4c-15adf1b57/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.055816933Z namespaces/open-cluster-management-ca20abe1-5548-4ad5-9c4c-15adf1b57/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.056016984Z namespaces/open-cluster-management-ca20abe1-5548-4ad5-9c4c-15adf1b57/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.056286318Z namespaces/open-cluster-management-ca20abe1-5548-4ad5-9c4c-15adf1b57/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.056796796Z namespaces/open-cluster-management-ca20abe1-5548-4ad5-9c4c-15adf1b57/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.057044409Z namespaces/open-cluster-management-ca20abe1-5548-4ad5-9c4c-15adf1b57/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.057367347Z namespaces/openshift-apiserver-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.05743314Z namespaces/openshift-apiserver-operator/openshift-apiserver-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.057533466Z namespaces/openshift-apiserver-operator/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.057594999Z namespaces/openshift-apiserver-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.057695084Z namespaces/openshift-apiserver-operator/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.057764398Z namespaces/openshift-apiserver-operator/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.057895746Z namespaces/openshift-apiserver-operator/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.058022732Z namespaces/openshift-apiserver-operator/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.058137879Z namespaces/openshift-apiserver-operator/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.058233694Z namespaces/openshift-apiserver-operator/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.058268646Z namespaces/openshift-apiserver-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.05835094Z namespaces/openshift-apiserver-operator/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.058409183Z namespaces/openshift-apiserver-operator/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.05852833Z namespaces/openshift-apiserver-operator/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.058589933Z namespaces/openshift-apiserver-operator/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.058655747Z namespaces/openshift-apiserver-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.058782434Z namespaces/openshift-apiserver-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.058850057Z namespaces/openshift-apiserver-operator/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.058911801Z namespaces/openshift-apiserver-operator/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.060044102Z namespaces/openshift-apiserver-operator/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.0601904Z namespaces/openshift-apiserver-operator/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.060294536Z namespaces/openshift-apiserver-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.06037699Z namespaces/openshift-apiserver-operator/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.060464345Z namespaces/openshift-apiserver-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.060610323Z namespaces/openshift-apiserver-operator/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.060801323Z namespaces/openshift-apiserver-operator/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.060953481Z namespaces/openshift-apiserver-operator/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.060971892Z namespaces/openshift-apiserver-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.061054227Z namespaces/openshift-apiserver-operator/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.061072578Z namespaces/openshift-apiserver-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.061137441Z namespaces/openshift-apiserver-operator/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.061215935Z namespaces/openshift-apiserver-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.061311341Z namespaces/openshift-apiserver-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.061397255Z namespaces/openshift-apiserver-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.061452698Z namespaces/openshift-apiserver-operator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.0614907Z namespaces/openshift-apiserver-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.061563564Z namespaces/openshift-apiserver-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.061592266Z namespaces/openshift-apiserver-operator/monitoring.coreos.com/servicemonitors/openshift-apiserver-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.061659599Z namespaces/openshift-apiserver-operator/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.061706202Z namespaces/openshift-apiserver-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.061769796Z namespaces/openshift-apiserver-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.061782676Z namespaces/openshift-apiserver-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.061797337Z namespaces/openshift-apiserver-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.061955855Z namespaces/openshift-apiserver-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.062138565Z namespaces/openshift-apiserver-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.062304385Z namespaces/openshift-apiserver-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.062701556Z namespaces/openshift-apiserver-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.062882216Z namespaces/openshift-apiserver-operator/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.062917918Z namespaces/openshift-apiserver-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.06297079Z namespaces/openshift-apiserver-operator/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.062998712Z namespaces/openshift-apiserver-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.063107918Z namespaces/openshift-apiserver/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.063156281Z namespaces/openshift-apiserver/openshift-apiserver.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.063352711Z namespaces/openshift-apiserver/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.063411074Z namespaces/openshift-apiserver/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.063457667Z namespaces/openshift-apiserver/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.06350243Z namespaces/openshift-apiserver/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.063588774Z namespaces/openshift-apiserver/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.063666208Z namespaces/openshift-apiserver/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.063750923Z namespaces/openshift-apiserver/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.063786735Z namespaces/openshift-apiserver/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.063819867Z namespaces/openshift-apiserver/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.063898481Z namespaces/openshift-apiserver/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.063933173Z namespaces/openshift-apiserver/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.064020978Z namespaces/openshift-apiserver/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.06406839Z namespaces/openshift-apiserver/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.064102702Z namespaces/openshift-apiserver/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.064224379Z namespaces/openshift-apiserver/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.064308133Z namespaces/openshift-apiserver/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.064343915Z namespaces/openshift-apiserver/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.064452831Z namespaces/openshift-apiserver/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.064532925Z namespaces/openshift-apiserver/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.06461502Z namespaces/openshift-apiserver/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.064697754Z namespaces/openshift-apiserver/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.064775348Z namespaces/openshift-apiserver/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.064912256Z namespaces/openshift-apiserver/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.065071244Z namespaces/openshift-apiserver/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.065137928Z namespaces/openshift-apiserver/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.065157039Z namespaces/openshift-apiserver/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.065266995Z namespaces/openshift-apiserver/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.065318738Z namespaces/openshift-apiserver/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.065370501Z namespaces/openshift-apiserver/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.065420303Z namespaces/openshift-apiserver/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.065506518Z namespaces/openshift-apiserver/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.065594283Z namespaces/openshift-apiserver/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.065646066Z namespaces/openshift-apiserver/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.065687068Z namespaces/openshift-apiserver/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.065752472Z namespaces/openshift-apiserver/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.065769302Z namespaces/openshift-apiserver/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.065828056Z namespaces/openshift-apiserver/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.065843266Z namespaces/openshift-apiserver/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.06590148Z namespaces/openshift-apiserver/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.066053228Z namespaces/openshift-apiserver/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.06627028Z namespaces/openshift-apiserver/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.066413697Z namespaces/openshift-apiserver/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.066612088Z namespaces/openshift-apiserver/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.066796118Z namespaces/openshift-apiserver/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.066816399Z namespaces/openshift-apiserver/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.067148607Z namespaces/openshift-apiserver/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.067214241Z namespaces/openshift-apiserver/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.067271954Z namespaces/openshift-authentication-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.067282104Z namespaces/openshift-authentication-operator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.067294815Z namespaces/openshift-authentication-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.067346268Z namespaces/openshift-authentication-operator/monitoring.coreos.com/servicemonitors/authentication-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.067404871Z namespaces/openshift-authentication-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.067417282Z namespaces/openshift-authentication-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.067482545Z namespaces/openshift-authentication-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.067625983Z namespaces/openshift-authentication-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.067836474Z namespaces/openshift-authentication-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.067979032Z namespaces/openshift-authentication-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.068217035Z namespaces/openshift-authentication-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.068410176Z namespaces/openshift-authentication/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.068420246Z namespaces/openshift-authentication/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.068434587Z namespaces/openshift-authentication/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.068502561Z namespaces/openshift-authentication/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.068649559Z namespaces/openshift-authentication/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.068832639Z namespaces/openshift-authentication/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.068973516Z namespaces/openshift-authentication/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.069236121Z namespaces/openshift-authentication/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.069463223Z namespaces/openshift-cloud-controller-manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.069474843Z namespaces/openshift-cloud-controller-manager/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.069480474Z namespaces/openshift-cloud-controller-manager/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.069524956Z namespaces/openshift-cloud-controller-manager/coordination.k8s.io/leases/cloud-controller-manager.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.069581209Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.06960113Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.069658263Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.069816982Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.070029283Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.070189932Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.070455016Z namespaces/openshift-cloud-controller-manager/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.070657798Z namespaces/openshift-cloud-credential-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.070668178Z namespaces/openshift-cloud-credential-operator/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.070673919Z namespaces/openshift-cloud-credential-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.070725721Z namespaces/openshift-cloud-credential-operator/coordination.k8s.io/leases/cloud-credential-operator-leader.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.070790735Z namespaces/openshift-cloud-credential-operator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.070801015Z namespaces/openshift-cloud-credential-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.070849398Z namespaces/openshift-cloud-credential-operator/monitoring.coreos.com/servicemonitors/cloud-credential-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.070926902Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.070937213Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.070986255Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.071148914Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.071372036Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.071519754Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.071742176Z namespaces/openshift-cloud-credential-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.072206351Z namespaces/openshift-cloud-network-config-controller/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.072280715Z namespaces/openshift-cloud-network-config-controller/openshift-cloud-network-config-controller.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.07235379Z namespaces/openshift-cloud-network-config-controller/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.072377151Z namespaces/openshift-cloud-network-config-controller/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.072460175Z namespaces/openshift-cloud-network-config-controller/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.072480386Z namespaces/openshift-cloud-network-config-controller/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.072583032Z namespaces/openshift-cloud-network-config-controller/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.072663036Z namespaces/openshift-cloud-network-config-controller/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.072744721Z namespaces/openshift-cloud-network-config-controller/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.072794313Z namespaces/openshift-cloud-network-config-controller/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.072837296Z namespaces/openshift-cloud-network-config-controller/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.072884588Z namespaces/openshift-cloud-network-config-controller/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.07291978Z namespaces/openshift-cloud-network-config-controller/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.073015085Z namespaces/openshift-cloud-network-config-controller/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.073059908Z namespaces/openshift-cloud-network-config-controller/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.07309513Z namespaces/openshift-cloud-network-config-controller/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.073185595Z namespaces/openshift-cloud-network-config-controller/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.073258768Z namespaces/openshift-cloud-network-config-controller/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.073270569Z namespaces/openshift-cloud-network-config-controller/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.073322192Z namespaces/openshift-cloud-network-config-controller/coordination.k8s.io/leases/cloud-network-config-controller-lock.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.073419127Z namespaces/openshift-cloud-network-config-controller/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.073441769Z namespaces/openshift-cloud-network-config-controller/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.07366159Z namespaces/openshift-cloud-network-config-controller/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.073743055Z namespaces/openshift-cloud-network-config-controller/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.073829119Z namespaces/openshift-cloud-network-config-controller/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.073908674Z namespaces/openshift-cloud-network-config-controller/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.073990938Z namespaces/openshift-cloud-network-config-controller/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.074151957Z namespaces/openshift-cloud-network-config-controller/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.074289735Z namespaces/openshift-cloud-network-config-controller/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.074345247Z namespaces/openshift-cloud-network-config-controller/core/serviceaccounts/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.074362468Z namespaces/openshift-cloud-network-config-controller/core/serviceaccounts/cloud-network-config-controller.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.074435282Z namespaces/openshift-cloud-network-config-controller/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.074458554Z namespaces/openshift-cloud-network-config-controller/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.074522837Z namespaces/openshift-cloud-network-config-controller/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.074540908Z namespaces/openshift-cloud-network-config-controller/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.074631893Z namespaces/openshift-cloud-network-config-controller/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.074650834Z namespaces/openshift-cloud-network-config-controller/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.07476146Z namespaces/openshift-cloud-network-config-controller/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.074838684Z namespaces/openshift-cloud-network-config-controller/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.074890387Z namespaces/openshift-cloud-network-config-controller/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.074911488Z namespaces/openshift-cloud-network-config-controller/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.074970301Z namespaces/openshift-cloud-network-config-controller/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.075041585Z namespaces/openshift-cloud-network-config-controller/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.075056306Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.075061746Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.07512032Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.075299649Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.075476439Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.075614926Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.075813077Z namespaces/openshift-cloud-network-config-controller/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.076007078Z namespaces/openshift-cloud-network-config-controller/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.076027519Z namespaces/openshift-cloud-network-config-controller/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.076103953Z namespaces/openshift-cloud-network-config-controller/rbac.authorization.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.076114194Z namespaces/openshift-cloud-network-config-controller/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.076128924Z namespaces/openshift-cloud-network-config-controller/rbac.authorization.k8s.io/rolebindings/cloud-network-config-controller-rb.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.07624103Z namespaces/openshift-cloud-network-config-controller/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.076261402Z namespaces/openshift-cloud-network-config-controller/rbac.authorization.k8s.io/roles/cloud-network-config-controller.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.076337686Z namespaces/openshift-cloud-network-config-controller/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.076371517Z namespaces/openshift-cloud-network-config-controller/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.076471223Z namespaces/openshift-cluster-csi-drivers/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.076524796Z namespaces/openshift-cluster-csi-drivers/openshift-cluster-csi-drivers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.07660699Z namespaces/openshift-cluster-csi-drivers/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.076625851Z namespaces/openshift-cluster-csi-drivers/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.076731317Z namespaces/openshift-cluster-csi-drivers/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.076747138Z namespaces/openshift-cluster-csi-drivers/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.076925287Z namespaces/openshift-cluster-csi-drivers/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.077000691Z namespaces/openshift-cluster-csi-drivers/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.077093916Z namespaces/openshift-cluster-csi-drivers/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.077142809Z namespaces/openshift-cluster-csi-drivers/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.077224964Z namespaces/openshift-cluster-csi-drivers/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.077275266Z namespaces/openshift-cluster-csi-drivers/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.07734872Z namespaces/openshift-cluster-csi-drivers/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.077449046Z namespaces/openshift-cluster-csi-drivers/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.077507599Z namespaces/openshift-cluster-csi-drivers/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.077546851Z namespaces/openshift-cluster-csi-drivers/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.077646937Z namespaces/openshift-cluster-csi-drivers/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.07770566Z namespaces/openshift-cluster-csi-drivers/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.07771529Z namespaces/openshift-cluster-csi-drivers/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.077756492Z namespaces/openshift-cluster-csi-drivers/coordination.k8s.io/leases/ebs-csi-aws-com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.077855478Z namespaces/openshift-cluster-csi-drivers/coordination.k8s.io/leases/external-attacher-leader-ebs-csi-aws-com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.077991545Z namespaces/openshift-cluster-csi-drivers/coordination.k8s.io/leases/external-resizer-ebs-csi-aws-com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.078127143Z namespaces/openshift-cluster-csi-drivers/coordination.k8s.io/leases/external-snapshotter-leader-ebs-csi-aws-com.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.07827136Z namespaces/openshift-cluster-csi-drivers/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.078296342Z namespaces/openshift-cluster-csi-drivers/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.078423819Z namespaces/openshift-cluster-csi-drivers/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.078503633Z namespaces/openshift-cluster-csi-drivers/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.078864583Z namespaces/openshift-cluster-csi-drivers/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.078966838Z namespaces/openshift-cluster-csi-drivers/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.079492827Z namespaces/openshift-cluster-csi-drivers/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.079678757Z namespaces/openshift-cluster-csi-drivers/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.079846216Z namespaces/openshift-cluster-csi-drivers/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.079901969Z namespaces/openshift-cluster-csi-drivers/core/serviceaccounts/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.07993345Z namespaces/openshift-cluster-csi-drivers/core/serviceaccounts/aws-ebs-csi-driver-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.080001764Z namespaces/openshift-cluster-csi-drivers/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.080043256Z namespaces/openshift-cluster-csi-drivers/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.080085229Z namespaces/openshift-cluster-csi-drivers/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.080120731Z namespaces/openshift-cluster-csi-drivers/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.080178264Z namespaces/openshift-cluster-csi-drivers/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.080252198Z namespaces/openshift-cluster-csi-drivers/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.080347973Z namespaces/openshift-cluster-csi-drivers/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.080433578Z namespaces/openshift-cluster-csi-drivers/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.08047435Z namespaces/openshift-cluster-csi-drivers/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.080521002Z namespaces/openshift-cluster-csi-drivers/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.080569585Z namespaces/openshift-cluster-csi-drivers/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.080608217Z namespaces/openshift-cluster-csi-drivers/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.080684831Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.080701242Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.080747395Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.080903393Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.081082733Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.081252452Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.081474854Z namespaces/openshift-cluster-csi-drivers/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.081676315Z namespaces/openshift-cluster-csi-drivers/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.081688836Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.081716637Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/aws-ebs-csi-driver-node-2pnv7.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.081865535Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/csi-driver/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.081876956Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/csi-driver/csi-driver/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.081882656Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/csi-driver/csi-driver/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.081928439Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/csi-driver/csi-driver/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.082030074Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/csi-driver/csi-driver/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.082097728Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/csi-driver/csi-driver/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.082112449Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/csi-liveness-probe/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.082121519Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/csi-liveness-probe/csi-liveness-probe/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.08212938Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/csi-liveness-probe/csi-liveness-probe/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.082213454Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/csi-liveness-probe/csi-liveness-probe/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.082308119Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/csi-liveness-probe/csi-liveness-probe/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.082373643Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/csi-liveness-probe/csi-liveness-probe/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.082649308Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/csi-node-driver-registrar/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.082661909Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/csi-node-driver-registrar/csi-node-driver-registrar/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.082667349Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/csi-node-driver-registrar/csi-node-driver-registrar/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.082710391Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/csi-node-driver-registrar/csi-node-driver-registrar/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.082811597Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/csi-node-driver-registrar/csi-node-driver-registrar/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.082883971Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-2pnv7/csi-node-driver-registrar/csi-node-driver-registrar/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.082920933Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.082969995Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/aws-ebs-csi-driver-node-p47tr.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.08306259Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/csi-driver/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.083073291Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/csi-driver/csi-driver/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.083089232Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/csi-driver/csi-driver/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.083133704Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/csi-driver/csi-driver/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.083270912Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/csi-driver/csi-driver/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.083332425Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/csi-driver/csi-driver/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.083350106Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/csi-liveness-probe/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.083364027Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/csi-liveness-probe/csi-liveness-probe/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.083381508Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/csi-liveness-probe/csi-liveness-probe/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.083433891Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/csi-liveness-probe/csi-liveness-probe/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.083523525Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/csi-liveness-probe/csi-liveness-probe/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.083591709Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/csi-liveness-probe/csi-liveness-probe/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.08360463Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/csi-node-driver-registrar/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.083618381Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/csi-node-driver-registrar/csi-node-driver-registrar/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.083635251Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/csi-node-driver-registrar/csi-node-driver-registrar/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.083682094Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/csi-node-driver-registrar/csi-node-driver-registrar/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.083776499Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/csi-node-driver-registrar/csi-node-driver-registrar/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.083846403Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-p47tr/csi-node-driver-registrar/csi-node-driver-registrar/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.083888435Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.084037323Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/aws-ebs-csi-driver-node-tsmnd.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.084119428Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/csi-driver/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.084131218Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/csi-driver/csi-driver/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.084143559Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/csi-driver/csi-driver/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.084213143Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/csi-driver/csi-driver/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.084309118Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/csi-driver/csi-driver/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.084373221Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/csi-driver/csi-driver/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.084424244Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/csi-liveness-probe/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.084433505Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/csi-liveness-probe/csi-liveness-probe/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.084439045Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/csi-liveness-probe/csi-liveness-probe/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.084486168Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/csi-liveness-probe/csi-liveness-probe/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.084564442Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/csi-liveness-probe/csi-liveness-probe/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.084638436Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/csi-liveness-probe/csi-liveness-probe/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.084682838Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/csi-node-driver-registrar/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.084691829Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/csi-node-driver-registrar/csi-node-driver-registrar/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.084708189Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/csi-node-driver-registrar/csi-node-driver-registrar/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.084755292Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/csi-node-driver-registrar/csi-node-driver-registrar/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.084855837Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/csi-node-driver-registrar/csi-node-driver-registrar/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085026257Z namespaces/openshift-cluster-csi-drivers/pods/aws-ebs-csi-driver-node-tsmnd/csi-node-driver-registrar/csi-node-driver-registrar/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085062729Z namespaces/openshift-cluster-csi-drivers/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085112271Z namespaces/openshift-cluster-csi-drivers/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085191006Z namespaces/openshift-cluster-csi-drivers/rbac.authorization.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085206127Z namespaces/openshift-cluster-csi-drivers/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085248659Z namespaces/openshift-cluster-csi-drivers/rbac.authorization.k8s.io/rolebindings/aws-ebs-csi-driver-operator-rolebinding.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085327833Z namespaces/openshift-cluster-csi-drivers/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085354455Z namespaces/openshift-cluster-csi-drivers/rbac.authorization.k8s.io/roles/aws-ebs-csi-driver-operator-role.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085431929Z namespaces/openshift-cluster-csi-drivers/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.08545098Z namespaces/openshift-cluster-csi-drivers/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085534224Z namespaces/openshift-cluster-machine-approver/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085543805Z namespaces/openshift-cluster-machine-approver/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085549585Z namespaces/openshift-cluster-machine-approver/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085597228Z namespaces/openshift-cluster-machine-approver/coordination.k8s.io/leases/cluster-machine-approver-leader.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085662911Z namespaces/openshift-cluster-machine-approver/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085672842Z namespaces/openshift-cluster-machine-approver/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085685053Z namespaces/openshift-cluster-machine-approver/monitoring.coreos.com/servicemonitors/cluster-machine-approver.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085765807Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085775478Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085834531Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.085990449Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.08618747Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.086330397Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.086522758Z namespaces/openshift-cluster-machine-approver/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.08692666Z namespaces/openshift-cluster-node-tuning-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.086961742Z namespaces/openshift-cluster-node-tuning-operator/openshift-cluster-node-tuning-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.087046096Z namespaces/openshift-cluster-node-tuning-operator/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.087082808Z namespaces/openshift-cluster-node-tuning-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.087155612Z namespaces/openshift-cluster-node-tuning-operator/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.087235737Z namespaces/openshift-cluster-node-tuning-operator/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.087367644Z namespaces/openshift-cluster-node-tuning-operator/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.087439278Z namespaces/openshift-cluster-node-tuning-operator/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.087518732Z namespaces/openshift-cluster-node-tuning-operator/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.087569245Z namespaces/openshift-cluster-node-tuning-operator/apps/daemonsets/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.087584916Z namespaces/openshift-cluster-node-tuning-operator/apps/daemonsets/tuned.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.087689461Z namespaces/openshift-cluster-node-tuning-operator/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.087712323Z namespaces/openshift-cluster-node-tuning-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.087776136Z namespaces/openshift-cluster-node-tuning-operator/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.08784969Z namespaces/openshift-cluster-node-tuning-operator/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.087880301Z namespaces/openshift-cluster-node-tuning-operator/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.087931944Z namespaces/openshift-cluster-node-tuning-operator/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.087962846Z namespaces/openshift-cluster-node-tuning-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.088060821Z namespaces/openshift-cluster-node-tuning-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.088098893Z namespaces/openshift-cluster-node-tuning-operator/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.088113074Z namespaces/openshift-cluster-node-tuning-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.088181038Z namespaces/openshift-cluster-node-tuning-operator/coordination.k8s.io/leases/node-tuning-operator-lock.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.088389839Z namespaces/openshift-cluster-node-tuning-operator/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.08840696Z namespaces/openshift-cluster-node-tuning-operator/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.08932901Z namespaces/openshift-cluster-node-tuning-operator/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.089443386Z namespaces/openshift-cluster-node-tuning-operator/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.089585874Z namespaces/openshift-cluster-node-tuning-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.089671549Z namespaces/openshift-cluster-node-tuning-operator/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.08987435Z namespaces/openshift-cluster-node-tuning-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.090042819Z namespaces/openshift-cluster-node-tuning-operator/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.090220179Z namespaces/openshift-cluster-node-tuning-operator/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.090293483Z namespaces/openshift-cluster-node-tuning-operator/core/serviceaccounts/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.090310393Z namespaces/openshift-cluster-node-tuning-operator/core/serviceaccounts/cluster-node-tuning-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.090387497Z namespaces/openshift-cluster-node-tuning-operator/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.09042946Z namespaces/openshift-cluster-node-tuning-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.090491543Z namespaces/openshift-cluster-node-tuning-operator/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.090514004Z namespaces/openshift-cluster-node-tuning-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.090591959Z namespaces/openshift-cluster-node-tuning-operator/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.09062282Z namespaces/openshift-cluster-node-tuning-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.090721126Z namespaces/openshift-cluster-node-tuning-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.09080484Z namespaces/openshift-cluster-node-tuning-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.090863053Z namespaces/openshift-cluster-node-tuning-operator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.090916766Z namespaces/openshift-cluster-node-tuning-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.0909856Z namespaces/openshift-cluster-node-tuning-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.091020482Z namespaces/openshift-cluster-node-tuning-operator/monitoring.coreos.com/prometheusrules/node-tuning-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.091103816Z namespaces/openshift-cluster-node-tuning-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.091136868Z namespaces/openshift-cluster-node-tuning-operator/monitoring.coreos.com/servicemonitors/node-tuning-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.091228163Z namespaces/openshift-cluster-node-tuning-operator/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.091249624Z namespaces/openshift-cluster-node-tuning-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.091323668Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.091339119Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.091395922Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.091565061Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.091983944Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.092181045Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.092394417Z namespaces/openshift-cluster-node-tuning-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.092623609Z namespaces/openshift-cluster-node-tuning-operator/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.092731605Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-4m96v/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.092796428Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-4m96v/tuned-4m96v.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.092943256Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-4m96v/tuned/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.092954907Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-4m96v/tuned/tuned/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.092966348Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-4m96v/tuned/tuned/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.093027151Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-4m96v/tuned/tuned/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.093184589Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-4m96v/tuned/tuned/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.093275514Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-4m96v/tuned/tuned/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.093356899Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-kkm4w/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.093395041Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-kkm4w/tuned-kkm4w.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.093498786Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-kkm4w/tuned/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.093509317Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-kkm4w/tuned/tuned/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.093515017Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-kkm4w/tuned/tuned/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.093523438Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-kkm4w/tuned/tuned/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.093737749Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-kkm4w/tuned/tuned/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.093807973Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-kkm4w/tuned/tuned/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.093821844Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-w9jwf/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.093884037Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-w9jwf/tuned-w9jwf.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.093969122Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-w9jwf/tuned/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.093979072Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-w9jwf/tuned/tuned/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.093983923Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-w9jwf/tuned/tuned/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.094024815Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-w9jwf/tuned/tuned/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.094193864Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-w9jwf/tuned/tuned/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.09430568Z namespaces/openshift-cluster-node-tuning-operator/pods/tuned-w9jwf/tuned/tuned/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.094349262Z namespaces/openshift-cluster-node-tuning-operator/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.094423987Z namespaces/openshift-cluster-node-tuning-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.094472119Z namespaces/openshift-cluster-node-tuning-operator/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.094561214Z namespaces/openshift-cluster-node-tuning-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.094699701Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.094716192Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/profiles/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.094783486Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/profiles/ip-10-0-128-142.ec2.internal.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.094908413Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/profiles/ip-10-0-130-182.ec2.internal.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.095027249Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/profiles/ip-10-0-142-172.ec2.internal.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.095097203Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/tuneds/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.095180628Z namespaces/openshift-cluster-node-tuning-operator/tuned.openshift.io/tuneds/default.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.095287883Z namespaces/openshift-cluster-samples-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.095364598Z namespaces/openshift-cluster-samples-operator/openshift-cluster-samples-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.095465973Z namespaces/openshift-cluster-samples-operator/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.095514696Z namespaces/openshift-cluster-samples-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.095615141Z namespaces/openshift-cluster-samples-operator/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.095654083Z namespaces/openshift-cluster-samples-operator/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.09578347Z namespaces/openshift-cluster-samples-operator/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.095934829Z namespaces/openshift-cluster-samples-operator/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.096074196Z namespaces/openshift-cluster-samples-operator/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.09614976Z namespaces/openshift-cluster-samples-operator/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.09632764Z namespaces/openshift-cluster-samples-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.096406804Z namespaces/openshift-cluster-samples-operator/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.096448626Z namespaces/openshift-cluster-samples-operator/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.096581193Z namespaces/openshift-cluster-samples-operator/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.096659878Z namespaces/openshift-cluster-samples-operator/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.09670479Z namespaces/openshift-cluster-samples-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.096834687Z namespaces/openshift-cluster-samples-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.096937673Z namespaces/openshift-cluster-samples-operator/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.096997686Z namespaces/openshift-cluster-samples-operator/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.097311523Z namespaces/openshift-cluster-samples-operator/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.09743329Z namespaces/openshift-cluster-samples-operator/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.097824161Z namespaces/openshift-cluster-samples-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.098007501Z namespaces/openshift-cluster-samples-operator/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.098254864Z namespaces/openshift-cluster-samples-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.098440174Z namespaces/openshift-cluster-samples-operator/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.098688398Z namespaces/openshift-cluster-samples-operator/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.098762852Z namespaces/openshift-cluster-samples-operator/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.098810364Z namespaces/openshift-cluster-samples-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.098943101Z namespaces/openshift-cluster-samples-operator/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.098981083Z namespaces/openshift-cluster-samples-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.09910015Z namespaces/openshift-cluster-samples-operator/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.099217936Z namespaces/openshift-cluster-samples-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.099490531Z namespaces/openshift-cluster-samples-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.099592367Z namespaces/openshift-cluster-samples-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.09965861Z namespaces/openshift-cluster-samples-operator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.099706583Z namespaces/openshift-cluster-samples-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.099804498Z namespaces/openshift-cluster-samples-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.09984517Z namespaces/openshift-cluster-samples-operator/monitoring.coreos.com/prometheusrules/samples-operator-alerts.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.099943816Z namespaces/openshift-cluster-samples-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.099964117Z namespaces/openshift-cluster-samples-operator/monitoring.coreos.com/servicemonitors/cluster-samples-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.10002968Z namespaces/openshift-cluster-samples-operator/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.100051942Z namespaces/openshift-cluster-samples-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.100116535Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.100126436Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.100141837Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.100438373Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.100667205Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.100808703Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.101017844Z namespaces/openshift-cluster-samples-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.101226595Z namespaces/openshift-cluster-samples-operator/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.101245477Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-56fcf86bf-6bprr/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.101254527Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-56fcf86bf-6bprr/cluster-samples-operator-56fcf86bf-6bprr.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.101387584Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-56fcf86bf-6bprr/cluster-samples-operator-watch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.101398535Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-56fcf86bf-6bprr/cluster-samples-operator-watch/cluster-samples-operator-watch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.101405775Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-56fcf86bf-6bprr/cluster-samples-operator-watch/cluster-samples-operator-watch/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.101435377Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-56fcf86bf-6bprr/cluster-samples-operator-watch/cluster-samples-operator-watch/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.102085892Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-56fcf86bf-6bprr/cluster-samples-operator-watch/cluster-samples-operator-watch/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.102355707Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-56fcf86bf-6bprr/cluster-samples-operator-watch/cluster-samples-operator-watch/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.102391939Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-56fcf86bf-6bprr/cluster-samples-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.102431361Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-56fcf86bf-6bprr/cluster-samples-operator/cluster-samples-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.102493664Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-56fcf86bf-6bprr/cluster-samples-operator/cluster-samples-operator/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.102502745Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-56fcf86bf-6bprr/cluster-samples-operator/cluster-samples-operator/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.103049854Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-56fcf86bf-6bprr/cluster-samples-operator/cluster-samples-operator/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.103447026Z namespaces/openshift-cluster-samples-operator/pods/cluster-samples-operator-56fcf86bf-6bprr/cluster-samples-operator/cluster-samples-operator/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.103465557Z namespaces/openshift-cluster-samples-operator/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.103473177Z namespaces/openshift-cluster-samples-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.103490078Z namespaces/openshift-cluster-samples-operator/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.103497008Z namespaces/openshift-cluster-samples-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.103503479Z namespaces/openshift-cluster-storage-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.103510029Z namespaces/openshift-cluster-storage-operator/openshift-cluster-storage-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.10351577Z namespaces/openshift-cluster-storage-operator/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.103533261Z namespaces/openshift-cluster-storage-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.103547571Z namespaces/openshift-cluster-storage-operator/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.103569623Z namespaces/openshift-cluster-storage-operator/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.103627996Z namespaces/openshift-cluster-storage-operator/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.103734972Z namespaces/openshift-cluster-storage-operator/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.103845367Z namespaces/openshift-cluster-storage-operator/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.10389497Z namespaces/openshift-cluster-storage-operator/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.103929852Z namespaces/openshift-cluster-storage-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.104407948Z namespaces/openshift-cluster-storage-operator/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.104479402Z namespaces/openshift-cluster-storage-operator/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.104643741Z namespaces/openshift-cluster-storage-operator/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.104741626Z namespaces/openshift-cluster-storage-operator/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.104779518Z namespaces/openshift-cluster-storage-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.104872183Z namespaces/openshift-cluster-storage-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.104909685Z namespaces/openshift-cluster-storage-operator/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.104927176Z namespaces/openshift-cluster-storage-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.104970199Z namespaces/openshift-cluster-storage-operator/coordination.k8s.io/leases/data-source-validator-leader.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.105074204Z namespaces/openshift-cluster-storage-operator/coordination.k8s.io/leases/snapshot-controller-leader.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.10519109Z namespaces/openshift-cluster-storage-operator/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.105262134Z namespaces/openshift-cluster-storage-operator/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.105421953Z namespaces/openshift-cluster-storage-operator/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.105508328Z namespaces/openshift-cluster-storage-operator/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.105837826Z namespaces/openshift-cluster-storage-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.105976973Z namespaces/openshift-cluster-storage-operator/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.10609622Z namespaces/openshift-cluster-storage-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.106321442Z namespaces/openshift-cluster-storage-operator/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.10647603Z namespaces/openshift-cluster-storage-operator/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.106550104Z namespaces/openshift-cluster-storage-operator/core/serviceaccounts/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.106591636Z namespaces/openshift-cluster-storage-operator/core/serviceaccounts/csi-snapshot-controller-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.106666931Z namespaces/openshift-cluster-storage-operator/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.106689912Z namespaces/openshift-cluster-storage-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.106766976Z namespaces/openshift-cluster-storage-operator/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.106785017Z namespaces/openshift-cluster-storage-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.106857121Z namespaces/openshift-cluster-storage-operator/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.106904183Z namespaces/openshift-cluster-storage-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.106992428Z namespaces/openshift-cluster-storage-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.107067872Z namespaces/openshift-cluster-storage-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.107132256Z namespaces/openshift-cluster-storage-operator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.107154527Z namespaces/openshift-cluster-storage-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.107261143Z namespaces/openshift-cluster-storage-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.107281264Z namespaces/openshift-cluster-storage-operator/monitoring.coreos.com/prometheusrules/prometheus.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.10740268Z namespaces/openshift-cluster-storage-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.107423652Z namespaces/openshift-cluster-storage-operator/monitoring.coreos.com/servicemonitors/cluster-storage-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.107499446Z namespaces/openshift-cluster-storage-operator/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.107556429Z namespaces/openshift-cluster-storage-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.107645404Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.107655924Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.107694506Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.107869606Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.108022884Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.108156091Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.108401714Z namespaces/openshift-cluster-storage-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.108843798Z namespaces/openshift-cluster-storage-operator/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.108856169Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-5d456fdbcd-2kj9p/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.10887004Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-5d456fdbcd-2kj9p/volume-data-source-validator-5d456fdbcd-2kj9p.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.108952744Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-5d456fdbcd-2kj9p/volume-data-source-validator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.108964015Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-5d456fdbcd-2kj9p/volume-data-source-validator/volume-data-source-validator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.108971155Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-5d456fdbcd-2kj9p/volume-data-source-validator/volume-data-source-validator/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.109010118Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-5d456fdbcd-2kj9p/volume-data-source-validator/volume-data-source-validator/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.109108303Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-5d456fdbcd-2kj9p/volume-data-source-validator/volume-data-source-validator/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.109203348Z namespaces/openshift-cluster-storage-operator/pods/volume-data-source-validator-5d456fdbcd-2kj9p/volume-data-source-validator/volume-data-source-validator/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.109228089Z namespaces/openshift-cluster-storage-operator/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.109300473Z namespaces/openshift-cluster-storage-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.109353326Z namespaces/openshift-cluster-storage-operator/rbac.authorization.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.109363837Z namespaces/openshift-cluster-storage-operator/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.10941934Z namespaces/openshift-cluster-storage-operator/rbac.authorization.k8s.io/rolebindings/csi-snapshot-controller-operator-role.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.109471792Z namespaces/openshift-cluster-storage-operator/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.109509195Z namespaces/openshift-cluster-storage-operator/rbac.authorization.k8s.io/roles/csi-snapshot-controller-operator-role.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.109568708Z namespaces/openshift-cluster-storage-operator/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.109616371Z namespaces/openshift-cluster-storage-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.109702345Z namespaces/openshift-cluster-version/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.109740377Z namespaces/openshift-cluster-version/openshift-cluster-version.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.109811301Z namespaces/openshift-cluster-version/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.109834322Z namespaces/openshift-cluster-version/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.109918007Z namespaces/openshift-cluster-version/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.109938388Z namespaces/openshift-cluster-version/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.110034543Z namespaces/openshift-cluster-version/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.110110547Z namespaces/openshift-cluster-version/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.110222003Z namespaces/openshift-cluster-version/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.110258035Z namespaces/openshift-cluster-version/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.110309468Z namespaces/openshift-cluster-version/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.110377652Z namespaces/openshift-cluster-version/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.110397793Z namespaces/openshift-cluster-version/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.110499598Z namespaces/openshift-cluster-version/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.110558731Z namespaces/openshift-cluster-version/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.110605324Z namespaces/openshift-cluster-version/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.110682108Z namespaces/openshift-cluster-version/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.110735541Z namespaces/openshift-cluster-version/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.110747582Z namespaces/openshift-cluster-version/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.110758532Z namespaces/openshift-cluster-version/coordination.k8s.io/leases/version.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.110855758Z namespaces/openshift-cluster-version/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.110884519Z namespaces/openshift-cluster-version/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.111003556Z namespaces/openshift-cluster-version/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.111104141Z namespaces/openshift-cluster-version/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.111237368Z namespaces/openshift-cluster-version/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.111325863Z namespaces/openshift-cluster-version/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.111403617Z namespaces/openshift-cluster-version/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.111541025Z namespaces/openshift-cluster-version/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.111720094Z namespaces/openshift-cluster-version/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.111765077Z namespaces/openshift-cluster-version/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.111863682Z namespaces/openshift-cluster-version/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.111899954Z namespaces/openshift-cluster-version/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.111937856Z namespaces/openshift-cluster-version/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.11200479Z namespaces/openshift-cluster-version/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.112040682Z namespaces/openshift-cluster-version/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.112130367Z namespaces/openshift-cluster-version/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.112239043Z namespaces/openshift-cluster-version/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.112263354Z namespaces/openshift-cluster-version/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.112327378Z namespaces/openshift-cluster-version/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.11236861Z namespaces/openshift-cluster-version/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.112390411Z namespaces/openshift-cluster-version/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.112462745Z namespaces/openshift-cluster-version/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.112487786Z namespaces/openshift-cluster-version/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.112533098Z namespaces/openshift-cluster-version/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.112682667Z namespaces/openshift-cluster-version/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.112857046Z namespaces/openshift-cluster-version/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.112997054Z namespaces/openshift-cluster-version/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.113209975Z namespaces/openshift-cluster-version/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.113443338Z namespaces/openshift-cluster-version/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.1134729Z namespaces/openshift-cluster-version/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.113550764Z namespaces/openshift-cluster-version/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.113574145Z namespaces/openshift-cluster-version/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.113694161Z namespaces/openshift-config-managed/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.113732954Z namespaces/openshift-config-managed/openshift-config-managed.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.113797347Z namespaces/openshift-config-managed/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.113837499Z namespaces/openshift-config-managed/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.113909913Z namespaces/openshift-config-managed/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.113932434Z namespaces/openshift-config-managed/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.11402844Z namespaces/openshift-config-managed/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.114102524Z namespaces/openshift-config-managed/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.114232781Z namespaces/openshift-config-managed/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.114259102Z namespaces/openshift-config-managed/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.114312735Z namespaces/openshift-config-managed/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.114372938Z namespaces/openshift-config-managed/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.11441268Z namespaces/openshift-config-managed/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.114505556Z namespaces/openshift-config-managed/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.114549368Z namespaces/openshift-config-managed/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.11458586Z namespaces/openshift-config-managed/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.114661284Z namespaces/openshift-config-managed/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.114749559Z namespaces/openshift-config-managed/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.114790621Z namespaces/openshift-config-managed/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.118224237Z namespaces/openshift-config-managed/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.118306432Z namespaces/openshift-config-managed/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.118394616Z namespaces/openshift-config-managed/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.118602118Z namespaces/openshift-config-managed/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.118677472Z namespaces/openshift-config-managed/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.118858022Z namespaces/openshift-config-managed/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.118961417Z namespaces/openshift-config-managed/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.11901401Z namespaces/openshift-config-managed/core/configmaps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.119053452Z namespaces/openshift-config-managed/core/configmaps/console-public.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.119142047Z namespaces/openshift-config-managed/core/configmaps/openshift-network-features.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.119249063Z namespaces/openshift-config-managed/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.119291745Z namespaces/openshift-config-managed/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.119346108Z namespaces/openshift-config-managed/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.11938753Z namespaces/openshift-config-managed/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.119451744Z namespaces/openshift-config-managed/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.119493906Z namespaces/openshift-config-managed/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.119582711Z namespaces/openshift-config-managed/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.119664155Z namespaces/openshift-config-managed/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.119736459Z namespaces/openshift-config-managed/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.119816824Z namespaces/openshift-config-managed/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.119870916Z namespaces/openshift-config-managed/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.11993408Z namespaces/openshift-config-managed/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.119992383Z namespaces/openshift-config-managed/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.120028415Z namespaces/openshift-config-managed/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.120106459Z namespaces/openshift-config-managed/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.120348482Z namespaces/openshift-config-managed/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.120554934Z namespaces/openshift-config-managed/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.120726573Z namespaces/openshift-config-managed/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.120951175Z namespaces/openshift-config-managed/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.121202509Z namespaces/openshift-config-managed/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.121375238Z namespaces/openshift-config-managed/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.121453042Z namespaces/openshift-config-managed/rbac.authorization.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.121462763Z namespaces/openshift-config-managed/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.121514926Z namespaces/openshift-config-managed/rbac.authorization.k8s.io/rolebindings/openshift-network-public-role-binding.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.121577659Z namespaces/openshift-config-managed/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.121704876Z namespaces/openshift-config-managed/rbac.authorization.k8s.io/roles/openshift-network-public-role.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.121758549Z namespaces/openshift-config-managed/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.12177404Z namespaces/openshift-config-managed/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.121856294Z namespaces/openshift-config-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.121868025Z namespaces/openshift-config-operator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.121874755Z namespaces/openshift-config-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.121927508Z namespaces/openshift-config-operator/monitoring.coreos.com/servicemonitors/config-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.121996592Z namespaces/openshift-config-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.122009792Z namespaces/openshift-config-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.122046745Z namespaces/openshift-config-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.122234395Z namespaces/openshift-config-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.122404744Z namespaces/openshift-config-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.122541531Z namespaces/openshift-config-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.122756353Z namespaces/openshift-config-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.122976455Z namespaces/openshift-config/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.123018707Z namespaces/openshift-config/openshift-config.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.12325696Z namespaces/openshift-config/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.123303613Z namespaces/openshift-config/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.123385267Z namespaces/openshift-config/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.12342772Z namespaces/openshift-config/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.123517484Z namespaces/openshift-config/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.123590988Z namespaces/openshift-config/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.123671923Z namespaces/openshift-config/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.123706964Z namespaces/openshift-config/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.123795999Z namespaces/openshift-config/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.123833711Z namespaces/openshift-config/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.123880004Z namespaces/openshift-config/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.123940377Z namespaces/openshift-config/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.124009261Z namespaces/openshift-config/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.124024112Z namespaces/openshift-config/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.124243044Z namespaces/openshift-config/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.124267215Z namespaces/openshift-config/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.124335619Z namespaces/openshift-config/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.124445865Z namespaces/openshift-config/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.124522789Z namespaces/openshift-config/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.124601183Z namespaces/openshift-config/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.124683928Z namespaces/openshift-config/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.124756912Z namespaces/openshift-config/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.12491458Z namespaces/openshift-config/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.125076349Z namespaces/openshift-config/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.125139332Z namespaces/openshift-config/core/secrets/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.125212456Z namespaces/openshift-config/core/secrets/pull-secret.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.12528579Z namespaces/openshift-config/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.125313282Z namespaces/openshift-config/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.125396056Z namespaces/openshift-config/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.125424148Z namespaces/openshift-config/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.125490931Z namespaces/openshift-config/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.125516143Z namespaces/openshift-config/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.125609458Z namespaces/openshift-config/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.125692642Z namespaces/openshift-config/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.125747745Z namespaces/openshift-config/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.125768356Z namespaces/openshift-config/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.12583123Z namespaces/openshift-config/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.125870062Z namespaces/openshift-config/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.125932435Z namespaces/openshift-config/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.125954286Z namespaces/openshift-config/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.125992428Z namespaces/openshift-config/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.126135776Z namespaces/openshift-config/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.126347748Z namespaces/openshift-config/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.126483675Z namespaces/openshift-config/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.126703607Z namespaces/openshift-config/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.126901038Z namespaces/openshift-config/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.126922719Z namespaces/openshift-config/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.126973352Z namespaces/openshift-config/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.127000543Z namespaces/openshift-config/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.127110089Z namespaces/openshift-console-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.1271338Z namespaces/openshift-console-operator/openshift-console-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.12730195Z namespaces/openshift-console-operator/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.127333561Z namespaces/openshift-console-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.127370673Z namespaces/openshift-console-operator/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.127437297Z namespaces/openshift-console-operator/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.127516531Z namespaces/openshift-console-operator/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.127632297Z namespaces/openshift-console-operator/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.127744234Z namespaces/openshift-console-operator/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.127764335Z namespaces/openshift-console-operator/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.127824838Z namespaces/openshift-console-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.127881731Z namespaces/openshift-console-operator/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.127908083Z namespaces/openshift-console-operator/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.127997357Z namespaces/openshift-console-operator/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.128011958Z namespaces/openshift-console-operator/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.128074672Z namespaces/openshift-console-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.128180467Z namespaces/openshift-console-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.128209299Z namespaces/openshift-console-operator/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.128221429Z namespaces/openshift-console-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.128280123Z namespaces/openshift-console-operator/coordination.k8s.io/leases/console-operator-lock.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.128369537Z namespaces/openshift-console-operator/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.128392579Z namespaces/openshift-console-operator/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.128987791Z namespaces/openshift-console-operator/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.129054395Z namespaces/openshift-console-operator/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.129599354Z namespaces/openshift-console-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.129674858Z namespaces/openshift-console-operator/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.129800895Z namespaces/openshift-console-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.129933772Z namespaces/openshift-console-operator/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.130113462Z namespaces/openshift-console-operator/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.130280161Z namespaces/openshift-console-operator/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.130325214Z namespaces/openshift-console-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.130399747Z namespaces/openshift-console-operator/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.13044333Z namespaces/openshift-console-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.130495693Z namespaces/openshift-console-operator/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.130536395Z namespaces/openshift-console-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.130618859Z namespaces/openshift-console-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.130693974Z namespaces/openshift-console-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.130754527Z namespaces/openshift-console-operator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.130795179Z namespaces/openshift-console-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.130847792Z namespaces/openshift-console-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.130888534Z namespaces/openshift-console-operator/monitoring.coreos.com/prometheusrules/cluster-monitoring-prometheus-rules.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.130946217Z namespaces/openshift-console-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.130987879Z namespaces/openshift-console-operator/monitoring.coreos.com/servicemonitors/console-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.131037202Z namespaces/openshift-console-operator/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.131077674Z namespaces/openshift-console-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.131121397Z namespaces/openshift-console-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.131131547Z namespaces/openshift-console-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.131237603Z namespaces/openshift-console-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.13137004Z namespaces/openshift-console-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.13154486Z namespaces/openshift-console-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.131685367Z namespaces/openshift-console-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.131903589Z namespaces/openshift-console-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.132083609Z namespaces/openshift-console-operator/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.132095319Z namespaces/openshift-console-operator/pods/console-operator-68b757fb67-vj8l6/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.132145382Z namespaces/openshift-console-operator/pods/console-operator-68b757fb67-vj8l6/console-operator-68b757fb67-vj8l6.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.132366244Z namespaces/openshift-console-operator/pods/console-operator-68b757fb67-vj8l6/console-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.132383935Z namespaces/openshift-console-operator/pods/console-operator-68b757fb67-vj8l6/console-operator/console-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.132400166Z namespaces/openshift-console-operator/pods/console-operator-68b757fb67-vj8l6/console-operator/console-operator/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.132421657Z namespaces/openshift-console-operator/pods/console-operator-68b757fb67-vj8l6/console-operator/console-operator/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.132913714Z namespaces/openshift-console-operator/pods/console-operator-68b757fb67-vj8l6/console-operator/console-operator/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.132979387Z namespaces/openshift-console-operator/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.133003039Z namespaces/openshift-console-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.133072012Z namespaces/openshift-console-operator/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.133097594Z namespaces/openshift-console-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.133187339Z namespaces/openshift-console-user-settings/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.13320453Z namespaces/openshift-console-user-settings/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.13321585Z namespaces/openshift-console-user-settings/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.133270163Z namespaces/openshift-console-user-settings/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.133443763Z namespaces/openshift-console-user-settings/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.133619562Z namespaces/openshift-console-user-settings/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.133744939Z namespaces/openshift-console-user-settings/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.13394402Z namespaces/openshift-console-user-settings/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.134181573Z namespaces/openshift-console/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.134230085Z namespaces/openshift-console/openshift-console.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.134573214Z namespaces/openshift-console/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.134591655Z namespaces/openshift-console/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.134660589Z namespaces/openshift-console/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.13468092Z namespaces/openshift-console/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.134794806Z namespaces/openshift-console/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.134979446Z namespaces/openshift-console/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.135292003Z namespaces/openshift-console/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.135321494Z namespaces/openshift-console/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.135380798Z namespaces/openshift-console/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.135441241Z namespaces/openshift-console/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.135476583Z namespaces/openshift-console/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.135563008Z namespaces/openshift-console/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.135624181Z namespaces/openshift-console/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.135664713Z namespaces/openshift-console/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.135744937Z namespaces/openshift-console/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.13578627Z namespaces/openshift-console/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.135829952Z namespaces/openshift-console/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.136456306Z namespaces/openshift-console/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.136546171Z namespaces/openshift-console/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.136983665Z namespaces/openshift-console/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.137055668Z namespaces/openshift-console/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.13725723Z namespaces/openshift-console/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.137421328Z namespaces/openshift-console/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.137612779Z namespaces/openshift-console/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.137670452Z namespaces/openshift-console/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.137719864Z namespaces/openshift-console/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.137795419Z namespaces/openshift-console/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.13781915Z namespaces/openshift-console/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.137901144Z namespaces/openshift-console/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.137926026Z namespaces/openshift-console/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.138021011Z namespaces/openshift-console/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.138108156Z namespaces/openshift-console/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.138159518Z namespaces/openshift-console/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.138233212Z namespaces/openshift-console/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.138307346Z namespaces/openshift-console/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.138355349Z namespaces/openshift-console/monitoring.coreos.com/servicemonitors/console.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.138418862Z namespaces/openshift-console/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.138448064Z namespaces/openshift-console/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.138527788Z namespaces/openshift-console/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.138537699Z namespaces/openshift-console/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.13855155Z namespaces/openshift-console/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.138769992Z namespaces/openshift-console/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.138999584Z namespaces/openshift-console/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.139131651Z namespaces/openshift-console/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.139425617Z namespaces/openshift-console/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.139635768Z namespaces/openshift-console/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.139647349Z namespaces/openshift-console/pods/console-85d9d9b968-h2892/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.13966195Z namespaces/openshift-console/pods/console-85d9d9b968-h2892/console-85d9d9b968-h2892.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.139775536Z namespaces/openshift-console/pods/console-85d9d9b968-h2892/console/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.139785927Z namespaces/openshift-console/pods/console-85d9d9b968-h2892/console/console/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.139792307Z namespaces/openshift-console/pods/console-85d9d9b968-h2892/console/console/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.139811268Z namespaces/openshift-console/pods/console-85d9d9b968-h2892/console/console/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.139913643Z namespaces/openshift-console/pods/console-85d9d9b968-h2892/console/console/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.139979027Z namespaces/openshift-console/pods/console-85d9d9b968-h2892/console/console/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.139997988Z namespaces/openshift-console/pods/downloads-685bfb5f64-v54bj/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.140046141Z namespaces/openshift-console/pods/downloads-685bfb5f64-v54bj/downloads-685bfb5f64-v54bj.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.140136636Z namespaces/openshift-console/pods/downloads-685bfb5f64-v54bj/download-server/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.140147886Z namespaces/openshift-console/pods/downloads-685bfb5f64-v54bj/download-server/download-server/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.140154047Z namespaces/openshift-console/pods/downloads-685bfb5f64-v54bj/download-server/download-server/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.140181638Z namespaces/openshift-console/pods/downloads-685bfb5f64-v54bj/download-server/download-server/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.140536597Z namespaces/openshift-console/pods/downloads-685bfb5f64-v54bj/download-server/download-server/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.14057966Z namespaces/openshift-console/pods/downloads-685bfb5f64-v54bj/download-server/download-server/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.140638263Z namespaces/openshift-console/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.140657724Z namespaces/openshift-console/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.140742668Z namespaces/openshift-console/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.140757299Z namespaces/openshift-console/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.140860915Z namespaces/openshift-controller-manager-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.140931759Z namespaces/openshift-controller-manager-operator/openshift-controller-manager-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.140968441Z namespaces/openshift-controller-manager-operator/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.141024844Z namespaces/openshift-controller-manager-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.141082427Z namespaces/openshift-controller-manager-operator/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.141099468Z namespaces/openshift-controller-manager-operator/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.141216464Z namespaces/openshift-controller-manager-operator/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.14131325Z namespaces/openshift-controller-manager-operator/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.141382883Z namespaces/openshift-controller-manager-operator/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.141442166Z namespaces/openshift-controller-manager-operator/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.141474438Z namespaces/openshift-controller-manager-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.141538412Z namespaces/openshift-controller-manager-operator/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.141598135Z namespaces/openshift-controller-manager-operator/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.141664958Z namespaces/openshift-controller-manager-operator/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.141733752Z namespaces/openshift-controller-manager-operator/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.141771004Z namespaces/openshift-controller-manager-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.141863889Z namespaces/openshift-controller-manager-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.141932133Z namespaces/openshift-controller-manager-operator/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.141957854Z namespaces/openshift-controller-manager-operator/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.142087861Z namespaces/openshift-controller-manager-operator/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.142182826Z namespaces/openshift-controller-manager-operator/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.142267181Z namespaces/openshift-controller-manager-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.142352866Z namespaces/openshift-controller-manager-operator/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.14243511Z namespaces/openshift-controller-manager-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.142742647Z namespaces/openshift-controller-manager-operator/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.142925457Z namespaces/openshift-controller-manager-operator/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.14298417Z namespaces/openshift-controller-manager-operator/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.143036723Z namespaces/openshift-controller-manager-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.143092066Z namespaces/openshift-controller-manager-operator/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.143131888Z namespaces/openshift-controller-manager-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.143193072Z namespaces/openshift-controller-manager-operator/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.143239004Z namespaces/openshift-controller-manager-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.143328939Z namespaces/openshift-controller-manager-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.143412213Z namespaces/openshift-controller-manager-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.143448335Z namespaces/openshift-controller-manager-operator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.143488937Z namespaces/openshift-controller-manager-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.143522349Z namespaces/openshift-controller-manager-operator/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.143573662Z namespaces/openshift-controller-manager-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.143605894Z namespaces/openshift-controller-manager-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.143610864Z namespaces/openshift-controller-manager-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.143666297Z namespaces/openshift-controller-manager-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.143819115Z namespaces/openshift-controller-manager-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.143996055Z namespaces/openshift-controller-manager-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.144128652Z namespaces/openshift-controller-manager-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.144363765Z namespaces/openshift-controller-manager-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.144552915Z namespaces/openshift-controller-manager-operator/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.144567746Z namespaces/openshift-controller-manager-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.144631639Z namespaces/openshift-controller-manager-operator/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.14464572Z namespaces/openshift-controller-manager-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.144758836Z namespaces/openshift-controller-manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.144772717Z namespaces/openshift-controller-manager/openshift-controller-manager.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.144852161Z namespaces/openshift-controller-manager/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.144876563Z namespaces/openshift-controller-manager/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.144955037Z namespaces/openshift-controller-manager/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.144975898Z namespaces/openshift-controller-manager/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.145076763Z namespaces/openshift-controller-manager/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.145148707Z namespaces/openshift-controller-manager/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.145263104Z namespaces/openshift-controller-manager/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.145315416Z namespaces/openshift-controller-manager/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.14538061Z namespaces/openshift-controller-manager/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.145403491Z namespaces/openshift-controller-manager/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.145464095Z namespaces/openshift-controller-manager/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.145538339Z namespaces/openshift-controller-manager/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.145609303Z namespaces/openshift-controller-manager/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.145631044Z namespaces/openshift-controller-manager/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.145736549Z namespaces/openshift-controller-manager/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.14575892Z namespaces/openshift-controller-manager/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.145832755Z namespaces/openshift-controller-manager/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.145881947Z namespaces/openshift-controller-manager/coordination.k8s.io/leases/openshift-master-controllers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.145972622Z namespaces/openshift-controller-manager/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.145987133Z namespaces/openshift-controller-manager/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.14611427Z namespaces/openshift-controller-manager/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.146233036Z namespaces/openshift-controller-manager/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.146334482Z namespaces/openshift-controller-manager/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.146407686Z namespaces/openshift-controller-manager/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.14648719Z namespaces/openshift-controller-manager/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.146622318Z namespaces/openshift-controller-manager/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.146791167Z namespaces/openshift-controller-manager/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.14686175Z namespaces/openshift-controller-manager/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.146908103Z namespaces/openshift-controller-manager/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.146943025Z namespaces/openshift-controller-manager/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.147016839Z namespaces/openshift-controller-manager/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.147074982Z namespaces/openshift-controller-manager/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.147135135Z namespaces/openshift-controller-manager/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.147264872Z namespaces/openshift-controller-manager/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.147357207Z namespaces/openshift-controller-manager/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.147570379Z namespaces/openshift-controller-manager/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.14758491Z namespaces/openshift-controller-manager/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.147651123Z namespaces/openshift-controller-manager/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.147710656Z namespaces/openshift-controller-manager/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.147765329Z namespaces/openshift-controller-manager/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.14777615Z namespaces/openshift-controller-manager/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.147789431Z namespaces/openshift-controller-manager/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.14796829Z namespaces/openshift-controller-manager/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.14814499Z namespaces/openshift-controller-manager/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.148400594Z namespaces/openshift-controller-manager/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.148676149Z namespaces/openshift-controller-manager/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.148867709Z namespaces/openshift-controller-manager/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.14888956Z namespaces/openshift-controller-manager/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.148963364Z namespaces/openshift-controller-manager/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.149100162Z namespaces/openshift-controller-manager/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.149403658Z namespaces/openshift-dns-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.149491303Z namespaces/openshift-dns-operator/openshift-dns-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.149511004Z namespaces/openshift-dns-operator/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.149548686Z namespaces/openshift-dns-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.14961887Z namespaces/openshift-dns-operator/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.149649142Z namespaces/openshift-dns-operator/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.149736686Z namespaces/openshift-dns-operator/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.149817321Z namespaces/openshift-dns-operator/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.149892825Z namespaces/openshift-dns-operator/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.149936807Z namespaces/openshift-dns-operator/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.149974789Z namespaces/openshift-dns-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.150039913Z namespaces/openshift-dns-operator/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.150095846Z namespaces/openshift-dns-operator/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.150190711Z namespaces/openshift-dns-operator/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.150273925Z namespaces/openshift-dns-operator/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.150309817Z namespaces/openshift-dns-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.150400822Z namespaces/openshift-dns-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.150483377Z namespaces/openshift-dns-operator/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.150533359Z namespaces/openshift-dns-operator/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.150645976Z namespaces/openshift-dns-operator/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.15072942Z namespaces/openshift-dns-operator/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.150837206Z namespaces/openshift-dns-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.15091761Z namespaces/openshift-dns-operator/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.151003295Z namespaces/openshift-dns-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.151136142Z namespaces/openshift-dns-operator/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.151511243Z namespaces/openshift-dns-operator/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.151554365Z namespaces/openshift-dns-operator/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.151608648Z namespaces/openshift-dns-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.15165658Z namespaces/openshift-dns-operator/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.151691182Z namespaces/openshift-dns-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.151731675Z namespaces/openshift-dns-operator/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.151783247Z namespaces/openshift-dns-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.151862991Z namespaces/openshift-dns-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.151941516Z namespaces/openshift-dns-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.151983168Z namespaces/openshift-dns-operator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.152030861Z namespaces/openshift-dns-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.152071863Z namespaces/openshift-dns-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.152122286Z namespaces/openshift-dns-operator/monitoring.coreos.com/prometheusrules/dns.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.152184239Z namespaces/openshift-dns-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.152234782Z namespaces/openshift-dns-operator/monitoring.coreos.com/servicemonitors/dns-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.152307546Z namespaces/openshift-dns-operator/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.152344058Z namespaces/openshift-dns-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.152419722Z namespaces/openshift-dns-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.152429842Z namespaces/openshift-dns-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.152533568Z namespaces/openshift-dns-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.152684046Z namespaces/openshift-dns-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.152869056Z namespaces/openshift-dns-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.153007764Z namespaces/openshift-dns-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.153317921Z namespaces/openshift-dns-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.153511341Z namespaces/openshift-dns-operator/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.153525242Z namespaces/openshift-dns-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.153592425Z namespaces/openshift-dns-operator/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.153613747Z namespaces/openshift-dns-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.153729053Z namespaces/openshift-dns/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.153765245Z namespaces/openshift-dns/openshift-dns.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.153848859Z namespaces/openshift-dns/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.153870251Z namespaces/openshift-dns/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.154668844Z namespaces/openshift-dns/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.154689215Z namespaces/openshift-dns/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.154869345Z namespaces/openshift-dns/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.154944799Z namespaces/openshift-dns/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.155030983Z namespaces/openshift-dns/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.155086346Z namespaces/openshift-dns/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.155127579Z namespaces/openshift-dns/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.155231944Z namespaces/openshift-dns/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.155269486Z namespaces/openshift-dns/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.155405874Z namespaces/openshift-dns/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.155465177Z namespaces/openshift-dns/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.155614665Z namespaces/openshift-dns/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.15570115Z namespaces/openshift-dns/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.155778404Z namespaces/openshift-dns/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.155839167Z namespaces/openshift-dns/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.155948943Z namespaces/openshift-dns/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.15607154Z namespaces/openshift-dns/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.156345595Z namespaces/openshift-dns/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.156421559Z namespaces/openshift-dns/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.156695974Z namespaces/openshift-dns/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.156823291Z namespaces/openshift-dns/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.157064384Z namespaces/openshift-dns/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.157156749Z namespaces/openshift-dns/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.157396402Z namespaces/openshift-dns/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.157438964Z namespaces/openshift-dns/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.15754679Z namespaces/openshift-dns/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.157631455Z namespaces/openshift-dns/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.157693278Z namespaces/openshift-dns/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.157817174Z namespaces/openshift-dns/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.15790703Z namespaces/openshift-dns/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.157963753Z namespaces/openshift-dns/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.158016045Z namespaces/openshift-dns/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.158076459Z namespaces/openshift-dns/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.158129051Z namespaces/openshift-dns/monitoring.coreos.com/servicemonitors/dns-default.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.158204155Z namespaces/openshift-dns/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.158266649Z namespaces/openshift-dns/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.158335363Z namespaces/openshift-dns/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.158344743Z namespaces/openshift-dns/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.158397296Z namespaces/openshift-dns/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.158554485Z namespaces/openshift-dns/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.158734784Z namespaces/openshift-dns/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.158867931Z namespaces/openshift-dns/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.159083823Z namespaces/openshift-dns/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.159338107Z namespaces/openshift-dns/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.159352968Z namespaces/openshift-dns/pods/dns-default-gglb5/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.159365118Z namespaces/openshift-dns/pods/dns-default-gglb5/dns-default-gglb5.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.159476384Z namespaces/openshift-dns/pods/dns-default-gglb5/dns/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.159486185Z namespaces/openshift-dns/pods/dns-default-gglb5/dns/dns/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.159501816Z namespaces/openshift-dns/pods/dns-default-gglb5/dns/dns/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.159545418Z namespaces/openshift-dns/pods/dns-default-gglb5/dns/dns/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.159655764Z namespaces/openshift-dns/pods/dns-default-gglb5/dns/dns/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.159725098Z namespaces/openshift-dns/pods/dns-default-gglb5/dns/dns/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.159740489Z namespaces/openshift-dns/pods/dns-default-gglb5/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.15976166Z namespaces/openshift-dns/pods/dns-default-gglb5/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.15976722Z namespaces/openshift-dns/pods/dns-default-gglb5/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.159822213Z namespaces/openshift-dns/pods/dns-default-gglb5/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.159913378Z namespaces/openshift-dns/pods/dns-default-gglb5/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.159979972Z namespaces/openshift-dns/pods/dns-default-gglb5/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.159998783Z namespaces/openshift-dns/pods/dns-default-n8m9r/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.160059816Z namespaces/openshift-dns/pods/dns-default-n8m9r/dns-default-n8m9r.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.160194063Z namespaces/openshift-dns/pods/dns-default-n8m9r/dns/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.160212015Z namespaces/openshift-dns/pods/dns-default-n8m9r/dns/dns/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.160256727Z namespaces/openshift-dns/pods/dns-default-n8m9r/dns/dns/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.160281938Z namespaces/openshift-dns/pods/dns-default-n8m9r/dns/dns/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.160361032Z namespaces/openshift-dns/pods/dns-default-n8m9r/dns/dns/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.160437537Z namespaces/openshift-dns/pods/dns-default-n8m9r/dns/dns/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.160452048Z namespaces/openshift-dns/pods/dns-default-n8m9r/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.160461918Z namespaces/openshift-dns/pods/dns-default-n8m9r/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.16048979Z namespaces/openshift-dns/pods/dns-default-n8m9r/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.160550293Z namespaces/openshift-dns/pods/dns-default-n8m9r/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.160635387Z namespaces/openshift-dns/pods/dns-default-n8m9r/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.160716332Z namespaces/openshift-dns/pods/dns-default-n8m9r/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.160734763Z namespaces/openshift-dns/pods/dns-default-tf2qd/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.160799396Z namespaces/openshift-dns/pods/dns-default-tf2qd/dns-default-tf2qd.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.16087846Z namespaces/openshift-dns/pods/dns-default-tf2qd/dns/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.160887991Z namespaces/openshift-dns/pods/dns-default-tf2qd/dns/dns/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.160900822Z namespaces/openshift-dns/pods/dns-default-tf2qd/dns/dns/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.160948034Z namespaces/openshift-dns/pods/dns-default-tf2qd/dns/dns/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.16105154Z namespaces/openshift-dns/pods/dns-default-tf2qd/dns/dns/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.161117893Z namespaces/openshift-dns/pods/dns-default-tf2qd/dns/dns/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.161180807Z namespaces/openshift-dns/pods/dns-default-tf2qd/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.161196208Z namespaces/openshift-dns/pods/dns-default-tf2qd/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.161201918Z namespaces/openshift-dns/pods/dns-default-tf2qd/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.161246811Z namespaces/openshift-dns/pods/dns-default-tf2qd/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.161363127Z namespaces/openshift-dns/pods/dns-default-tf2qd/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.16142985Z namespaces/openshift-dns/pods/dns-default-tf2qd/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.161467463Z namespaces/openshift-dns/pods/node-resolver-d558v/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.161521506Z namespaces/openshift-dns/pods/node-resolver-d558v/node-resolver-d558v.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.161618741Z namespaces/openshift-dns/pods/node-resolver-d558v/dns-node-resolver/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.161629711Z namespaces/openshift-dns/pods/node-resolver-d558v/dns-node-resolver/dns-node-resolver/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.161636192Z namespaces/openshift-dns/pods/node-resolver-d558v/dns-node-resolver/dns-node-resolver/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.161678014Z namespaces/openshift-dns/pods/node-resolver-d558v/dns-node-resolver/dns-node-resolver/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.161775219Z namespaces/openshift-dns/pods/node-resolver-d558v/dns-node-resolver/dns-node-resolver/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.161833452Z namespaces/openshift-dns/pods/node-resolver-d558v/dns-node-resolver/dns-node-resolver/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.161897236Z namespaces/openshift-dns/pods/node-resolver-hq9qt/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.161910787Z namespaces/openshift-dns/pods/node-resolver-hq9qt/node-resolver-hq9qt.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.162005452Z namespaces/openshift-dns/pods/node-resolver-hq9qt/dns-node-resolver/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.162015402Z namespaces/openshift-dns/pods/node-resolver-hq9qt/dns-node-resolver/dns-node-resolver/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.162020982Z namespaces/openshift-dns/pods/node-resolver-hq9qt/dns-node-resolver/dns-node-resolver/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.162030253Z namespaces/openshift-dns/pods/node-resolver-hq9qt/dns-node-resolver/dns-node-resolver/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.162133879Z namespaces/openshift-dns/pods/node-resolver-hq9qt/dns-node-resolver/dns-node-resolver/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.162233754Z namespaces/openshift-dns/pods/node-resolver-hq9qt/dns-node-resolver/dns-node-resolver/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.162253835Z namespaces/openshift-dns/pods/node-resolver-jzrk9/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.162298917Z namespaces/openshift-dns/pods/node-resolver-jzrk9/node-resolver-jzrk9.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.162362351Z namespaces/openshift-dns/pods/node-resolver-jzrk9/dns-node-resolver/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.162372832Z namespaces/openshift-dns/pods/node-resolver-jzrk9/dns-node-resolver/dns-node-resolver/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.162378982Z namespaces/openshift-dns/pods/node-resolver-jzrk9/dns-node-resolver/dns-node-resolver/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.162419964Z namespaces/openshift-dns/pods/node-resolver-jzrk9/dns-node-resolver/dns-node-resolver/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.162599034Z namespaces/openshift-dns/pods/node-resolver-jzrk9/dns-node-resolver/dns-node-resolver/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.162661377Z namespaces/openshift-dns/pods/node-resolver-jzrk9/dns-node-resolver/dns-node-resolver/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.16270305Z namespaces/openshift-dns/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.162745742Z namespaces/openshift-dns/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.162804235Z namespaces/openshift-dns/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.162827996Z namespaces/openshift-dns/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.162938392Z namespaces/openshift-etcd/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.162960844Z namespaces/openshift-etcd/openshift-etcd.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.163034127Z namespaces/openshift-etcd/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.16307273Z namespaces/openshift-etcd/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.163124632Z namespaces/openshift-etcd/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.163185176Z namespaces/openshift-etcd/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.16327155Z namespaces/openshift-etcd/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.163359435Z namespaces/openshift-etcd/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.163429939Z namespaces/openshift-etcd/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.163482112Z namespaces/openshift-etcd/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.163502663Z namespaces/openshift-etcd/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.163575837Z namespaces/openshift-etcd/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.16362488Z namespaces/openshift-etcd/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.163706844Z namespaces/openshift-etcd/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.163764987Z namespaces/openshift-etcd/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.163796369Z namespaces/openshift-etcd/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.163877443Z namespaces/openshift-etcd/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.163947327Z namespaces/openshift-etcd/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.16399626Z namespaces/openshift-etcd/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.164099815Z namespaces/openshift-etcd/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.16418569Z namespaces/openshift-etcd/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.164308777Z namespaces/openshift-etcd/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.164386651Z namespaces/openshift-etcd/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.164467085Z namespaces/openshift-etcd/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.164594302Z namespaces/openshift-etcd/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.164755881Z namespaces/openshift-etcd/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.164790243Z namespaces/openshift-etcd/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.164857296Z namespaces/openshift-etcd/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.164876597Z namespaces/openshift-etcd/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.16493438Z namespaces/openshift-etcd/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.164994834Z namespaces/openshift-etcd/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.165011915Z namespaces/openshift-etcd/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.165119941Z namespaces/openshift-etcd/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.165354523Z namespaces/openshift-etcd/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.165379655Z namespaces/openshift-etcd/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.165439388Z namespaces/openshift-etcd/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.16547558Z namespaces/openshift-etcd/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.165510612Z namespaces/openshift-etcd/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.165561585Z namespaces/openshift-etcd/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.165582886Z namespaces/openshift-etcd/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.165622968Z namespaces/openshift-etcd/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.165790367Z namespaces/openshift-etcd/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.165965416Z namespaces/openshift-etcd/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.166351517Z namespaces/openshift-etcd/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.16658291Z namespaces/openshift-etcd/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.16677551Z namespaces/openshift-etcd/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.166796112Z namespaces/openshift-etcd/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.166863105Z namespaces/openshift-etcd/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.166884466Z namespaces/openshift-etcd/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.166990092Z namespaces/openshift-host-network/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.167043035Z namespaces/openshift-host-network/openshift-host-network.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.167105268Z namespaces/openshift-host-network/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.167155351Z namespaces/openshift-host-network/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.167237835Z namespaces/openshift-host-network/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.167259337Z namespaces/openshift-host-network/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.167361762Z namespaces/openshift-host-network/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.167449277Z namespaces/openshift-host-network/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.167519721Z namespaces/openshift-host-network/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.167579024Z namespaces/openshift-host-network/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.167639707Z namespaces/openshift-host-network/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.16769482Z namespaces/openshift-host-network/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.167743373Z namespaces/openshift-host-network/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.167816477Z namespaces/openshift-host-network/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.167859329Z namespaces/openshift-host-network/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.167916112Z namespaces/openshift-host-network/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.167998717Z namespaces/openshift-host-network/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.168073631Z namespaces/openshift-host-network/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.168115683Z namespaces/openshift-host-network/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.16824552Z namespaces/openshift-host-network/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.168321304Z namespaces/openshift-host-network/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.168395558Z namespaces/openshift-host-network/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.168478613Z namespaces/openshift-host-network/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.168553177Z namespaces/openshift-host-network/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.168700435Z namespaces/openshift-host-network/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.16879871Z namespaces/openshift-host-network/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.168859163Z namespaces/openshift-host-network/core/resourcequotas/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.168896475Z namespaces/openshift-host-network/core/resourcequotas/host-network-namespace-quotas.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.168962049Z namespaces/openshift-host-network/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.169003341Z namespaces/openshift-host-network/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.169045703Z namespaces/openshift-host-network/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.169085386Z namespaces/openshift-host-network/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.169154829Z namespaces/openshift-host-network/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.169210552Z namespaces/openshift-host-network/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.169307558Z namespaces/openshift-host-network/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.169394112Z namespaces/openshift-host-network/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.169437015Z namespaces/openshift-host-network/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.169469917Z namespaces/openshift-host-network/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.169510039Z namespaces/openshift-host-network/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.16954237Z namespaces/openshift-host-network/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.169618774Z namespaces/openshift-host-network/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.169630765Z namespaces/openshift-host-network/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.169684118Z namespaces/openshift-host-network/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.169848327Z namespaces/openshift-host-network/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.170024636Z namespaces/openshift-host-network/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.170178125Z namespaces/openshift-host-network/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.170379856Z namespaces/openshift-host-network/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.170574256Z namespaces/openshift-host-network/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.170588377Z namespaces/openshift-host-network/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.170655131Z namespaces/openshift-host-network/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.170687692Z namespaces/openshift-host-network/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.170772267Z namespaces/openshift-image-registry/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.170801709Z namespaces/openshift-image-registry/openshift-image-registry.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.170882843Z namespaces/openshift-image-registry/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.170896664Z namespaces/openshift-image-registry/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.170959737Z namespaces/openshift-image-registry/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.171107705Z namespaces/openshift-image-registry/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.171239822Z namespaces/openshift-image-registry/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.17137504Z namespaces/openshift-image-registry/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.17156623Z namespaces/openshift-image-registry/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.171603872Z namespaces/openshift-image-registry/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.171635834Z namespaces/openshift-image-registry/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.171713928Z namespaces/openshift-image-registry/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.171728419Z namespaces/openshift-image-registry/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.171836495Z namespaces/openshift-image-registry/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.171895398Z namespaces/openshift-image-registry/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.171946141Z namespaces/openshift-image-registry/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.172069178Z namespaces/openshift-image-registry/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.172093679Z namespaces/openshift-image-registry/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.17211269Z namespaces/openshift-image-registry/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.172185174Z namespaces/openshift-image-registry/coordination.k8s.io/leases/openshift-master-controllers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.172262498Z namespaces/openshift-image-registry/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.17230394Z namespaces/openshift-image-registry/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.173618522Z namespaces/openshift-image-registry/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.173712136Z namespaces/openshift-image-registry/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.173985711Z namespaces/openshift-image-registry/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.174062575Z namespaces/openshift-image-registry/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.174307789Z namespaces/openshift-image-registry/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.174448527Z namespaces/openshift-image-registry/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.174658148Z namespaces/openshift-image-registry/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.174714121Z namespaces/openshift-image-registry/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.174737502Z namespaces/openshift-image-registry/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.174814216Z namespaces/openshift-image-registry/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.174832887Z namespaces/openshift-image-registry/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.174920402Z namespaces/openshift-image-registry/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.174947474Z namespaces/openshift-image-registry/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.17506218Z namespaces/openshift-image-registry/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.175141304Z namespaces/openshift-image-registry/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.175235529Z namespaces/openshift-image-registry/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.175277061Z namespaces/openshift-image-registry/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.175378567Z namespaces/openshift-image-registry/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.175405128Z namespaces/openshift-image-registry/monitoring.coreos.com/prometheusrules/image-registry-operator-alerts.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.175523335Z namespaces/openshift-image-registry/monitoring.coreos.com/prometheusrules/image-registry-rules.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.17560857Z namespaces/openshift-image-registry/monitoring.coreos.com/prometheusrules/imagestreams-rules.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.175649552Z namespaces/openshift-image-registry/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.175690094Z namespaces/openshift-image-registry/monitoring.coreos.com/servicemonitors/image-registry.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.175743217Z namespaces/openshift-image-registry/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.175790479Z namespaces/openshift-image-registry/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.175835342Z namespaces/openshift-image-registry/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.175863673Z namespaces/openshift-image-registry/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.175915096Z namespaces/openshift-image-registry/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.176083695Z namespaces/openshift-image-registry/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.176303697Z namespaces/openshift-image-registry/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.176432754Z namespaces/openshift-image-registry/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.176642195Z namespaces/openshift-image-registry/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.176970353Z namespaces/openshift-image-registry/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.176983324Z namespaces/openshift-image-registry/pods/image-registry-57d76c5ff7-cp4cq/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.176992525Z namespaces/openshift-image-registry/pods/image-registry-57d76c5ff7-cp4cq/image-registry-57d76c5ff7-cp4cq.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.177120911Z namespaces/openshift-image-registry/pods/image-registry-57d76c5ff7-cp4cq/registry/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.177131872Z namespaces/openshift-image-registry/pods/image-registry-57d76c5ff7-cp4cq/registry/registry/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.177137972Z namespaces/openshift-image-registry/pods/image-registry-57d76c5ff7-cp4cq/registry/registry/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.177208366Z namespaces/openshift-image-registry/pods/image-registry-57d76c5ff7-cp4cq/registry/registry/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.179436237Z namespaces/openshift-image-registry/pods/image-registry-57d76c5ff7-cp4cq/registry/registry/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.17949133Z namespaces/openshift-image-registry/pods/image-registry-57d76c5ff7-cp4cq/registry/registry/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.179526362Z namespaces/openshift-image-registry/pods/node-ca-lscjn/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.179573745Z namespaces/openshift-image-registry/pods/node-ca-lscjn/node-ca-lscjn.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.17967745Z namespaces/openshift-image-registry/pods/node-ca-lscjn/node-ca/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.179692691Z namespaces/openshift-image-registry/pods/node-ca-lscjn/node-ca/node-ca/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.179699211Z namespaces/openshift-image-registry/pods/node-ca-lscjn/node-ca/node-ca/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.179727213Z namespaces/openshift-image-registry/pods/node-ca-lscjn/node-ca/node-ca/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.179928774Z namespaces/openshift-image-registry/pods/node-ca-lscjn/node-ca/node-ca/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.180009358Z namespaces/openshift-image-registry/pods/node-ca-lscjn/node-ca/node-ca/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.180068251Z namespaces/openshift-image-registry/pods/node-ca-mdplr/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.180122224Z namespaces/openshift-image-registry/pods/node-ca-mdplr/node-ca-mdplr.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.180281163Z namespaces/openshift-image-registry/pods/node-ca-mdplr/node-ca/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.180303064Z namespaces/openshift-image-registry/pods/node-ca-mdplr/node-ca/node-ca/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.180308814Z namespaces/openshift-image-registry/pods/node-ca-mdplr/node-ca/node-ca/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.180317855Z namespaces/openshift-image-registry/pods/node-ca-mdplr/node-ca/node-ca/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.180513845Z namespaces/openshift-image-registry/pods/node-ca-mdplr/node-ca/node-ca/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.18059662Z namespaces/openshift-image-registry/pods/node-ca-mdplr/node-ca/node-ca/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.180618941Z namespaces/openshift-image-registry/pods/node-ca-t8k5z/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.180693995Z namespaces/openshift-image-registry/pods/node-ca-t8k5z/node-ca-t8k5z.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.180768129Z namespaces/openshift-image-registry/pods/node-ca-t8k5z/node-ca/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.180782Z namespaces/openshift-image-registry/pods/node-ca-t8k5z/node-ca/node-ca/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.180790751Z namespaces/openshift-image-registry/pods/node-ca-t8k5z/node-ca/node-ca/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.180872385Z namespaces/openshift-image-registry/pods/node-ca-t8k5z/node-ca/node-ca/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.181061685Z namespaces/openshift-image-registry/pods/node-ca-t8k5z/node-ca/node-ca/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.181130049Z namespaces/openshift-image-registry/pods/node-ca-t8k5z/node-ca/node-ca/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.18114908Z namespaces/openshift-image-registry/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.181230554Z namespaces/openshift-image-registry/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.181303178Z namespaces/openshift-image-registry/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.181429655Z namespaces/openshift-image-registry/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.18152459Z namespaces/openshift-infra/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.181535341Z namespaces/openshift-infra/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.181539881Z namespaces/openshift-infra/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.181586604Z namespaces/openshift-infra/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.181763783Z namespaces/openshift-infra/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.181978975Z namespaces/openshift-infra/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.182124743Z namespaces/openshift-infra/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.182370776Z namespaces/openshift-infra/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.182593888Z namespaces/openshift-ingress-canary/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.182645941Z namespaces/openshift-ingress-canary/openshift-ingress-canary.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.182750367Z namespaces/openshift-ingress-canary/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.182782248Z namespaces/openshift-ingress-canary/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.182870473Z namespaces/openshift-ingress-canary/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.182888034Z namespaces/openshift-ingress-canary/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.183014401Z namespaces/openshift-ingress-canary/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.183091215Z namespaces/openshift-ingress-canary/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.183193161Z namespaces/openshift-ingress-canary/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.183257744Z namespaces/openshift-ingress-canary/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.183293376Z namespaces/openshift-ingress-canary/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.183350369Z namespaces/openshift-ingress-canary/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.183388931Z namespaces/openshift-ingress-canary/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.183472836Z namespaces/openshift-ingress-canary/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.183526569Z namespaces/openshift-ingress-canary/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.183577151Z namespaces/openshift-ingress-canary/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.183654526Z namespaces/openshift-ingress-canary/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.18372633Z namespaces/openshift-ingress-canary/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.183759912Z namespaces/openshift-ingress-canary/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.183873798Z namespaces/openshift-ingress-canary/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.183966543Z namespaces/openshift-ingress-canary/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.184122571Z namespaces/openshift-ingress-canary/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.184237837Z namespaces/openshift-ingress-canary/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.184393716Z namespaces/openshift-ingress-canary/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.184547654Z namespaces/openshift-ingress-canary/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.184726634Z namespaces/openshift-ingress-canary/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.184792057Z namespaces/openshift-ingress-canary/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.18483597Z namespaces/openshift-ingress-canary/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.184905954Z namespaces/openshift-ingress-canary/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.184943116Z namespaces/openshift-ingress-canary/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.184985128Z namespaces/openshift-ingress-canary/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.185043821Z namespaces/openshift-ingress-canary/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.185122955Z namespaces/openshift-ingress-canary/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.185240602Z namespaces/openshift-ingress-canary/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.185316446Z namespaces/openshift-ingress-canary/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.185348338Z namespaces/openshift-ingress-canary/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.185417242Z namespaces/openshift-ingress-canary/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.185443033Z namespaces/openshift-ingress-canary/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.185518777Z namespaces/openshift-ingress-canary/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.185539348Z namespaces/openshift-ingress-canary/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.18557541Z namespaces/openshift-ingress-canary/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.185724218Z namespaces/openshift-ingress-canary/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.185893277Z namespaces/openshift-ingress-canary/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.186035875Z namespaces/openshift-ingress-canary/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.186281618Z namespaces/openshift-ingress-canary/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.186668639Z namespaces/openshift-ingress-canary/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.18667867Z namespaces/openshift-ingress-canary/pods/ingress-canary-9sr8f/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.186712772Z namespaces/openshift-ingress-canary/pods/ingress-canary-9sr8f/ingress-canary-9sr8f.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.186811307Z namespaces/openshift-ingress-canary/pods/ingress-canary-9sr8f/serve-healthcheck-canary/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.186821338Z namespaces/openshift-ingress-canary/pods/ingress-canary-9sr8f/serve-healthcheck-canary/serve-healthcheck-canary/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.186827088Z namespaces/openshift-ingress-canary/pods/ingress-canary-9sr8f/serve-healthcheck-canary/serve-healthcheck-canary/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.18686784Z namespaces/openshift-ingress-canary/pods/ingress-canary-9sr8f/serve-healthcheck-canary/serve-healthcheck-canary/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.186966195Z namespaces/openshift-ingress-canary/pods/ingress-canary-9sr8f/serve-healthcheck-canary/serve-healthcheck-canary/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.187035129Z namespaces/openshift-ingress-canary/pods/ingress-canary-9sr8f/serve-healthcheck-canary/serve-healthcheck-canary/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.187098013Z namespaces/openshift-ingress-canary/pods/ingress-canary-bcc5n/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.187112033Z namespaces/openshift-ingress-canary/pods/ingress-canary-bcc5n/ingress-canary-bcc5n.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.18722945Z namespaces/openshift-ingress-canary/pods/ingress-canary-bcc5n/serve-healthcheck-canary/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.187245301Z namespaces/openshift-ingress-canary/pods/ingress-canary-bcc5n/serve-healthcheck-canary/serve-healthcheck-canary/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.187254841Z namespaces/openshift-ingress-canary/pods/ingress-canary-bcc5n/serve-healthcheck-canary/serve-healthcheck-canary/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.187305894Z namespaces/openshift-ingress-canary/pods/ingress-canary-bcc5n/serve-healthcheck-canary/serve-healthcheck-canary/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.18741392Z namespaces/openshift-ingress-canary/pods/ingress-canary-bcc5n/serve-healthcheck-canary/serve-healthcheck-canary/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.187482263Z namespaces/openshift-ingress-canary/pods/ingress-canary-bcc5n/serve-healthcheck-canary/serve-healthcheck-canary/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.187525806Z namespaces/openshift-ingress-canary/pods/ingress-canary-qgtgq/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.187557747Z namespaces/openshift-ingress-canary/pods/ingress-canary-qgtgq/ingress-canary-qgtgq.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.187649692Z namespaces/openshift-ingress-canary/pods/ingress-canary-qgtgq/serve-healthcheck-canary/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.187664643Z namespaces/openshift-ingress-canary/pods/ingress-canary-qgtgq/serve-healthcheck-canary/serve-healthcheck-canary/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.187670813Z namespaces/openshift-ingress-canary/pods/ingress-canary-qgtgq/serve-healthcheck-canary/serve-healthcheck-canary/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.187705746Z namespaces/openshift-ingress-canary/pods/ingress-canary-qgtgq/serve-healthcheck-canary/serve-healthcheck-canary/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.187802041Z namespaces/openshift-ingress-canary/pods/ingress-canary-qgtgq/serve-healthcheck-canary/serve-healthcheck-canary/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.187873295Z namespaces/openshift-ingress-canary/pods/ingress-canary-qgtgq/serve-healthcheck-canary/serve-healthcheck-canary/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.187886925Z namespaces/openshift-ingress-canary/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.187947968Z namespaces/openshift-ingress-canary/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.188007612Z namespaces/openshift-ingress-canary/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.188025053Z namespaces/openshift-ingress-canary/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.18815768Z namespaces/openshift-ingress-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.188230594Z namespaces/openshift-ingress-operator/openshift-ingress-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.188309068Z namespaces/openshift-ingress-operator/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.1883454Z namespaces/openshift-ingress-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.188417484Z namespaces/openshift-ingress-operator/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.188438925Z namespaces/openshift-ingress-operator/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.188543231Z namespaces/openshift-ingress-operator/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.188616175Z namespaces/openshift-ingress-operator/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.18870458Z namespaces/openshift-ingress-operator/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.188768303Z namespaces/openshift-ingress-operator/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.188804125Z namespaces/openshift-ingress-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.188859868Z namespaces/openshift-ingress-operator/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.1888988Z namespaces/openshift-ingress-operator/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.189283571Z namespaces/openshift-ingress-operator/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.189345044Z namespaces/openshift-ingress-operator/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.189397797Z namespaces/openshift-ingress-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.189475442Z namespaces/openshift-ingress-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.189531514Z namespaces/openshift-ingress-operator/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.189586868Z namespaces/openshift-ingress-operator/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.190469075Z namespaces/openshift-ingress-operator/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.19054981Z namespaces/openshift-ingress-operator/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.190665046Z namespaces/openshift-ingress-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.19074622Z namespaces/openshift-ingress-operator/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.190826725Z namespaces/openshift-ingress-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.190966442Z namespaces/openshift-ingress-operator/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.191226126Z namespaces/openshift-ingress-operator/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.19129939Z namespaces/openshift-ingress-operator/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.191354563Z namespaces/openshift-ingress-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.191413067Z namespaces/openshift-ingress-operator/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.191564165Z namespaces/openshift-ingress-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.191619548Z namespaces/openshift-ingress-operator/ingress.operator.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.191633768Z namespaces/openshift-ingress-operator/ingress.operator.openshift.io/dnsrecords/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.19165234Z namespaces/openshift-ingress-operator/ingress.operator.openshift.io/dnsrecords/default-wildcard.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.191740384Z namespaces/openshift-ingress-operator/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.191787527Z namespaces/openshift-ingress-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.191874752Z namespaces/openshift-ingress-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.191950166Z namespaces/openshift-ingress-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.192003379Z namespaces/openshift-ingress-operator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.19203448Z namespaces/openshift-ingress-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.192109364Z namespaces/openshift-ingress-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.192152576Z namespaces/openshift-ingress-operator/monitoring.coreos.com/prometheusrules/ingress-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.192274013Z namespaces/openshift-ingress-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.192321276Z namespaces/openshift-ingress-operator/monitoring.coreos.com/servicemonitors/ingress-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.19239588Z namespaces/openshift-ingress-operator/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.192413681Z namespaces/openshift-ingress-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.192467284Z namespaces/openshift-ingress-operator/operator.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.192484175Z namespaces/openshift-ingress-operator/operator.openshift.io/ingresscontrollers/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.192527177Z namespaces/openshift-ingress-operator/operator.openshift.io/ingresscontrollers/default.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.192610101Z namespaces/openshift-ingress-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.192620572Z namespaces/openshift-ingress-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.19276881Z namespaces/openshift-ingress-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.192919538Z namespaces/openshift-ingress-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.193103808Z namespaces/openshift-ingress-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.193288728Z namespaces/openshift-ingress-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.193523081Z namespaces/openshift-ingress-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.193791156Z namespaces/openshift-ingress-operator/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.193835868Z namespaces/openshift-ingress-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.193886581Z namespaces/openshift-ingress-operator/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.193930583Z namespaces/openshift-ingress-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.19405131Z namespaces/openshift-ingress/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.194079861Z namespaces/openshift-ingress/openshift-ingress.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.194158056Z namespaces/openshift-ingress/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.194219499Z namespaces/openshift-ingress/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.194310394Z namespaces/openshift-ingress/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.194343855Z namespaces/openshift-ingress/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.194442021Z namespaces/openshift-ingress/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.194906526Z namespaces/openshift-ingress/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.195114387Z namespaces/openshift-ingress/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.195183611Z namespaces/openshift-ingress/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.195205102Z namespaces/openshift-ingress/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.195311148Z namespaces/openshift-ingress/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.195363151Z namespaces/openshift-ingress/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.195454566Z namespaces/openshift-ingress/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.195518709Z namespaces/openshift-ingress/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.195566272Z namespaces/openshift-ingress/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.195670207Z namespaces/openshift-ingress/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.196016786Z namespaces/openshift-ingress/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.196034717Z namespaces/openshift-ingress/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.196095061Z namespaces/openshift-ingress/coordination.k8s.io/leases/istio-gateway-ca-openshift-gateway.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.196323353Z namespaces/openshift-ingress/coordination.k8s.io/leases/istio-gateway-deployment-openshift-gateway.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.196419208Z namespaces/openshift-ingress/coordination.k8s.io/leases/istio-gateway-status-leader-openshift-gateway.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.196544975Z namespaces/openshift-ingress/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.196582417Z namespaces/openshift-ingress/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.197048382Z namespaces/openshift-ingress/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.197154418Z namespaces/openshift-ingress/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.197401141Z namespaces/openshift-ingress/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.197483116Z namespaces/openshift-ingress/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.197728949Z namespaces/openshift-ingress/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.197869927Z namespaces/openshift-ingress/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.198083698Z namespaces/openshift-ingress/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.198190044Z namespaces/openshift-ingress/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.198222106Z namespaces/openshift-ingress/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.198327811Z namespaces/openshift-ingress/gateway.networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.198339022Z namespaces/openshift-ingress/gateway.networking.k8s.io/gateways/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.198383894Z namespaces/openshift-ingress/gateway.networking.k8s.io/gateways/openshift-ai-inference.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.198466999Z namespaces/openshift-ingress/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.198501061Z namespaces/openshift-ingress/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.198561544Z namespaces/openshift-ingress/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.198607457Z namespaces/openshift-ingress/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.198691111Z namespaces/openshift-ingress/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.198773536Z namespaces/openshift-ingress/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.198830549Z namespaces/openshift-ingress/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.198880212Z namespaces/openshift-ingress/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.198944275Z namespaces/openshift-ingress/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.198961326Z namespaces/openshift-ingress/monitoring.coreos.com/servicemonitors/router-default.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.199027689Z namespaces/openshift-ingress/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.199064971Z namespaces/openshift-ingress/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.199115064Z namespaces/openshift-ingress/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.199125215Z namespaces/openshift-ingress/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.19921679Z namespaces/openshift-ingress/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.199417441Z namespaces/openshift-ingress/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.199624562Z namespaces/openshift-ingress/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.199941549Z namespaces/openshift-ingress/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.200185182Z namespaces/openshift-ingress/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.200418245Z namespaces/openshift-ingress/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.200426085Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.200451167Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/istiod-openshift-gateway-94bb8fbfd-5kc7r.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.200586224Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/discovery/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.200596785Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/discovery/discovery/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.200600745Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/discovery/discovery/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.200644667Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/discovery/discovery/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.210442479Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/discovery/discovery/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.210508542Z namespaces/openshift-ingress/pods/istiod-openshift-gateway-94bb8fbfd-5kc7r/discovery/discovery/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.210569535Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.210626189Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.210745785Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/istio-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.210754865Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/istio-proxy/istio-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.210759916Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/istio-proxy/istio-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.210803268Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/istio-proxy/istio-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.211842695Z namespaces/openshift-ingress/pods/openshift-ai-inference-openshift-default-655f7c58b4-mbx7z/istio-proxy/istio-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.211969571Z namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.212007604Z namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router-default-5658d689b9-4zvzx.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.212193223Z namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.212212415Z namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router/router/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.212224695Z namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router/router/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.212273428Z namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router/router/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.212394574Z namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router/router/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.212455008Z namespaces/openshift-ingress/pods/router-default-5658d689b9-4zvzx/router/router/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.212516491Z namespaces/openshift-ingress/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.212555153Z namespaces/openshift-ingress/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.212618977Z namespaces/openshift-ingress/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.212650868Z namespaces/openshift-ingress/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.212762334Z namespaces/openshift-insights/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.212820188Z namespaces/openshift-insights/openshift-insights.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.212921643Z namespaces/openshift-insights/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.212989067Z namespaces/openshift-insights/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.213181697Z namespaces/openshift-insights/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.213209609Z namespaces/openshift-insights/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.213292173Z namespaces/openshift-insights/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.213411569Z namespaces/openshift-insights/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.213518535Z namespaces/openshift-insights/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.213554467Z namespaces/openshift-insights/apps/deployments/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.21360384Z namespaces/openshift-insights/apps/deployments/insights-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.213687555Z namespaces/openshift-insights/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.213705305Z namespaces/openshift-insights/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.21379206Z namespaces/openshift-insights/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.213809681Z namespaces/openshift-insights/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.213907916Z namespaces/openshift-insights/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.21396892Z namespaces/openshift-insights/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.213986881Z namespaces/openshift-insights/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.214084956Z namespaces/openshift-insights/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.214181431Z namespaces/openshift-insights/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.214237825Z namespaces/openshift-insights/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.215294642Z namespaces/openshift-insights/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.215390227Z namespaces/openshift-insights/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.215693483Z namespaces/openshift-insights/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.215872953Z namespaces/openshift-insights/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.216289166Z namespaces/openshift-insights/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.216384881Z namespaces/openshift-insights/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.21654996Z namespaces/openshift-insights/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.216596672Z namespaces/openshift-insights/core/configmaps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.216639635Z namespaces/openshift-insights/core/configmaps/service-ca-bundle.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.216723189Z namespaces/openshift-insights/core/serviceaccounts/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.216758941Z namespaces/openshift-insights/core/serviceaccounts/gather.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.216862627Z namespaces/openshift-insights/core/serviceaccounts/operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.216903689Z namespaces/openshift-insights/core/services/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.216942631Z namespaces/openshift-insights/core/services/metrics.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.217021365Z namespaces/openshift-insights/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.217059517Z namespaces/openshift-insights/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.217129241Z namespaces/openshift-insights/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.217157313Z namespaces/openshift-insights/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.217269319Z namespaces/openshift-insights/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.217316521Z namespaces/openshift-insights/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.217458889Z namespaces/openshift-insights/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.217571865Z namespaces/openshift-insights/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.21765253Z namespaces/openshift-insights/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.217725294Z namespaces/openshift-insights/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.217803078Z namespaces/openshift-insights/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.21783692Z namespaces/openshift-insights/monitoring.coreos.com/prometheusrules/insights-prometheus-rules.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.217920244Z namespaces/openshift-insights/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.217945726Z namespaces/openshift-insights/monitoring.coreos.com/servicemonitors/insights-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.218316596Z namespaces/openshift-insights/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.218335227Z namespaces/openshift-insights/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.218405631Z namespaces/openshift-insights/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.218418421Z namespaces/openshift-insights/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.218466864Z namespaces/openshift-insights/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.218655564Z namespaces/openshift-insights/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.218897537Z namespaces/openshift-insights/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.219046475Z namespaces/openshift-insights/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.219329921Z namespaces/openshift-insights/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.219577564Z namespaces/openshift-insights/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.219585084Z namespaces/openshift-insights/pods/insights-operator-5c847dcfc4-jcfjt/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.219611716Z namespaces/openshift-insights/pods/insights-operator-5c847dcfc4-jcfjt/insights-operator-5c847dcfc4-jcfjt.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.219722732Z namespaces/openshift-insights/pods/insights-operator-5c847dcfc4-jcfjt/insights-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.219730172Z namespaces/openshift-insights/pods/insights-operator-5c847dcfc4-jcfjt/insights-operator/insights-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.219736543Z namespaces/openshift-insights/pods/insights-operator-5c847dcfc4-jcfjt/insights-operator/insights-operator/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.219794646Z namespaces/openshift-insights/pods/insights-operator-5c847dcfc4-jcfjt/insights-operator/insights-operator/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.220256771Z namespaces/openshift-insights/pods/insights-operator-5c847dcfc4-jcfjt/insights-operator/insights-operator/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.220582498Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.22060773Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/insights-runtime-extractor-24ccq.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.220725296Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/exporter/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.220735407Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/exporter/exporter/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.220740327Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/exporter/exporter/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.22079293Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/exporter/exporter/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.220923277Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/exporter/exporter/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.221001241Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/exporter/exporter/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.221060464Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/extractor/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.221073735Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/extractor/extractor/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.221085856Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/extractor/extractor/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.221131338Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/extractor/extractor/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.221290587Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/extractor/extractor/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.221375341Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/extractor/extractor/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.221394033Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.221407033Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.221424774Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.221490378Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.221584143Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.221655227Z namespaces/openshift-insights/pods/insights-runtime-extractor-24ccq/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.221707919Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.221764583Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/insights-runtime-extractor-nk8jb.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.221849847Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/exporter/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.221860298Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/exporter/exporter/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.221868438Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/exporter/exporter/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.221916441Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/exporter/exporter/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.222010476Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/exporter/exporter/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.22207747Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/exporter/exporter/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.222114282Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/extractor/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.222128692Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/extractor/extractor/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.222132843Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/extractor/extractor/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.222200146Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/extractor/extractor/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.222343704Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/extractor/extractor/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.222421198Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/extractor/extractor/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.222485452Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.222496762Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.222506553Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.222534594Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.2226426Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.222714034Z namespaces/openshift-insights/pods/insights-runtime-extractor-nk8jb/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.222935356Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.222966648Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/insights-runtime-extractor-t9d9h.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.223067303Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/exporter/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.223079994Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/exporter/exporter/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.223086194Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/exporter/exporter/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.223116786Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/exporter/exporter/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.223251623Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/exporter/exporter/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.223326127Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/exporter/exporter/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.223341348Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/extractor/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.223350028Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/extractor/extractor/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.223358759Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/extractor/extractor/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.223443244Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/extractor/extractor/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.22356339Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/extractor/extractor/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.223631564Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/extractor/extractor/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.223647925Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.223659415Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.223669946Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.223714688Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.223826694Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.223899098Z namespaces/openshift-insights/pods/insights-runtime-extractor-t9d9h/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.223946591Z namespaces/openshift-insights/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.223963512Z namespaces/openshift-insights/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.224053357Z namespaces/openshift-insights/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.224074018Z namespaces/openshift-insights/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.224146532Z namespaces/openshift-keda/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.224157672Z namespaces/openshift-keda/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.224181954Z namespaces/openshift-keda/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.224229626Z namespaces/openshift-keda/coordination.k8s.io/leases/olm-operator.keda.sh.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.224329612Z namespaces/openshift-keda/coordination.k8s.io/leases/operator.keda.sh.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.224381304Z namespaces/openshift-keda/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.224391155Z namespaces/openshift-keda/monitoring.coreos.com/podmonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.224418937Z namespaces/openshift-keda/monitoring.coreos.com/podmonitors/keda-olm-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.22448984Z namespaces/openshift-keda/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.224509011Z namespaces/openshift-keda/monitoring.coreos.com/servicemonitors/keda-admission-webhooks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.224631068Z namespaces/openshift-keda/monitoring.coreos.com/servicemonitors/keda-metrics-apiserver.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.224744154Z namespaces/openshift-keda/monitoring.coreos.com/servicemonitors/keda-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.224821679Z namespaces/openshift-keda/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.224831549Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.224898212Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.22541174Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.225632843Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/custom-metrics-autoscaler.v2.19.0-1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.225899627Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.226151011Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.226365982Z namespaces/openshift-keda/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.226555122Z namespaces/openshift-keda/operators.coreos.com/installplans/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.226724291Z namespaces/openshift-keda/operators.coreos.com/installplans/install-zlslx.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.226861249Z namespaces/openshift-keda/operators.coreos.com/operatorconditions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.226921062Z namespaces/openshift-keda/operators.coreos.com/operatorconditions/custom-metrics-autoscaler.v2.19.0-1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.227000417Z namespaces/openshift-keda/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.227052529Z namespaces/openshift-keda/operators.coreos.com/operatorgroups/openshift-keda.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.227124903Z namespaces/openshift-keda/operators.coreos.com/subscriptions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.227203188Z namespaces/openshift-keda/operators.coreos.com/subscriptions/openshift-custom-metrics-autoscaler-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.227296223Z namespaces/openshift-kube-apiserver-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.227350716Z namespaces/openshift-kube-apiserver-operator/openshift-kube-apiserver-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.227419049Z namespaces/openshift-kube-apiserver-operator/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.227473452Z namespaces/openshift-kube-apiserver-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.227536576Z namespaces/openshift-kube-apiserver-operator/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.227585208Z namespaces/openshift-kube-apiserver-operator/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.227709195Z namespaces/openshift-kube-apiserver-operator/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.227812821Z namespaces/openshift-kube-apiserver-operator/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.227926427Z namespaces/openshift-kube-apiserver-operator/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.22798863Z namespaces/openshift-kube-apiserver-operator/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.228041133Z namespaces/openshift-kube-apiserver-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.228096246Z namespaces/openshift-kube-apiserver-operator/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.228180711Z namespaces/openshift-kube-apiserver-operator/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.228302767Z namespaces/openshift-kube-apiserver-operator/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.228373191Z namespaces/openshift-kube-apiserver-operator/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.228411933Z namespaces/openshift-kube-apiserver-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.22853198Z namespaces/openshift-kube-apiserver-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.228605064Z namespaces/openshift-kube-apiserver-operator/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.228666987Z namespaces/openshift-kube-apiserver-operator/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.228822985Z namespaces/openshift-kube-apiserver-operator/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.228933482Z namespaces/openshift-kube-apiserver-operator/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.229046888Z namespaces/openshift-kube-apiserver-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.229174235Z namespaces/openshift-kube-apiserver-operator/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.229291921Z namespaces/openshift-kube-apiserver-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.229495592Z namespaces/openshift-kube-apiserver-operator/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.229761976Z namespaces/openshift-kube-apiserver-operator/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.22982735Z namespaces/openshift-kube-apiserver-operator/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.229934966Z namespaces/openshift-kube-apiserver-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.230002489Z namespaces/openshift-kube-apiserver-operator/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.230064383Z namespaces/openshift-kube-apiserver-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.230125086Z namespaces/openshift-kube-apiserver-operator/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.230154658Z namespaces/openshift-kube-apiserver-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.230282195Z namespaces/openshift-kube-apiserver-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.230363529Z namespaces/openshift-kube-apiserver-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.230435273Z namespaces/openshift-kube-apiserver-operator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.230498706Z namespaces/openshift-kube-apiserver-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.230543459Z namespaces/openshift-kube-apiserver-operator/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.230599982Z namespaces/openshift-kube-apiserver-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.230669836Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.230680646Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.230735049Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.230902988Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.23111994Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.231316941Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.231561404Z namespaces/openshift-kube-apiserver-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.231767775Z namespaces/openshift-kube-apiserver-operator/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.231817458Z namespaces/openshift-kube-apiserver-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.232154506Z namespaces/openshift-kube-apiserver-operator/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.2322252Z namespaces/openshift-kube-apiserver-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.232308065Z namespaces/openshift-kube-apiserver/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.232366458Z namespaces/openshift-kube-apiserver/openshift-kube-apiserver.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.232449952Z namespaces/openshift-kube-apiserver/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.232499525Z namespaces/openshift-kube-apiserver/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.232572889Z namespaces/openshift-kube-apiserver/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.232621122Z namespaces/openshift-kube-apiserver/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.232723977Z namespaces/openshift-kube-apiserver/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.232820192Z namespaces/openshift-kube-apiserver/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.232923978Z namespaces/openshift-kube-apiserver/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.232976501Z namespaces/openshift-kube-apiserver/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.233017203Z namespaces/openshift-kube-apiserver/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.233092997Z namespaces/openshift-kube-apiserver/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.233125069Z namespaces/openshift-kube-apiserver/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.233343701Z namespaces/openshift-kube-apiserver/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.233393023Z namespaces/openshift-kube-apiserver/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.233453056Z namespaces/openshift-kube-apiserver/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.233560022Z namespaces/openshift-kube-apiserver/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.233628926Z namespaces/openshift-kube-apiserver/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.233686089Z namespaces/openshift-kube-apiserver/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.233808046Z namespaces/openshift-kube-apiserver/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.233900081Z namespaces/openshift-kube-apiserver/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.234007526Z namespaces/openshift-kube-apiserver/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.234112302Z namespaces/openshift-kube-apiserver/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.234241869Z namespaces/openshift-kube-apiserver/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.23443284Z namespaces/openshift-kube-apiserver/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.234647461Z namespaces/openshift-kube-apiserver/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.234693584Z namespaces/openshift-kube-apiserver/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.234739676Z namespaces/openshift-kube-apiserver/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.23480615Z namespaces/openshift-kube-apiserver/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.234846192Z namespaces/openshift-kube-apiserver/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.234912676Z namespaces/openshift-kube-apiserver/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.234947548Z namespaces/openshift-kube-apiserver/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.235037552Z namespaces/openshift-kube-apiserver/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.235267105Z namespaces/openshift-kube-apiserver/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.235343289Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.235381031Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.235453785Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.235509388Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/prometheusrules/api-usage.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.235623624Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/prometheusrules/podsecurity.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.235687968Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.235715279Z namespaces/openshift-kube-apiserver/monitoring.coreos.com/servicemonitors/openshift-kube-apiserver.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.235793194Z namespaces/openshift-kube-apiserver/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.235853977Z namespaces/openshift-kube-apiserver/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.235925951Z namespaces/openshift-kube-apiserver/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.235935201Z namespaces/openshift-kube-apiserver/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.235974823Z namespaces/openshift-kube-apiserver/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.236154213Z namespaces/openshift-kube-apiserver/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.236394726Z namespaces/openshift-kube-apiserver/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.236571126Z namespaces/openshift-kube-apiserver/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.236813339Z namespaces/openshift-kube-apiserver/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.237028881Z namespaces/openshift-kube-apiserver/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.237087174Z namespaces/openshift-kube-apiserver/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.237191599Z namespaces/openshift-kube-apiserver/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.237269963Z namespaces/openshift-kube-apiserver/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.237371829Z namespaces/openshift-kube-controller-manager-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.237430422Z namespaces/openshift-kube-controller-manager-operator/openshift-kube-controller-manager-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.237504506Z namespaces/openshift-kube-controller-manager-operator/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.237520447Z namespaces/openshift-kube-controller-manager-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.237590281Z namespaces/openshift-kube-controller-manager-operator/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.237644504Z namespaces/openshift-kube-controller-manager-operator/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.23775487Z namespaces/openshift-kube-controller-manager-operator/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.237849535Z namespaces/openshift-kube-controller-manager-operator/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.23794015Z namespaces/openshift-kube-controller-manager-operator/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.237997723Z namespaces/openshift-kube-controller-manager-operator/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.238046036Z namespaces/openshift-kube-controller-manager-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.238108219Z namespaces/openshift-kube-controller-manager-operator/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.238190653Z namespaces/openshift-kube-controller-manager-operator/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.23830253Z namespaces/openshift-kube-controller-manager-operator/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.238369953Z namespaces/openshift-kube-controller-manager-operator/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.238431697Z namespaces/openshift-kube-controller-manager-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.238546943Z namespaces/openshift-kube-controller-manager-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.238626257Z namespaces/openshift-kube-controller-manager-operator/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.23868476Z namespaces/openshift-kube-controller-manager-operator/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.238836888Z namespaces/openshift-kube-controller-manager-operator/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.238955415Z namespaces/openshift-kube-controller-manager-operator/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.239068941Z namespaces/openshift-kube-controller-manager-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.239182187Z namespaces/openshift-kube-controller-manager-operator/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.239336356Z namespaces/openshift-kube-controller-manager-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.239537077Z namespaces/openshift-kube-controller-manager-operator/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.239818002Z namespaces/openshift-kube-controller-manager-operator/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.239900166Z namespaces/openshift-kube-controller-manager-operator/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.23996692Z namespaces/openshift-kube-controller-manager-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.240058095Z namespaces/openshift-kube-controller-manager-operator/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.240105427Z namespaces/openshift-kube-controller-manager-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.240224444Z namespaces/openshift-kube-controller-manager-operator/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.240288897Z namespaces/openshift-kube-controller-manager-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.240418804Z namespaces/openshift-kube-controller-manager-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.240538921Z namespaces/openshift-kube-controller-manager-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.240601244Z namespaces/openshift-kube-controller-manager-operator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.240653407Z namespaces/openshift-kube-controller-manager-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.24071357Z namespaces/openshift-kube-controller-manager-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.240762423Z namespaces/openshift-kube-controller-manager-operator/monitoring.coreos.com/servicemonitors/kube-controller-manager-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.240838567Z namespaces/openshift-kube-controller-manager-operator/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.240867229Z namespaces/openshift-kube-controller-manager-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.240953613Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.240963904Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.241030867Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.241404078Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.24163489Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.241797329Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.242399422Z namespaces/openshift-kube-controller-manager-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.242589712Z namespaces/openshift-kube-controller-manager-operator/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.242619994Z namespaces/openshift-kube-controller-manager-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.242702338Z namespaces/openshift-kube-controller-manager-operator/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.24273266Z namespaces/openshift-kube-controller-manager-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.242831555Z namespaces/openshift-kube-controller-manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.242891888Z namespaces/openshift-kube-controller-manager/openshift-kube-controller-manager.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.242965463Z namespaces/openshift-kube-controller-manager/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.243016445Z namespaces/openshift-kube-controller-manager/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.243092219Z namespaces/openshift-kube-controller-manager/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.243120981Z namespaces/openshift-kube-controller-manager/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.243254108Z namespaces/openshift-kube-controller-manager/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.243339983Z namespaces/openshift-kube-controller-manager/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.243441898Z namespaces/openshift-kube-controller-manager/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.243494491Z namespaces/openshift-kube-controller-manager/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.243578906Z namespaces/openshift-kube-controller-manager/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.243642659Z namespaces/openshift-kube-controller-manager/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.243696052Z namespaces/openshift-kube-controller-manager/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.243792167Z namespaces/openshift-kube-controller-manager/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.24384752Z namespaces/openshift-kube-controller-manager/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.243903753Z namespaces/openshift-kube-controller-manager/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.243989388Z namespaces/openshift-kube-controller-manager/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.244059462Z namespaces/openshift-kube-controller-manager/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.244069412Z namespaces/openshift-kube-controller-manager/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.244123795Z namespaces/openshift-kube-controller-manager/coordination.k8s.io/leases/cluster-policy-controller-lock.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.244276774Z namespaces/openshift-kube-controller-manager/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.244324626Z namespaces/openshift-kube-controller-manager/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.244471894Z namespaces/openshift-kube-controller-manager/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.24458231Z namespaces/openshift-kube-controller-manager/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.24495596Z namespaces/openshift-kube-controller-manager/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.245091858Z namespaces/openshift-kube-controller-manager/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.245234146Z namespaces/openshift-kube-controller-manager/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.245439346Z namespaces/openshift-kube-controller-manager/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.245670979Z namespaces/openshift-kube-controller-manager/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.245737643Z namespaces/openshift-kube-controller-manager/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.245803616Z namespaces/openshift-kube-controller-manager/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.245861909Z namespaces/openshift-kube-controller-manager/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.245918443Z namespaces/openshift-kube-controller-manager/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.245998887Z namespaces/openshift-kube-controller-manager/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.246062171Z namespaces/openshift-kube-controller-manager/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.246194498Z namespaces/openshift-kube-controller-manager/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.246344396Z namespaces/openshift-kube-controller-manager/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.246410139Z namespaces/openshift-kube-controller-manager/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.246465412Z namespaces/openshift-kube-controller-manager/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.246539956Z namespaces/openshift-kube-controller-manager/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.246595889Z namespaces/openshift-kube-controller-manager/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.246650892Z namespaces/openshift-kube-controller-manager/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.246700065Z namespaces/openshift-kube-controller-manager/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.246758908Z namespaces/openshift-kube-controller-manager/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.246948879Z namespaces/openshift-kube-controller-manager/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.24715671Z namespaces/openshift-kube-controller-manager/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.2473498Z namespaces/openshift-kube-controller-manager/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.247623025Z namespaces/openshift-kube-controller-manager/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.248403717Z namespaces/openshift-kube-controller-manager/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.248438469Z namespaces/openshift-kube-controller-manager/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.248521984Z namespaces/openshift-kube-controller-manager/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.248560176Z namespaces/openshift-kube-controller-manager/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.248648581Z namespaces/openshift-kube-scheduler-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.248709634Z namespaces/openshift-kube-scheduler-operator/openshift-kube-scheduler-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.248792348Z namespaces/openshift-kube-scheduler-operator/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.24882518Z namespaces/openshift-kube-scheduler-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.248918195Z namespaces/openshift-kube-scheduler-operator/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.248956157Z namespaces/openshift-kube-scheduler-operator/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.249071634Z namespaces/openshift-kube-scheduler-operator/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.24918507Z namespaces/openshift-kube-scheduler-operator/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.24937948Z namespaces/openshift-kube-scheduler-operator/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.249453914Z namespaces/openshift-kube-scheduler-operator/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.249485466Z namespaces/openshift-kube-scheduler-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.24956155Z namespaces/openshift-kube-scheduler-operator/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.249615693Z namespaces/openshift-kube-scheduler-operator/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.249719369Z namespaces/openshift-kube-scheduler-operator/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.249780502Z namespaces/openshift-kube-scheduler-operator/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.249827104Z namespaces/openshift-kube-scheduler-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.24992754Z namespaces/openshift-kube-scheduler-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.249977823Z namespaces/openshift-kube-scheduler-operator/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.250034136Z namespaces/openshift-kube-scheduler-operator/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.250188304Z namespaces/openshift-kube-scheduler-operator/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.250316951Z namespaces/openshift-kube-scheduler-operator/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.250403716Z namespaces/openshift-kube-scheduler-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.250508712Z namespaces/openshift-kube-scheduler-operator/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.250588286Z namespaces/openshift-kube-scheduler-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.250725453Z namespaces/openshift-kube-scheduler-operator/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.250908203Z namespaces/openshift-kube-scheduler-operator/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.251280513Z namespaces/openshift-kube-scheduler-operator/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.251308765Z namespaces/openshift-kube-scheduler-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.25139802Z namespaces/openshift-kube-scheduler-operator/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.251429422Z namespaces/openshift-kube-scheduler-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.251502115Z namespaces/openshift-kube-scheduler-operator/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.251563549Z namespaces/openshift-kube-scheduler-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.251647033Z namespaces/openshift-kube-scheduler-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.251740288Z namespaces/openshift-kube-scheduler-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.251816132Z namespaces/openshift-kube-scheduler-operator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.251874175Z namespaces/openshift-kube-scheduler-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.251933929Z namespaces/openshift-kube-scheduler-operator/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.251982992Z namespaces/openshift-kube-scheduler-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.252050455Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.252110998Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.252189233Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.252420675Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.252613586Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.252778775Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.253029388Z namespaces/openshift-kube-scheduler-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.25324866Z namespaces/openshift-kube-scheduler-operator/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.253288692Z namespaces/openshift-kube-scheduler-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.253357636Z namespaces/openshift-kube-scheduler-operator/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.253405509Z namespaces/openshift-kube-scheduler-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.253550397Z namespaces/openshift-kube-scheduler/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.253587499Z namespaces/openshift-kube-scheduler/openshift-kube-scheduler.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.253671603Z namespaces/openshift-kube-scheduler/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.253709635Z namespaces/openshift-kube-scheduler/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.253774859Z namespaces/openshift-kube-scheduler/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.253832842Z namespaces/openshift-kube-scheduler/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.253937758Z namespaces/openshift-kube-scheduler/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.254020122Z namespaces/openshift-kube-scheduler/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.254109267Z namespaces/openshift-kube-scheduler/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.254183551Z namespaces/openshift-kube-scheduler/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.254238974Z namespaces/openshift-kube-scheduler/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.254298587Z namespaces/openshift-kube-scheduler/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.25434895Z namespaces/openshift-kube-scheduler/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.254449985Z namespaces/openshift-kube-scheduler/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.254501498Z namespaces/openshift-kube-scheduler/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.254557191Z namespaces/openshift-kube-scheduler/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.254642896Z namespaces/openshift-kube-scheduler/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.254706759Z namespaces/openshift-kube-scheduler/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.254759062Z namespaces/openshift-kube-scheduler/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.254885329Z namespaces/openshift-kube-scheduler/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.254977344Z namespaces/openshift-kube-scheduler/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.25508548Z namespaces/openshift-kube-scheduler/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.255203076Z namespaces/openshift-kube-scheduler/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.255294261Z namespaces/openshift-kube-scheduler/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.255438989Z namespaces/openshift-kube-scheduler/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.25563761Z namespaces/openshift-kube-scheduler/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.255690233Z namespaces/openshift-kube-scheduler/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.255752046Z namespaces/openshift-kube-scheduler/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.255811299Z namespaces/openshift-kube-scheduler/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.255861082Z namespaces/openshift-kube-scheduler/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.255936256Z namespaces/openshift-kube-scheduler/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.255990909Z namespaces/openshift-kube-scheduler/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.256085534Z namespaces/openshift-kube-scheduler/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.25619663Z namespaces/openshift-kube-scheduler/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.256399971Z namespaces/openshift-kube-scheduler/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.256435263Z namespaces/openshift-kube-scheduler/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.256504147Z namespaces/openshift-kube-scheduler/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.256521127Z namespaces/openshift-kube-scheduler/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.256586231Z namespaces/openshift-kube-scheduler/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.256601162Z namespaces/openshift-kube-scheduler/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.256659915Z namespaces/openshift-kube-scheduler/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.256819904Z namespaces/openshift-kube-scheduler/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.257044946Z namespaces/openshift-kube-scheduler/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.257239907Z namespaces/openshift-kube-scheduler/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.25748872Z namespaces/openshift-kube-scheduler/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.257694271Z namespaces/openshift-kube-scheduler/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.257717963Z namespaces/openshift-kube-scheduler/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.257793687Z namespaces/openshift-kube-scheduler/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.257837489Z namespaces/openshift-kube-scheduler/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.257955725Z namespaces/openshift-kube-storage-version-migrator-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.258015139Z namespaces/openshift-kube-storage-version-migrator-operator/openshift-kube-storage-version-migrator-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.258114784Z namespaces/openshift-kube-storage-version-migrator-operator/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.258141746Z namespaces/openshift-kube-storage-version-migrator-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.258263762Z namespaces/openshift-kube-storage-version-migrator-operator/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.258293674Z namespaces/openshift-kube-storage-version-migrator-operator/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.258387559Z namespaces/openshift-kube-storage-version-migrator-operator/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.258557318Z namespaces/openshift-kube-storage-version-migrator-operator/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.258694105Z namespaces/openshift-kube-storage-version-migrator-operator/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.258753989Z namespaces/openshift-kube-storage-version-migrator-operator/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.258811322Z namespaces/openshift-kube-storage-version-migrator-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.258865675Z namespaces/openshift-kube-storage-version-migrator-operator/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.258931788Z namespaces/openshift-kube-storage-version-migrator-operator/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.259025453Z namespaces/openshift-kube-storage-version-migrator-operator/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.259098507Z namespaces/openshift-kube-storage-version-migrator-operator/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.259136949Z namespaces/openshift-kube-storage-version-migrator-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.259304038Z namespaces/openshift-kube-storage-version-migrator-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.259363212Z namespaces/openshift-kube-storage-version-migrator-operator/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.259374892Z namespaces/openshift-kube-storage-version-migrator-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.259423695Z namespaces/openshift-kube-storage-version-migrator-operator/coordination.k8s.io/leases/openshift-kube-storage-version-migrator-operator-lock.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.259525161Z namespaces/openshift-kube-storage-version-migrator-operator/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.259576223Z namespaces/openshift-kube-storage-version-migrator-operator/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.259724851Z namespaces/openshift-kube-storage-version-migrator-operator/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.259839998Z namespaces/openshift-kube-storage-version-migrator-operator/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.260056419Z namespaces/openshift-kube-storage-version-migrator-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.260155755Z namespaces/openshift-kube-storage-version-migrator-operator/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.260365706Z namespaces/openshift-kube-storage-version-migrator-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.260524565Z namespaces/openshift-kube-storage-version-migrator-operator/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.260765158Z namespaces/openshift-kube-storage-version-migrator-operator/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.260845762Z namespaces/openshift-kube-storage-version-migrator-operator/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.260907796Z namespaces/openshift-kube-storage-version-migrator-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.26098464Z namespaces/openshift-kube-storage-version-migrator-operator/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.261027282Z namespaces/openshift-kube-storage-version-migrator-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.261114807Z namespaces/openshift-kube-storage-version-migrator-operator/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.26118376Z namespaces/openshift-kube-storage-version-migrator-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.261282256Z namespaces/openshift-kube-storage-version-migrator-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.261400962Z namespaces/openshift-kube-storage-version-migrator-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.261483757Z namespaces/openshift-kube-storage-version-migrator-operator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.26154129Z namespaces/openshift-kube-storage-version-migrator-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.261598113Z namespaces/openshift-kube-storage-version-migrator-operator/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.261643405Z namespaces/openshift-kube-storage-version-migrator-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.261703699Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.261715879Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.261758582Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.261945492Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.262192855Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.262388526Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.26265487Z namespaces/openshift-kube-storage-version-migrator-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.263279464Z namespaces/openshift-kube-storage-version-migrator-operator/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.263298505Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-846bf668f7-6c6v5/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.263332647Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-846bf668f7-6c6v5/kube-storage-version-migrator-operator-846bf668f7-6c6v5.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.263494526Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-846bf668f7-6c6v5/kube-storage-version-migrator-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.263508106Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-846bf668f7-6c6v5/kube-storage-version-migrator-operator/kube-storage-version-migrator-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.263514207Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-846bf668f7-6c6v5/kube-storage-version-migrator-operator/kube-storage-version-migrator-operator/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.26356508Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-846bf668f7-6c6v5/kube-storage-version-migrator-operator/kube-storage-version-migrator-operator/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.263715498Z namespaces/openshift-kube-storage-version-migrator-operator/pods/kube-storage-version-migrator-operator-846bf668f7-6c6v5/kube-storage-version-migrator-operator/kube-storage-version-migrator-operator/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.263956461Z namespaces/openshift-kube-storage-version-migrator-operator/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.264018044Z namespaces/openshift-kube-storage-version-migrator-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.264079878Z namespaces/openshift-kube-storage-version-migrator-operator/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.26413264Z namespaces/openshift-kube-storage-version-migrator-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.264261018Z namespaces/openshift-kube-storage-version-migrator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.264347082Z namespaces/openshift-kube-storage-version-migrator/openshift-kube-storage-version-migrator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.264405845Z namespaces/openshift-kube-storage-version-migrator/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.264729273Z namespaces/openshift-kube-storage-version-migrator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.264749244Z namespaces/openshift-kube-storage-version-migrator/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.264757264Z namespaces/openshift-kube-storage-version-migrator/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.264764085Z namespaces/openshift-kube-storage-version-migrator/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.264783156Z namespaces/openshift-kube-storage-version-migrator/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.264882001Z namespaces/openshift-kube-storage-version-migrator/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.264906032Z namespaces/openshift-kube-storage-version-migrator/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.264974696Z namespaces/openshift-kube-storage-version-migrator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.265032569Z namespaces/openshift-kube-storage-version-migrator/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.265065411Z namespaces/openshift-kube-storage-version-migrator/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.265146305Z namespaces/openshift-kube-storage-version-migrator/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.265243201Z namespaces/openshift-kube-storage-version-migrator/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.265313075Z namespaces/openshift-kube-storage-version-migrator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.265399019Z namespaces/openshift-kube-storage-version-migrator/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.265470103Z namespaces/openshift-kube-storage-version-migrator/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.265493214Z namespaces/openshift-kube-storage-version-migrator/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.265612851Z namespaces/openshift-kube-storage-version-migrator/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.265699995Z namespaces/openshift-kube-storage-version-migrator/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.265826272Z namespaces/openshift-kube-storage-version-migrator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.265904276Z namespaces/openshift-kube-storage-version-migrator/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.266024353Z namespaces/openshift-kube-storage-version-migrator/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.26615635Z namespaces/openshift-kube-storage-version-migrator/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.266358521Z namespaces/openshift-kube-storage-version-migrator/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.266423635Z namespaces/openshift-kube-storage-version-migrator/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.266463217Z namespaces/openshift-kube-storage-version-migrator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.26652243Z namespaces/openshift-kube-storage-version-migrator/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.266558282Z namespaces/openshift-kube-storage-version-migrator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.266614235Z namespaces/openshift-kube-storage-version-migrator/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.266650227Z namespaces/openshift-kube-storage-version-migrator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.266744822Z namespaces/openshift-kube-storage-version-migrator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.266916421Z namespaces/openshift-kube-storage-version-migrator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.266966164Z namespaces/openshift-kube-storage-version-migrator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.267016857Z namespaces/openshift-kube-storage-version-migrator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.267068559Z namespaces/openshift-kube-storage-version-migrator/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.267121313Z namespaces/openshift-kube-storage-version-migrator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.267190856Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.267211747Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.267275971Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.267478802Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.267697194Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.267871843Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.268124647Z namespaces/openshift-kube-storage-version-migrator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.268392262Z namespaces/openshift-kube-storage-version-migrator/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.268409392Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-d57d58cc9-fvv6h/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.268460045Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-d57d58cc9-fvv6h/migrator-d57d58cc9-fvv6h.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.268561851Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-d57d58cc9-fvv6h/graceful-termination/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.268572241Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-d57d58cc9-fvv6h/graceful-termination/graceful-termination/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.268578832Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-d57d58cc9-fvv6h/graceful-termination/graceful-termination/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.268632684Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-d57d58cc9-fvv6h/graceful-termination/graceful-termination/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.268773992Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-d57d58cc9-fvv6h/graceful-termination/graceful-termination/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.268883378Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-d57d58cc9-fvv6h/graceful-termination/graceful-termination/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.268935141Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-d57d58cc9-fvv6h/migrator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.268945192Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-d57d58cc9-fvv6h/migrator/migrator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.268950652Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-d57d58cc9-fvv6h/migrator/migrator/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.269011515Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-d57d58cc9-fvv6h/migrator/migrator/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.269146262Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-d57d58cc9-fvv6h/migrator/migrator/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.26928542Z namespaces/openshift-kube-storage-version-migrator/pods/migrator-d57d58cc9-fvv6h/migrator/migrator/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.269367494Z namespaces/openshift-kube-storage-version-migrator/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.269424677Z namespaces/openshift-kube-storage-version-migrator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.269490121Z namespaces/openshift-kube-storage-version-migrator/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.269542914Z namespaces/openshift-kube-storage-version-migrator/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.269625548Z namespaces/openshift-lws-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.269697902Z namespaces/openshift-lws-operator/openshift-lws-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.269783887Z namespaces/openshift-lws-operator/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.26984605Z namespaces/openshift-lws-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.269916904Z namespaces/openshift-lws-operator/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.269972377Z namespaces/openshift-lws-operator/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.270094864Z namespaces/openshift-lws-operator/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.270325086Z namespaces/openshift-lws-operator/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.270472694Z namespaces/openshift-lws-operator/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.270540188Z namespaces/openshift-lws-operator/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.270603871Z namespaces/openshift-lws-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.270673565Z namespaces/openshift-lws-operator/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.270735249Z namespaces/openshift-lws-operator/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.270848715Z namespaces/openshift-lws-operator/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.270916578Z namespaces/openshift-lws-operator/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.270978402Z namespaces/openshift-lws-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.271092808Z namespaces/openshift-lws-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.271183623Z namespaces/openshift-lws-operator/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.271203154Z namespaces/openshift-lws-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.271271018Z namespaces/openshift-lws-operator/coordination.k8s.io/leases/b8b2488c.x-k8s.io.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.271393594Z namespaces/openshift-lws-operator/coordination.k8s.io/leases/openshift-lws-operator-lock.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.271467808Z namespaces/openshift-lws-operator/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.271527321Z namespaces/openshift-lws-operator/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.27168502Z namespaces/openshift-lws-operator/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.271816447Z namespaces/openshift-lws-operator/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.272508485Z namespaces/openshift-lws-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.272618041Z namespaces/openshift-lws-operator/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.272836863Z namespaces/openshift-lws-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.273001571Z namespaces/openshift-lws-operator/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.273327969Z namespaces/openshift-lws-operator/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.273439775Z namespaces/openshift-lws-operator/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.273479027Z namespaces/openshift-lws-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.273573812Z namespaces/openshift-lws-operator/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.273627685Z namespaces/openshift-lws-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.27370685Z namespaces/openshift-lws-operator/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.273766483Z namespaces/openshift-lws-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.273874019Z namespaces/openshift-lws-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.273981994Z namespaces/openshift-lws-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.274045478Z namespaces/openshift-lws-operator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.274103681Z namespaces/openshift-lws-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.274191706Z namespaces/openshift-lws-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.27425748Z namespaces/openshift-lws-operator/monitoring.coreos.com/servicemonitors/lws-controller-manager-metrics-monitor.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.274322613Z namespaces/openshift-lws-operator/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.274368726Z namespaces/openshift-lws-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.27445086Z namespaces/openshift-lws-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.27445968Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.274521114Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.274706574Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.274929936Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.275098955Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/leader-worker-set.v1.0.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.275425723Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.275603822Z namespaces/openshift-lws-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.275799533Z namespaces/openshift-lws-operator/operators.coreos.com/installplans/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.275850266Z namespaces/openshift-lws-operator/operators.coreos.com/installplans/install-dcwfq.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.275945811Z namespaces/openshift-lws-operator/operators.coreos.com/operatorconditions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.275989594Z namespaces/openshift-lws-operator/operators.coreos.com/operatorconditions/leader-worker-set.v1.0.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.276045746Z namespaces/openshift-lws-operator/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.276087909Z namespaces/openshift-lws-operator/operators.coreos.com/operatorgroups/leader-worker-set.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.276155183Z namespaces/openshift-lws-operator/operators.coreos.com/subscriptions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.276241577Z namespaces/openshift-lws-operator/operators.coreos.com/subscriptions/leader-worker-set.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.276345003Z namespaces/openshift-lws-operator/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.276354633Z namespaces/openshift-lws-operator/pods/lws-controller-manager-6744679755-75qfd/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.276407936Z namespaces/openshift-lws-operator/pods/lws-controller-manager-6744679755-75qfd/lws-controller-manager-6744679755-75qfd.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.276498531Z namespaces/openshift-lws-operator/pods/lws-controller-manager-6744679755-75qfd/manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.276508142Z namespaces/openshift-lws-operator/pods/lws-controller-manager-6744679755-75qfd/manager/manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.276521942Z namespaces/openshift-lws-operator/pods/lws-controller-manager-6744679755-75qfd/manager/manager/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.276555694Z namespaces/openshift-lws-operator/pods/lws-controller-manager-6744679755-75qfd/manager/manager/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.276779016Z namespaces/openshift-lws-operator/pods/lws-controller-manager-6744679755-75qfd/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.277045841Z namespaces/openshift-lws-operator/pods/lws-controller-manager-6744679755-75qfd/manager/manager/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.277052591Z namespaces/openshift-lws-operator/pods/lws-controller-manager-6744679755-9gjmt/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.277056601Z namespaces/openshift-lws-operator/pods/lws-controller-manager-6744679755-9gjmt/lws-controller-manager-6744679755-9gjmt.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.277095183Z namespaces/openshift-lws-operator/pods/lws-controller-manager-6744679755-9gjmt/manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.277122595Z namespaces/openshift-lws-operator/pods/lws-controller-manager-6744679755-9gjmt/manager/manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.277136736Z namespaces/openshift-lws-operator/pods/lws-controller-manager-6744679755-9gjmt/manager/manager/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.277145256Z namespaces/openshift-lws-operator/pods/lws-controller-manager-6744679755-9gjmt/manager/manager/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.277353177Z namespaces/openshift-lws-operator/pods/lws-controller-manager-6744679755-9gjmt/manager/manager/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.277452223Z namespaces/openshift-lws-operator/pods/lws-controller-manager-6744679755-9gjmt/manager/manager/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.277515306Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-fd8ccff4c-58g4c/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.277570379Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-fd8ccff4c-58g4c/openshift-lws-operator-fd8ccff4c-58g4c.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.277675675Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-fd8ccff4c-58g4c/openshift-lws-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.277682905Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-fd8ccff4c-58g4c/openshift-lws-operator/openshift-lws-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.277696826Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-fd8ccff4c-58g4c/openshift-lws-operator/openshift-lws-operator/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.277748249Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-fd8ccff4c-58g4c/openshift-lws-operator/openshift-lws-operator/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.277942829Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-fd8ccff4c-58g4c/openshift-lws-operator/openshift-lws-operator/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.278042695Z namespaces/openshift-lws-operator/pods/openshift-lws-operator-fd8ccff4c-58g4c/openshift-lws-operator/openshift-lws-operator/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.278101558Z namespaces/openshift-lws-operator/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.278186202Z namespaces/openshift-lws-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.278267837Z namespaces/openshift-lws-operator/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.27832177Z namespaces/openshift-lws-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.278391814Z namespaces/openshift-machine-api/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.278399044Z namespaces/openshift-machine-api/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.278407645Z namespaces/openshift-machine-api/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.278468238Z namespaces/openshift-machine-api/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.278683609Z namespaces/openshift-machine-api/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.278891771Z namespaces/openshift-machine-api/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.279071581Z namespaces/openshift-machine-api/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.27943259Z namespaces/openshift-machine-api/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.279660042Z namespaces/openshift-machine-config-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.279669893Z namespaces/openshift-machine-config-operator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.279674983Z namespaces/openshift-machine-config-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.279735507Z namespaces/openshift-machine-config-operator/monitoring.coreos.com/prometheusrules/machine-config-controller.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.279872464Z namespaces/openshift-machine-config-operator/monitoring.coreos.com/prometheusrules/machine-config-daemon.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.279942148Z namespaces/openshift-machine-config-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.279951668Z namespaces/openshift-machine-config-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.27999316Z namespaces/openshift-machine-config-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.28035369Z namespaces/openshift-machine-config-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.280637786Z namespaces/openshift-machine-config-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.280790334Z namespaces/openshift-machine-config-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.281050498Z namespaces/openshift-machine-config-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.281321443Z namespaces/openshift-marketplace/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.281341754Z namespaces/openshift-marketplace/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.281361835Z namespaces/openshift-marketplace/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.281403787Z namespaces/openshift-marketplace/monitoring.coreos.com/prometheusrules/marketplace-alert-rules.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.281479581Z namespaces/openshift-marketplace/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.281492402Z namespaces/openshift-marketplace/operators.coreos.com/catalogsources/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.281564146Z namespaces/openshift-marketplace/operators.coreos.com/catalogsources/certified-operators.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.281735895Z namespaces/openshift-marketplace/operators.coreos.com/catalogsources/community-operators.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.28182923Z namespaces/openshift-marketplace/operators.coreos.com/catalogsources/redhat-marketplace.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.281944066Z namespaces/openshift-marketplace/operators.coreos.com/catalogsources/redhat-operators.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.28201997Z namespaces/openshift-marketplace/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.282091974Z namespaces/openshift-marketplace/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.282310366Z namespaces/openshift-marketplace/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.282515007Z namespaces/openshift-marketplace/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.28311823Z namespaces/openshift-marketplace/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.283418016Z namespaces/openshift-marketplace/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.28366735Z namespaces/openshift-monitoring/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.283732923Z namespaces/openshift-monitoring/openshift-monitoring.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.283821058Z namespaces/openshift-monitoring/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.283840469Z namespaces/openshift-monitoring/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.283916463Z namespaces/openshift-monitoring/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.283939365Z namespaces/openshift-monitoring/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.284116064Z namespaces/openshift-monitoring/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.284604681Z namespaces/openshift-monitoring/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.284983521Z namespaces/openshift-monitoring/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.285248805Z namespaces/openshift-monitoring/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.285269727Z namespaces/openshift-monitoring/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.285348151Z namespaces/openshift-monitoring/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.285485929Z namespaces/openshift-monitoring/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.285569523Z namespaces/openshift-monitoring/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.285623516Z namespaces/openshift-monitoring/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.285662428Z namespaces/openshift-monitoring/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.285749403Z namespaces/openshift-monitoring/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.285836368Z namespaces/openshift-monitoring/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.28588786Z namespaces/openshift-monitoring/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.289343558Z namespaces/openshift-monitoring/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.289517287Z namespaces/openshift-monitoring/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.290697881Z namespaces/openshift-monitoring/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.290774435Z namespaces/openshift-monitoring/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.291814292Z namespaces/openshift-monitoring/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.291946299Z namespaces/openshift-monitoring/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.292490598Z namespaces/openshift-monitoring/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.292657827Z namespaces/openshift-monitoring/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.292688479Z namespaces/openshift-monitoring/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.292841548Z namespaces/openshift-monitoring/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.29288782Z namespaces/openshift-monitoring/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.292937243Z namespaces/openshift-monitoring/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.292981455Z namespaces/openshift-monitoring/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.29306504Z namespaces/openshift-monitoring/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.293147294Z namespaces/openshift-monitoring/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.293241289Z namespaces/openshift-monitoring/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.293282931Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.293426839Z namespaces/openshift-monitoring/monitoring.coreos.com/alertmanagers/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.293456301Z namespaces/openshift-monitoring/monitoring.coreos.com/alertmanagers/main.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.293552736Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheuses/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.293567647Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheuses/k8s.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.293679743Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.293732716Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/alertmanager-main-rules.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.293831831Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/cluster-monitoring-operator-prometheus-rules.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.294045943Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/kube-state-metrics-rules.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.294134718Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/kubernetes-monitoring-rules.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.294469156Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/node-exporter-rules.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.294583632Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/prometheus-k8s-prometheus-rules.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.294716229Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/prometheus-k8s-thanos-sidecar-rules.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.294805824Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/prometheus-operator-rules.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.29491824Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/telemetry.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.295027336Z namespaces/openshift-monitoring/monitoring.coreos.com/prometheusrules/thanos-querier.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.29510195Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.295147002Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/alertmanager-main.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.295269089Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/cluster-monitoring-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.295360294Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/kube-state-metrics.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.295457349Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/kubelet.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.295697802Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/metrics-server.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.295778217Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/node-exporter.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.295947536Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/openshift-state-metrics.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.296041341Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/prometheus-k8s.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.296133036Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/prometheus-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.296294335Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/telemeter-client.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.29638814Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/thanos-querier.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.296488295Z namespaces/openshift-monitoring/monitoring.coreos.com/servicemonitors/thanos-sidecar.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.296549078Z namespaces/openshift-monitoring/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.296599741Z namespaces/openshift-monitoring/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.296647434Z namespaces/openshift-monitoring/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.296657324Z namespaces/openshift-monitoring/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.296696546Z namespaces/openshift-monitoring/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.296879256Z namespaces/openshift-monitoring/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.29713165Z namespaces/openshift-monitoring/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.297439087Z namespaces/openshift-monitoring/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.297749674Z namespaces/openshift-monitoring/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.297915623Z namespaces/openshift-monitoring/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.297962625Z namespaces/openshift-monitoring/operators.coreos.com/operatorgroups/openshift-cluster-monitoring.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.298070941Z namespaces/openshift-monitoring/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.298086292Z namespaces/openshift-monitoring/pods/alertmanager-main-0/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.298182557Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager-main-0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.298383208Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.298395729Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager/alertmanager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.298400269Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager/alertmanager/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.298450801Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager/alertmanager/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.298555737Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager/alertmanager/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.298643182Z namespaces/openshift-monitoring/pods/alertmanager-main-0/alertmanager/alertmanager/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.298692035Z namespaces/openshift-monitoring/pods/alertmanager-main-0/config-reloader/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.298703535Z namespaces/openshift-monitoring/pods/alertmanager-main-0/config-reloader/config-reloader/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.298709896Z namespaces/openshift-monitoring/pods/alertmanager-main-0/config-reloader/config-reloader/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.298748648Z namespaces/openshift-monitoring/pods/alertmanager-main-0/config-reloader/config-reloader/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.298871914Z namespaces/openshift-monitoring/pods/alertmanager-main-0/config-reloader/config-reloader/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.298936398Z namespaces/openshift-monitoring/pods/alertmanager-main-0/config-reloader/config-reloader/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.298991601Z namespaces/openshift-monitoring/pods/alertmanager-main-0/init-config-reloader/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299000941Z namespaces/openshift-monitoring/pods/alertmanager-main-0/init-config-reloader/init-config-reloader/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299007092Z namespaces/openshift-monitoring/pods/alertmanager-main-0/init-config-reloader/init-config-reloader/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299020352Z namespaces/openshift-monitoring/pods/alertmanager-main-0/init-config-reloader/init-config-reloader/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299132998Z namespaces/openshift-monitoring/pods/alertmanager-main-0/init-config-reloader/init-config-reloader/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299229634Z namespaces/openshift-monitoring/pods/alertmanager-main-0/init-config-reloader/init-config-reloader/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299246295Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-metric/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299253025Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-metric/kube-rbac-proxy-metric/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299262436Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-metric/kube-rbac-proxy-metric/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299312718Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-metric/kube-rbac-proxy-metric/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299429095Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-metric/kube-rbac-proxy-metric/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299507019Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-metric/kube-rbac-proxy-metric/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299548181Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-web/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299557472Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-web/kube-rbac-proxy-web/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299564822Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299621935Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299727281Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299818276Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299835467Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299848027Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299862978Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.299929102Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.300033878Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.300115862Z namespaces/openshift-monitoring/pods/alertmanager-main-0/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.300156914Z namespaces/openshift-monitoring/pods/alertmanager-main-0/prom-label-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.300192416Z namespaces/openshift-monitoring/pods/alertmanager-main-0/prom-label-proxy/prom-label-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.300208677Z namespaces/openshift-monitoring/pods/alertmanager-main-0/prom-label-proxy/prom-label-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.30025563Z namespaces/openshift-monitoring/pods/alertmanager-main-0/prom-label-proxy/prom-label-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.300362305Z namespaces/openshift-monitoring/pods/alertmanager-main-0/prom-label-proxy/prom-label-proxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.300427439Z namespaces/openshift-monitoring/pods/alertmanager-main-0/prom-label-proxy/prom-label-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.300483632Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-64786d9cbb-ktzts/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.300517044Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-64786d9cbb-ktzts/cluster-monitoring-operator-64786d9cbb-ktzts.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.3006345Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-64786d9cbb-ktzts/cluster-monitoring-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.30064061Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-64786d9cbb-ktzts/cluster-monitoring-operator/cluster-monitoring-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.300645091Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-64786d9cbb-ktzts/cluster-monitoring-operator/cluster-monitoring-operator/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.300684233Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-64786d9cbb-ktzts/cluster-monitoring-operator/cluster-monitoring-operator/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.301464355Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-64786d9cbb-ktzts/cluster-monitoring-operator/cluster-monitoring-operator/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.301540179Z namespaces/openshift-monitoring/pods/cluster-monitoring-operator-64786d9cbb-ktzts/cluster-monitoring-operator/cluster-monitoring-operator/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.301591682Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.301647085Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/kube-state-metrics-7c9dbb8b7d-b8mjr.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.302041466Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/kube-rbac-proxy-main/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.302054957Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/kube-rbac-proxy-main/kube-rbac-proxy-main/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.302060377Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.302098419Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.302226256Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.30230095Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.302324572Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/kube-rbac-proxy-self/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.302335932Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/kube-rbac-proxy-self/kube-rbac-proxy-self/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.302346943Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.302390495Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.302490621Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.302567705Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.302587126Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/kube-state-metrics/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.302600407Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/kube-state-metrics/kube-state-metrics/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.302606837Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/kube-state-metrics/kube-state-metrics/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.302653509Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/kube-state-metrics/kube-state-metrics/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.302895633Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/kube-state-metrics/kube-state-metrics/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.302960916Z namespaces/openshift-monitoring/pods/kube-state-metrics-7c9dbb8b7d-b8mjr/kube-state-metrics/kube-state-metrics/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.302996318Z namespaces/openshift-monitoring/pods/metrics-server-85696fc556-mtdtp/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.30304005Z namespaces/openshift-monitoring/pods/metrics-server-85696fc556-mtdtp/metrics-server-85696fc556-mtdtp.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.303132186Z namespaces/openshift-monitoring/pods/metrics-server-85696fc556-mtdtp/metrics-server/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.303140806Z namespaces/openshift-monitoring/pods/metrics-server-85696fc556-mtdtp/metrics-server/metrics-server/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.303149486Z namespaces/openshift-monitoring/pods/metrics-server-85696fc556-mtdtp/metrics-server/metrics-server/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.303261513Z namespaces/openshift-monitoring/pods/metrics-server-85696fc556-mtdtp/metrics-server/metrics-server/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.303352057Z namespaces/openshift-monitoring/pods/metrics-server-85696fc556-mtdtp/metrics-server/metrics-server/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.303419781Z namespaces/openshift-monitoring/pods/metrics-server-85696fc556-mtdtp/metrics-server/metrics-server/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.303467744Z namespaces/openshift-monitoring/pods/monitoring-plugin-d5dcff7cf-t9vpw/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.303498685Z namespaces/openshift-monitoring/pods/monitoring-plugin-d5dcff7cf-t9vpw/monitoring-plugin-d5dcff7cf-t9vpw.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.30358245Z namespaces/openshift-monitoring/pods/monitoring-plugin-d5dcff7cf-t9vpw/monitoring-plugin/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.3035914Z namespaces/openshift-monitoring/pods/monitoring-plugin-d5dcff7cf-t9vpw/monitoring-plugin/monitoring-plugin/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.303597551Z namespaces/openshift-monitoring/pods/monitoring-plugin-d5dcff7cf-t9vpw/monitoring-plugin/monitoring-plugin/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.303639513Z namespaces/openshift-monitoring/pods/monitoring-plugin-d5dcff7cf-t9vpw/monitoring-plugin/monitoring-plugin/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.303735388Z namespaces/openshift-monitoring/pods/monitoring-plugin-d5dcff7cf-t9vpw/monitoring-plugin/monitoring-plugin/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.303823843Z namespaces/openshift-monitoring/pods/monitoring-plugin-d5dcff7cf-t9vpw/monitoring-plugin/monitoring-plugin/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.303887796Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.303935949Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/node-exporter-8fbnv.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.304047925Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/init-textfile/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.304057306Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/init-textfile/init-textfile/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.304067566Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/init-textfile/init-textfile/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.304122739Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/init-textfile/init-textfile/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.304235275Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/init-textfile/init-textfile/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.304303399Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/init-textfile/init-textfile/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.304349021Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.304356912Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.304363012Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.304401104Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.30449855Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.304562983Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.304613626Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/node-exporter/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.304624476Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/node-exporter/node-exporter/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.304636767Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/node-exporter/node-exporter/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.30468019Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/node-exporter/node-exporter/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.304802956Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/node-exporter/node-exporter/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.304864909Z namespaces/openshift-monitoring/pods/node-exporter-8fbnv/node-exporter/node-exporter/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.304914862Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.304964745Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/node-exporter-k6rsq.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.305079401Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/init-textfile/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.305089402Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/init-textfile/init-textfile/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.305100732Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/init-textfile/init-textfile/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.305176566Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/init-textfile/init-textfile/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.305316334Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/init-textfile/init-textfile/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.305396128Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/init-textfile/init-textfile/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.305441351Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.305450531Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.305456121Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.305485333Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.305587669Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.305653172Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.305696254Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/node-exporter/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.305705705Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/node-exporter/node-exporter/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.305711395Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/node-exporter/node-exporter/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.30580398Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/node-exporter/node-exporter/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.305912526Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/node-exporter/node-exporter/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.30597782Z namespaces/openshift-monitoring/pods/node-exporter-k6rsq/node-exporter/node-exporter/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.306027492Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.306046153Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/node-exporter-zsdvl.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.30617688Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/init-textfile/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.306192601Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/init-textfile/init-textfile/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.306200522Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/init-textfile/init-textfile/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.306244744Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/init-textfile/init-textfile/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.306315668Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/init-textfile/init-textfile/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.306391972Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/init-textfile/init-textfile/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.306428854Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.306436385Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.306443795Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.306487817Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.306584833Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.306651616Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.306695819Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/node-exporter/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.3067079Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/node-exporter/node-exporter/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.30671416Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/node-exporter/node-exporter/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.306753012Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/node-exporter/node-exporter/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.306848887Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/node-exporter/node-exporter/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.306931312Z namespaces/openshift-monitoring/pods/node-exporter-zsdvl/node-exporter/node-exporter/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.306980764Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.307016046Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/openshift-state-metrics-54cf96dfcf-54jr6.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.307186275Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/kube-rbac-proxy-main/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.307203326Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/kube-rbac-proxy-main/kube-rbac-proxy-main/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.307210857Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.307282411Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.307377636Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.3074457Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/kube-rbac-proxy-main/kube-rbac-proxy-main/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.307470711Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/kube-rbac-proxy-self/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.307494432Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/kube-rbac-proxy-self/kube-rbac-proxy-self/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.307507593Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.307560326Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.307657051Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.307722864Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/kube-rbac-proxy-self/kube-rbac-proxy-self/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.307775117Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/openshift-state-metrics/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.307788938Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/openshift-state-metrics/openshift-state-metrics/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.307799829Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/openshift-state-metrics/openshift-state-metrics/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.307837231Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/openshift-state-metrics/openshift-state-metrics/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.307947807Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/openshift-state-metrics/openshift-state-metrics/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.30801512Z namespaces/openshift-monitoring/pods/openshift-state-metrics-54cf96dfcf-54jr6/openshift-state-metrics/openshift-state-metrics/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.308089544Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.308208021Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus-k8s-0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.308426533Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/config-reloader/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.308439873Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/config-reloader/config-reloader/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.308445774Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/config-reloader/config-reloader/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.308499237Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/config-reloader/config-reloader/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.308620863Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/config-reloader/config-reloader/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.308834495Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/config-reloader/config-reloader/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.308883147Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/init-config-reloader/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.308893138Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/init-config-reloader/init-config-reloader/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.308902699Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/init-config-reloader/init-config-reloader/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.308952561Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/init-config-reloader/init-config-reloader/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.309069057Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/init-config-reloader/init-config-reloader/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.309177303Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/init-config-reloader/init-config-reloader/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.309235126Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-thanos/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.309246537Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-thanos/kube-rbac-proxy-thanos/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.309257088Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-thanos/kube-rbac-proxy-thanos/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.309323841Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-thanos/kube-rbac-proxy-thanos/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.309422817Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-thanos/kube-rbac-proxy-thanos/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.309521682Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-thanos/kube-rbac-proxy-thanos/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.309570115Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-web/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.309583195Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-web/kube-rbac-proxy-web/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.309588716Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.309630208Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.309757405Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.30984395Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.30986045Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.309867841Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.309875731Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.309924214Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.31004599Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.310120334Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.310145946Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.310154766Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus/prometheus/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.310183368Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus/prometheus/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.310251212Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus/prometheus/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.310857845Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus/prometheus/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.31095544Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/prometheus/prometheus/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.311002792Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/thanos-sidecar/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.311011943Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/thanos-sidecar/thanos-sidecar/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.311018333Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/thanos-sidecar/thanos-sidecar/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.311063756Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/thanos-sidecar/thanos-sidecar/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.311285588Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/thanos-sidecar/thanos-sidecar/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.311393094Z namespaces/openshift-monitoring/pods/prometheus-k8s-0/thanos-sidecar/thanos-sidecar/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.311442006Z namespaces/openshift-monitoring/pods/prometheus-operator-567f7b8b7c-kjtvx/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.311494629Z namespaces/openshift-monitoring/pods/prometheus-operator-567f7b8b7c-kjtvx/prometheus-operator-567f7b8b7c-kjtvx.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.311619666Z namespaces/openshift-monitoring/pods/prometheus-operator-567f7b8b7c-kjtvx/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.311632916Z namespaces/openshift-monitoring/pods/prometheus-operator-567f7b8b7c-kjtvx/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.311638187Z namespaces/openshift-monitoring/pods/prometheus-operator-567f7b8b7c-kjtvx/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.311675019Z namespaces/openshift-monitoring/pods/prometheus-operator-567f7b8b7c-kjtvx/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.311770934Z namespaces/openshift-monitoring/pods/prometheus-operator-567f7b8b7c-kjtvx/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.31187411Z namespaces/openshift-monitoring/pods/prometheus-operator-567f7b8b7c-kjtvx/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.311920332Z namespaces/openshift-monitoring/pods/prometheus-operator-567f7b8b7c-kjtvx/prometheus-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.311929152Z namespaces/openshift-monitoring/pods/prometheus-operator-567f7b8b7c-kjtvx/prometheus-operator/prometheus-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.311935633Z namespaces/openshift-monitoring/pods/prometheus-operator-567f7b8b7c-kjtvx/prometheus-operator/prometheus-operator/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.311976715Z namespaces/openshift-monitoring/pods/prometheus-operator-567f7b8b7c-kjtvx/prometheus-operator/prometheus-operator/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.312330624Z namespaces/openshift-monitoring/pods/prometheus-operator-567f7b8b7c-kjtvx/prometheus-operator/prometheus-operator/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.312425159Z namespaces/openshift-monitoring/pods/prometheus-operator-567f7b8b7c-kjtvx/prometheus-operator/prometheus-operator/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.312484363Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-d559d66d5-9nvfr/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.312543856Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-d559d66d5-9nvfr/prometheus-operator-admission-webhook-d559d66d5-9nvfr.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.312643241Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-d559d66d5-9nvfr/prometheus-operator-admission-webhook/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.312655532Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-d559d66d5-9nvfr/prometheus-operator-admission-webhook/prometheus-operator-admission-webhook/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.312661532Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-d559d66d5-9nvfr/prometheus-operator-admission-webhook/prometheus-operator-admission-webhook/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.312713645Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-d559d66d5-9nvfr/prometheus-operator-admission-webhook/prometheus-operator-admission-webhook/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.312832592Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-d559d66d5-9nvfr/prometheus-operator-admission-webhook/prometheus-operator-admission-webhook/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.312925357Z namespaces/openshift-monitoring/pods/prometheus-operator-admission-webhook-d559d66d5-9nvfr/prometheus-operator-admission-webhook/prometheus-operator-admission-webhook/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.312962239Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.313023512Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/telemeter-client-646c8d68d4-kd7vt.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.313226563Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.313239834Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.313243954Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.313291597Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.313396522Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.313483297Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.31353686Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/reload/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.31354424Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/reload/reload/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.31354831Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/reload/reload/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.313611444Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/reload/reload/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.31371568Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/reload/reload/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.313818765Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/reload/reload/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.313846167Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/telemeter-client/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.313864168Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/telemeter-client/telemeter-client/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.313874088Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/telemeter-client/telemeter-client/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.313926471Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/telemeter-client/telemeter-client/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.314054538Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/telemeter-client/telemeter-client/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.314140312Z namespaces/openshift-monitoring/pods/telemeter-client-646c8d68d4-kd7vt/telemeter-client/telemeter-client/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.314239338Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.314341783Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/thanos-querier-844c6d478b-hqmt6.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.314505842Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy-metrics/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.314515343Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy-metrics/kube-rbac-proxy-metrics/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.314521583Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy-metrics/kube-rbac-proxy-metrics/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.314566726Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy-metrics/kube-rbac-proxy-metrics/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.314700483Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy-metrics/kube-rbac-proxy-metrics/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.314789218Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy-metrics/kube-rbac-proxy-metrics/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.31482707Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy-rules/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.31483857Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy-rules/kube-rbac-proxy-rules/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.314849751Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy-rules/kube-rbac-proxy-rules/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.314884363Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy-rules/kube-rbac-proxy-rules/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.31501558Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy-rules/kube-rbac-proxy-rules/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.315099555Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy-rules/kube-rbac-proxy-rules/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.315143277Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy-web/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.315153307Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy-web/kube-rbac-proxy-web/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.315188009Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.315262693Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.315358238Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.315466784Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy-web/kube-rbac-proxy-web/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.315512867Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.315522698Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.315528468Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.315590261Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.315678636Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.315778741Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.315824394Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/prom-label-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.315837784Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/prom-label-proxy/prom-label-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.315843985Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/prom-label-proxy/prom-label-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.315876347Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/prom-label-proxy/prom-label-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.315991513Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/prom-label-proxy/prom-label-proxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.316078788Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/prom-label-proxy/prom-label-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.31612147Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/thanos-query/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.31613098Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/thanos-query/thanos-query/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.316136431Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/thanos-query/thanos-query/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.316212055Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/thanos-query/thanos-query/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.316334362Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/thanos-query/thanos-query/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.316412696Z namespaces/openshift-monitoring/pods/thanos-querier-844c6d478b-hqmt6/thanos-query/thanos-query/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.316470919Z namespaces/openshift-monitoring/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.316514041Z namespaces/openshift-monitoring/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.316567294Z namespaces/openshift-monitoring/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.316610626Z namespaces/openshift-monitoring/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.316730923Z namespaces/openshift-multus/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.316790666Z namespaces/openshift-multus/openshift-multus.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.316908722Z namespaces/openshift-multus/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.316960696Z namespaces/openshift-multus/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.317026609Z namespaces/openshift-multus/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.317073251Z namespaces/openshift-multus/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.317378108Z namespaces/openshift-multus/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.317460463Z namespaces/openshift-multus/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.317545177Z namespaces/openshift-multus/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.317625912Z namespaces/openshift-multus/apps/daemonsets/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.317667404Z namespaces/openshift-multus/apps/daemonsets/multus-additional-cni-plugins.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.317841923Z namespaces/openshift-multus/apps/daemonsets/multus.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.31796885Z namespaces/openshift-multus/apps/daemonsets/network-metrics-daemon.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.318049764Z namespaces/openshift-multus/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.318100447Z namespaces/openshift-multus/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.31814459Z namespaces/openshift-multus/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.318238075Z namespaces/openshift-multus/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.31833358Z namespaces/openshift-multus/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.318388343Z namespaces/openshift-multus/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.318434896Z namespaces/openshift-multus/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.318574583Z namespaces/openshift-multus/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.318622446Z namespaces/openshift-multus/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.318688489Z namespaces/openshift-multus/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.31888238Z namespaces/openshift-multus/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.319008947Z namespaces/openshift-multus/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.319685923Z namespaces/openshift-multus/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.319877074Z namespaces/openshift-multus/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.320946801Z namespaces/openshift-multus/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.321068838Z namespaces/openshift-multus/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.32127809Z namespaces/openshift-multus/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.321386325Z namespaces/openshift-multus/core/configmaps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.321439708Z namespaces/openshift-multus/core/configmaps/cni-copy-resources.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.321590467Z namespaces/openshift-multus/core/configmaps/default-cni-sysctl-allowlist.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.321720934Z namespaces/openshift-multus/core/configmaps/multus-daemon-config.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.321848041Z namespaces/openshift-multus/core/configmaps/whereabouts-flatfile-config.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.321989558Z namespaces/openshift-multus/core/serviceaccounts/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.322049521Z namespaces/openshift-multus/core/serviceaccounts/metrics-daemon-sa.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.322190609Z namespaces/openshift-multus/core/serviceaccounts/multus-ac.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.322312296Z namespaces/openshift-multus/core/serviceaccounts/multus-ancillary-tools.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.32239763Z namespaces/openshift-multus/core/serviceaccounts/multus.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.322453983Z namespaces/openshift-multus/core/services/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.322489465Z namespaces/openshift-multus/core/services/network-metrics-service.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.322558619Z namespaces/openshift-multus/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.322598401Z namespaces/openshift-multus/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.322659154Z namespaces/openshift-multus/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.322691876Z namespaces/openshift-multus/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.322751579Z namespaces/openshift-multus/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.322790092Z namespaces/openshift-multus/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.322868016Z namespaces/openshift-multus/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.322957991Z namespaces/openshift-multus/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.322991692Z namespaces/openshift-multus/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.323070047Z namespaces/openshift-multus/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.32312888Z namespaces/openshift-multus/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.32330374Z namespaces/openshift-multus/monitoring.coreos.com/servicemonitors/monitor-network.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.323346682Z namespaces/openshift-multus/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.323398925Z namespaces/openshift-multus/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.323457588Z namespaces/openshift-multus/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.323475899Z namespaces/openshift-multus/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.323528162Z namespaces/openshift-multus/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.323709022Z namespaces/openshift-multus/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.323898002Z namespaces/openshift-multus/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.324039239Z namespaces/openshift-multus/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.324276392Z namespaces/openshift-multus/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.324481013Z namespaces/openshift-multus/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.324491554Z namespaces/openshift-multus/pods/multus-8jxnm/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.324510545Z namespaces/openshift-multus/pods/multus-8jxnm/multus-8jxnm.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.324661193Z namespaces/openshift-multus/pods/multus-8jxnm/kube-multus/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.324671644Z namespaces/openshift-multus/pods/multus-8jxnm/kube-multus/kube-multus/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.324675744Z namespaces/openshift-multus/pods/multus-8jxnm/kube-multus/kube-multus/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.324682984Z namespaces/openshift-multus/pods/multus-8jxnm/kube-multus/kube-multus/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.325119308Z namespaces/openshift-multus/pods/multus-8jxnm/kube-multus/kube-multus/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.325239154Z namespaces/openshift-multus/pods/multus-8jxnm/kube-multus/kube-multus/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.325259746Z namespaces/openshift-multus/pods/multus-8pv6c/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.325327419Z namespaces/openshift-multus/pods/multus-8pv6c/multus-8pv6c.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.325417854Z namespaces/openshift-multus/pods/multus-8pv6c/kube-multus/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.325428585Z namespaces/openshift-multus/pods/multus-8pv6c/kube-multus/kube-multus/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.325434445Z namespaces/openshift-multus/pods/multus-8pv6c/kube-multus/kube-multus/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.325447476Z namespaces/openshift-multus/pods/multus-8pv6c/kube-multus/kube-multus/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.326570167Z namespaces/openshift-multus/pods/multus-8pv6c/kube-multus/kube-multus/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.32664059Z namespaces/openshift-multus/pods/multus-8pv6c/kube-multus/kube-multus/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.326694413Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.326744426Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/multus-additional-cni-plugins-6xpv2.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.326892984Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/bond-cni-plugin/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.326901444Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/bond-cni-plugin/bond-cni-plugin/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.326905535Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/bond-cni-plugin/bond-cni-plugin/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.326949457Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/bond-cni-plugin/bond-cni-plugin/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.327039952Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/bond-cni-plugin/bond-cni-plugin/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.327110126Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/bond-cni-plugin/bond-cni-plugin/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.327137967Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/cni-plugins/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.327144598Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/cni-plugins/cni-plugins/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.327157229Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/cni-plugins/cni-plugins/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.327248723Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/cni-plugins/cni-plugins/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.327352629Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/cni-plugins/cni-plugins/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.327422393Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/cni-plugins/cni-plugins/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.327476466Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/egress-router-binary-copy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.327488666Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/egress-router-binary-copy/egress-router-binary-copy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.327497687Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/egress-router-binary-copy/egress-router-binary-copy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.32754535Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/egress-router-binary-copy/egress-router-binary-copy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.327682557Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/egress-router-binary-copy/egress-router-binary-copy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.327757031Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/egress-router-binary-copy/egress-router-binary-copy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.327785932Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/kube-multus-additional-cni-plugins/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.327792273Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.327796423Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.327840746Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.32791797Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.327989054Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328018895Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/routeoverride-cni/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328026076Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/routeoverride-cni/routeoverride-cni/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328029986Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/routeoverride-cni/routeoverride-cni/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328072088Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/routeoverride-cni/routeoverride-cni/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328188644Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/routeoverride-cni/routeoverride-cni/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328382375Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/routeoverride-cni/routeoverride-cni/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328405866Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/whereabouts-cni-bincopy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328416557Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/whereabouts-cni-bincopy/whereabouts-cni-bincopy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328422757Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328458329Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328531783Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328616368Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328637789Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/whereabouts-cni/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328644369Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/whereabouts-cni/whereabouts-cni/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328649289Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/whereabouts-cni/whereabouts-cni/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328697652Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/whereabouts-cni/whereabouts-cni/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328784887Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/whereabouts-cni/whereabouts-cni/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328864741Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-6xpv2/whereabouts-cni/whereabouts-cni/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328890092Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.328924534Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/multus-additional-cni-plugins-97xhl.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.329078603Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/bond-cni-plugin/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.329092074Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/bond-cni-plugin/bond-cni-plugin/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.329099164Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/bond-cni-plugin/bond-cni-plugin/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.329108764Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/bond-cni-plugin/bond-cni-plugin/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.3292105Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/bond-cni-plugin/bond-cni-plugin/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.329314935Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/bond-cni-plugin/bond-cni-plugin/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.329331527Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/cni-plugins/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.329341877Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/cni-plugins/cni-plugins/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.329347677Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/cni-plugins/cni-plugins/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.329432692Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/cni-plugins/cni-plugins/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.329634523Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/cni-plugins/cni-plugins/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.329701896Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/cni-plugins/cni-plugins/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.329717037Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/egress-router-binary-copy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.329723488Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/egress-router-binary-copy/egress-router-binary-copy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.329741449Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/egress-router-binary-copy/egress-router-binary-copy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.329785521Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/egress-router-binary-copy/egress-router-binary-copy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.329877136Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/egress-router-binary-copy/egress-router-binary-copy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.32994532Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/egress-router-binary-copy/egress-router-binary-copy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.329991632Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/kube-multus-additional-cni-plugins/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330002063Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330007373Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330015604Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330097878Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330190843Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330252686Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/routeoverride-cni/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330262557Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/routeoverride-cni/routeoverride-cni/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330268207Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/routeoverride-cni/routeoverride-cni/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330306579Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/routeoverride-cni/routeoverride-cni/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330391744Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/routeoverride-cni/routeoverride-cni/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330479569Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/routeoverride-cni/routeoverride-cni/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.33049991Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/whereabouts-cni-bincopy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.33050955Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/whereabouts-cni-bincopy/whereabouts-cni-bincopy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.33051386Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330550522Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330641377Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330715771Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330752173Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/whereabouts-cni/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330759804Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/whereabouts-cni/whereabouts-cni/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330776275Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/whereabouts-cni/whereabouts-cni/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330788395Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/whereabouts-cni/whereabouts-cni/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330899981Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/whereabouts-cni/whereabouts-cni/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.330973455Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-97xhl/whereabouts-cni/whereabouts-cni/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.331039409Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.331091842Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/multus-additional-cni-plugins-stzpv.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.331269752Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/bond-cni-plugin/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.331284062Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/bond-cni-plugin/bond-cni-plugin/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.331288273Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/bond-cni-plugin/bond-cni-plugin/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.331334945Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/bond-cni-plugin/bond-cni-plugin/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.331466662Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/bond-cni-plugin/bond-cni-plugin/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.331558407Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/bond-cni-plugin/bond-cni-plugin/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.33161245Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/cni-plugins/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.33161984Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/cni-plugins/cni-plugins/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.331623991Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/cni-plugins/cni-plugins/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.331680514Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/cni-plugins/cni-plugins/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.331810381Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/cni-plugins/cni-plugins/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.331922737Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/cni-plugins/cni-plugins/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.332037993Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/egress-router-binary-copy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.332074765Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/egress-router-binary-copy/egress-router-binary-copy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.332082846Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/egress-router-binary-copy/egress-router-binary-copy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.332096146Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/egress-router-binary-copy/egress-router-binary-copy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.332229504Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/egress-router-binary-copy/egress-router-binary-copy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.332338959Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/egress-router-binary-copy/egress-router-binary-copy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.332396263Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/kube-multus-additional-cni-plugins/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.332417754Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.332424054Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.332440405Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.33253408Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.332602894Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/kube-multus-additional-cni-plugins/kube-multus-additional-cni-plugins/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.332616334Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/routeoverride-cni/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.332625465Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/routeoverride-cni/routeoverride-cni/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.332630915Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/routeoverride-cni/routeoverride-cni/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.33271883Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/routeoverride-cni/routeoverride-cni/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.332828276Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/routeoverride-cni/routeoverride-cni/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.332940542Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/routeoverride-cni/routeoverride-cni/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.332962103Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/whereabouts-cni-bincopy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.332968664Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/whereabouts-cni-bincopy/whereabouts-cni-bincopy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.332978124Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.333052068Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.333206206Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.333306512Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/whereabouts-cni-bincopy/whereabouts-cni-bincopy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.333363455Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/whereabouts-cni/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.333372175Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/whereabouts-cni/whereabouts-cni/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.333378216Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/whereabouts-cni/whereabouts-cni/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.333422118Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/whereabouts-cni/whereabouts-cni/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.333540515Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/whereabouts-cni/whereabouts-cni/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.33363725Z namespaces/openshift-multus/pods/multus-additional-cni-plugins-stzpv/whereabouts-cni/whereabouts-cni/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.333660531Z namespaces/openshift-multus/pods/multus-t8qnb/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.333731155Z namespaces/openshift-multus/pods/multus-t8qnb/multus-t8qnb.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.333833411Z namespaces/openshift-multus/pods/multus-t8qnb/kube-multus/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.333845381Z namespaces/openshift-multus/pods/multus-t8qnb/kube-multus/kube-multus/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.333851721Z namespaces/openshift-multus/pods/multus-t8qnb/kube-multus/kube-multus/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.333923435Z namespaces/openshift-multus/pods/multus-t8qnb/kube-multus/kube-multus/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.335392545Z namespaces/openshift-multus/pods/multus-t8qnb/kube-multus/kube-multus/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.33549025Z namespaces/openshift-multus/pods/multus-t8qnb/kube-multus/kube-multus/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.335518822Z namespaces/openshift-multus/pods/network-metrics-daemon-bxjqc/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.335612707Z namespaces/openshift-multus/pods/network-metrics-daemon-bxjqc/network-metrics-daemon-bxjqc.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.336186228Z namespaces/openshift-multus/pods/network-metrics-daemon-bxjqc/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.33621365Z namespaces/openshift-multus/pods/network-metrics-daemon-bxjqc/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.33622103Z namespaces/openshift-multus/pods/network-metrics-daemon-bxjqc/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.336227461Z namespaces/openshift-multus/pods/network-metrics-daemon-bxjqc/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.336234331Z namespaces/openshift-multus/pods/network-metrics-daemon-bxjqc/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.336239681Z namespaces/openshift-multus/pods/network-metrics-daemon-bxjqc/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.336245441Z namespaces/openshift-multus/pods/network-metrics-daemon-bxjqc/network-metrics-daemon/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.336251542Z namespaces/openshift-multus/pods/network-metrics-daemon-bxjqc/network-metrics-daemon/network-metrics-daemon/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.336257092Z namespaces/openshift-multus/pods/network-metrics-daemon-bxjqc/network-metrics-daemon/network-metrics-daemon/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.336262802Z namespaces/openshift-multus/pods/network-metrics-daemon-bxjqc/network-metrics-daemon/network-metrics-daemon/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.336797481Z namespaces/openshift-multus/pods/network-metrics-daemon-bxjqc/network-metrics-daemon/network-metrics-daemon/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.336827623Z namespaces/openshift-multus/pods/network-metrics-daemon-bxjqc/network-metrics-daemon/network-metrics-daemon/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.336835493Z namespaces/openshift-multus/pods/network-metrics-daemon-nb49f/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.336842024Z namespaces/openshift-multus/pods/network-metrics-daemon-nb49f/network-metrics-daemon-nb49f.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.336849924Z namespaces/openshift-multus/pods/network-metrics-daemon-nb49f/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.336855315Z namespaces/openshift-multus/pods/network-metrics-daemon-nb49f/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.336866835Z namespaces/openshift-multus/pods/network-metrics-daemon-nb49f/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.336896767Z namespaces/openshift-multus/pods/network-metrics-daemon-nb49f/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.336919878Z namespaces/openshift-multus/pods/network-metrics-daemon-nb49f/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.336929508Z namespaces/openshift-multus/pods/network-metrics-daemon-nb49f/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.337016103Z namespaces/openshift-multus/pods/network-metrics-daemon-nb49f/network-metrics-daemon/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.337061235Z namespaces/openshift-multus/pods/network-metrics-daemon-nb49f/network-metrics-daemon/network-metrics-daemon/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.337088067Z namespaces/openshift-multus/pods/network-metrics-daemon-nb49f/network-metrics-daemon/network-metrics-daemon/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.33713505Z namespaces/openshift-multus/pods/network-metrics-daemon-nb49f/network-metrics-daemon/network-metrics-daemon/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.33732333Z namespaces/openshift-multus/pods/network-metrics-daemon-nb49f/network-metrics-daemon/network-metrics-daemon/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.337401664Z namespaces/openshift-multus/pods/network-metrics-daemon-nb49f/network-metrics-daemon/network-metrics-daemon/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.337421505Z namespaces/openshift-multus/pods/network-metrics-daemon-psbhw/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.337473358Z namespaces/openshift-multus/pods/network-metrics-daemon-psbhw/network-metrics-daemon-psbhw.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.337565043Z namespaces/openshift-multus/pods/network-metrics-daemon-psbhw/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.337573513Z namespaces/openshift-multus/pods/network-metrics-daemon-psbhw/kube-rbac-proxy/kube-rbac-proxy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.337584184Z namespaces/openshift-multus/pods/network-metrics-daemon-psbhw/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.337645117Z namespaces/openshift-multus/pods/network-metrics-daemon-psbhw/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340583597Z namespaces/openshift-multus/pods/network-metrics-daemon-psbhw/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340609078Z namespaces/openshift-multus/pods/network-metrics-daemon-psbhw/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340615408Z namespaces/openshift-multus/pods/network-metrics-daemon-psbhw/network-metrics-daemon/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340621109Z namespaces/openshift-multus/pods/network-metrics-daemon-psbhw/network-metrics-daemon/network-metrics-daemon/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340626199Z namespaces/openshift-multus/pods/network-metrics-daemon-psbhw/network-metrics-daemon/network-metrics-daemon/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340631489Z namespaces/openshift-multus/pods/network-metrics-daemon-psbhw/network-metrics-daemon/network-metrics-daemon/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.34063708Z namespaces/openshift-multus/pods/network-metrics-daemon-psbhw/network-metrics-daemon/network-metrics-daemon/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.34064221Z namespaces/openshift-multus/pods/network-metrics-daemon-psbhw/network-metrics-daemon/network-metrics-daemon/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.34065323Z namespaces/openshift-multus/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340658451Z namespaces/openshift-multus/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340663601Z namespaces/openshift-multus/rbac.authorization.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340673562Z namespaces/openshift-multus/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340678732Z namespaces/openshift-multus/rbac.authorization.k8s.io/rolebindings/multus-whereabouts.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340684082Z namespaces/openshift-multus/rbac.authorization.k8s.io/rolebindings/prometheus-k8s.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340689142Z namespaces/openshift-multus/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340694113Z namespaces/openshift-multus/rbac.authorization.k8s.io/roles/prometheus-k8s.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340699073Z namespaces/openshift-multus/rbac.authorization.k8s.io/roles/whereabouts-cni.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340703803Z namespaces/openshift-multus/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340708593Z namespaces/openshift-multus/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340714474Z namespaces/openshift-must-gather-kv6x7/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340719484Z namespaces/openshift-must-gather-kv6x7/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340724364Z namespaces/openshift-must-gather-kv6x7/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340729474Z namespaces/openshift-must-gather-kv6x7/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340734455Z namespaces/openshift-must-gather-kv6x7/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340739315Z namespaces/openshift-must-gather-kv6x7/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340744215Z namespaces/openshift-must-gather-kv6x7/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340749156Z namespaces/openshift-must-gather-kv6x7/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340754156Z namespaces/openshift-must-gather-wf794/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340759726Z namespaces/openshift-must-gather-wf794/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340764976Z namespaces/openshift-must-gather-wf794/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340771827Z namespaces/openshift-must-gather-wf794/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.340928095Z namespaces/openshift-must-gather-wf794/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.341129746Z namespaces/openshift-must-gather-wf794/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.341339888Z namespaces/openshift-must-gather-wf794/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.341577011Z namespaces/openshift-must-gather-wf794/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.341788422Z namespaces/openshift-network-console/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.342073527Z namespaces/openshift-network-console/openshift-network-console.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.342108139Z namespaces/openshift-network-console/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.34211489Z namespaces/openshift-network-console/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.34212162Z namespaces/openshift-network-console/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.34212746Z namespaces/openshift-network-console/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.342225356Z namespaces/openshift-network-console/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.342379464Z namespaces/openshift-network-console/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.342532452Z namespaces/openshift-network-console/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.342567444Z namespaces/openshift-network-console/apps/deployments/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.342657119Z namespaces/openshift-network-console/apps/deployments/networking-console-plugin.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.342744444Z namespaces/openshift-network-console/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.342799837Z namespaces/openshift-network-console/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.34286445Z namespaces/openshift-network-console/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.342926624Z namespaces/openshift-network-console/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.343068532Z namespaces/openshift-network-console/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.343095163Z namespaces/openshift-network-console/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.343206309Z namespaces/openshift-network-console/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.343294234Z namespaces/openshift-network-console/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.343353177Z namespaces/openshift-network-console/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.34341078Z namespaces/openshift-network-console/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.343546737Z namespaces/openshift-network-console/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.343654003Z namespaces/openshift-network-console/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.343792101Z namespaces/openshift-network-console/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.343883676Z namespaces/openshift-network-console/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.344053425Z namespaces/openshift-network-console/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.344317569Z namespaces/openshift-network-console/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.344474028Z namespaces/openshift-network-console/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.344531731Z namespaces/openshift-network-console/core/configmaps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.344568633Z namespaces/openshift-network-console/core/configmaps/networking-console-plugin.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.344622646Z namespaces/openshift-network-console/core/services/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.344678909Z namespaces/openshift-network-console/core/services/networking-console-plugin.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.344751073Z namespaces/openshift-network-console/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.344799275Z namespaces/openshift-network-console/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.34487969Z namespaces/openshift-network-console/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.344919992Z namespaces/openshift-network-console/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.345000206Z namespaces/openshift-network-console/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.345047119Z namespaces/openshift-network-console/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.345159845Z namespaces/openshift-network-console/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.345287842Z namespaces/openshift-network-console/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.345381837Z namespaces/openshift-network-console/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.345450161Z namespaces/openshift-network-console/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.345503043Z namespaces/openshift-network-console/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.345574827Z namespaces/openshift-network-console/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.345611319Z namespaces/openshift-network-console/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.34562935Z namespaces/openshift-network-console/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.345732546Z namespaces/openshift-network-console/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.345844292Z namespaces/openshift-network-console/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.346026322Z namespaces/openshift-network-console/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.346204141Z namespaces/openshift-network-console/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.346447435Z namespaces/openshift-network-console/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.347000975Z namespaces/openshift-network-console/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.347021696Z namespaces/openshift-network-console/pods/networking-console-plugin-6bffdf9778-mt2zz/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.347032476Z namespaces/openshift-network-console/pods/networking-console-plugin-6bffdf9778-mt2zz/networking-console-plugin-6bffdf9778-mt2zz.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.347138552Z namespaces/openshift-network-console/pods/networking-console-plugin-6bffdf9778-mt2zz/networking-console-plugin/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.347157843Z namespaces/openshift-network-console/pods/networking-console-plugin-6bffdf9778-mt2zz/networking-console-plugin/networking-console-plugin/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.347201805Z namespaces/openshift-network-console/pods/networking-console-plugin-6bffdf9778-mt2zz/networking-console-plugin/networking-console-plugin/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.347214236Z namespaces/openshift-network-console/pods/networking-console-plugin-6bffdf9778-mt2zz/networking-console-plugin/networking-console-plugin/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.347312862Z namespaces/openshift-network-console/pods/networking-console-plugin-6bffdf9778-mt2zz/networking-console-plugin/networking-console-plugin/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.347378165Z namespaces/openshift-network-console/pods/networking-console-plugin-6bffdf9778-mt2zz/networking-console-plugin/networking-console-plugin/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.347404156Z namespaces/openshift-network-console/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.347456209Z namespaces/openshift-network-console/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.347507522Z namespaces/openshift-network-console/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.347542864Z namespaces/openshift-network-console/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.347596097Z namespaces/openshift-network-diagnostics/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.34765733Z namespaces/openshift-network-diagnostics/openshift-network-diagnostics.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.347714083Z namespaces/openshift-network-diagnostics/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.347753255Z namespaces/openshift-network-diagnostics/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.347816199Z namespaces/openshift-network-diagnostics/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.347848741Z namespaces/openshift-network-diagnostics/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.347957397Z namespaces/openshift-network-diagnostics/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.348050091Z namespaces/openshift-network-diagnostics/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.348150847Z namespaces/openshift-network-diagnostics/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.34821213Z namespaces/openshift-network-diagnostics/apps/daemonsets/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.348272924Z namespaces/openshift-network-diagnostics/apps/daemonsets/network-check-target.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.348337407Z namespaces/openshift-network-diagnostics/apps/deployments/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.34838232Z namespaces/openshift-network-diagnostics/apps/deployments/network-check-source.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.348443493Z namespaces/openshift-network-diagnostics/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.348487465Z namespaces/openshift-network-diagnostics/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.348534948Z namespaces/openshift-network-diagnostics/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.34857675Z namespaces/openshift-network-diagnostics/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.34875857Z namespaces/openshift-network-diagnostics/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.348807833Z namespaces/openshift-network-diagnostics/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.348841274Z namespaces/openshift-network-diagnostics/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.34894135Z namespaces/openshift-network-diagnostics/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.348991702Z namespaces/openshift-network-diagnostics/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.349041595Z namespaces/openshift-network-diagnostics/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.349191273Z namespaces/openshift-network-diagnostics/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.34931244Z namespaces/openshift-network-diagnostics/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.349529362Z namespaces/openshift-network-diagnostics/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.349623757Z namespaces/openshift-network-diagnostics/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.34986397Z namespaces/openshift-network-diagnostics/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.349962735Z namespaces/openshift-network-diagnostics/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.350388818Z namespaces/openshift-network-diagnostics/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.350516295Z namespaces/openshift-network-diagnostics/core/serviceaccounts/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.350544097Z namespaces/openshift-network-diagnostics/core/serviceaccounts/network-diagnostics.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.350642452Z namespaces/openshift-network-diagnostics/core/services/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.350696395Z namespaces/openshift-network-diagnostics/core/services/network-check-source.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.350812321Z namespaces/openshift-network-diagnostics/core/services/network-check-target.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.350871675Z namespaces/openshift-network-diagnostics/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.350913687Z namespaces/openshift-network-diagnostics/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.350996741Z namespaces/openshift-network-diagnostics/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.351056075Z namespaces/openshift-network-diagnostics/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.351111048Z namespaces/openshift-network-diagnostics/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.35115506Z namespaces/openshift-network-diagnostics/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.351297248Z namespaces/openshift-network-diagnostics/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.351418714Z namespaces/openshift-network-diagnostics/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.351470377Z namespaces/openshift-network-diagnostics/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.351540311Z namespaces/openshift-network-diagnostics/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.351606684Z namespaces/openshift-network-diagnostics/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.351671488Z namespaces/openshift-network-diagnostics/monitoring.coreos.com/servicemonitors/network-check-source.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.351747302Z namespaces/openshift-network-diagnostics/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.351784284Z namespaces/openshift-network-diagnostics/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.351856778Z namespaces/openshift-network-diagnostics/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.351867989Z namespaces/openshift-network-diagnostics/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.351919081Z namespaces/openshift-network-diagnostics/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.352089681Z namespaces/openshift-network-diagnostics/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.352335304Z namespaces/openshift-network-diagnostics/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.352503373Z namespaces/openshift-network-diagnostics/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.352763227Z namespaces/openshift-network-diagnostics/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.352963938Z namespaces/openshift-network-diagnostics/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.352977129Z namespaces/openshift-network-diagnostics/pods/network-check-source-989f8b8dc-gv9xz/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.352986069Z namespaces/openshift-network-diagnostics/pods/network-check-source-989f8b8dc-gv9xz/network-check-source-989f8b8dc-gv9xz.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.353090435Z namespaces/openshift-network-diagnostics/pods/network-check-source-989f8b8dc-gv9xz/check-endpoints/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.353102705Z namespaces/openshift-network-diagnostics/pods/network-check-source-989f8b8dc-gv9xz/check-endpoints/check-endpoints/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.353108136Z namespaces/openshift-network-diagnostics/pods/network-check-source-989f8b8dc-gv9xz/check-endpoints/check-endpoints/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.353125217Z namespaces/openshift-network-diagnostics/pods/network-check-source-989f8b8dc-gv9xz/check-endpoints/check-endpoints/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.353334528Z namespaces/openshift-network-diagnostics/pods/network-check-source-989f8b8dc-gv9xz/check-endpoints/check-endpoints/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.353438074Z namespaces/openshift-network-diagnostics/pods/network-check-source-989f8b8dc-gv9xz/check-endpoints/check-endpoints/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.353469445Z namespaces/openshift-network-diagnostics/pods/network-check-target-8m52j/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.353522328Z namespaces/openshift-network-diagnostics/pods/network-check-target-8m52j/network-check-target-8m52j.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.353622064Z namespaces/openshift-network-diagnostics/pods/network-check-target-8m52j/network-check-target-container/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.353640545Z namespaces/openshift-network-diagnostics/pods/network-check-target-8m52j/network-check-target-container/network-check-target-container/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.353647335Z namespaces/openshift-network-diagnostics/pods/network-check-target-8m52j/network-check-target-container/network-check-target-container/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.353660586Z namespaces/openshift-network-diagnostics/pods/network-check-target-8m52j/network-check-target-container/network-check-target-container/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.353828195Z namespaces/openshift-network-diagnostics/pods/network-check-target-8m52j/network-check-target-container/network-check-target-container/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.35391136Z namespaces/openshift-network-diagnostics/pods/network-check-target-8m52j/network-check-target-container/network-check-target-container/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.353934481Z namespaces/openshift-network-diagnostics/pods/network-check-target-fftjw/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.353998504Z namespaces/openshift-network-diagnostics/pods/network-check-target-fftjw/network-check-target-fftjw.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.354086969Z namespaces/openshift-network-diagnostics/pods/network-check-target-fftjw/network-check-target-container/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.35409974Z namespaces/openshift-network-diagnostics/pods/network-check-target-fftjw/network-check-target-container/network-check-target-container/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.35410546Z namespaces/openshift-network-diagnostics/pods/network-check-target-fftjw/network-check-target-container/network-check-target-container/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.354145392Z namespaces/openshift-network-diagnostics/pods/network-check-target-fftjw/network-check-target-container/network-check-target-container/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.354276179Z namespaces/openshift-network-diagnostics/pods/network-check-target-fftjw/network-check-target-container/network-check-target-container/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.354360134Z namespaces/openshift-network-diagnostics/pods/network-check-target-fftjw/network-check-target-container/network-check-target-container/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.354411207Z namespaces/openshift-network-diagnostics/pods/network-check-target-zsdxr/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.354460649Z namespaces/openshift-network-diagnostics/pods/network-check-target-zsdxr/network-check-target-zsdxr.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.354541724Z namespaces/openshift-network-diagnostics/pods/network-check-target-zsdxr/network-check-target-container/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.354553394Z namespaces/openshift-network-diagnostics/pods/network-check-target-zsdxr/network-check-target-container/network-check-target-container/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.354559445Z namespaces/openshift-network-diagnostics/pods/network-check-target-zsdxr/network-check-target-container/network-check-target-container/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.354586126Z namespaces/openshift-network-diagnostics/pods/network-check-target-zsdxr/network-check-target-container/network-check-target-container/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.354703632Z namespaces/openshift-network-diagnostics/pods/network-check-target-zsdxr/network-check-target-container/network-check-target-container/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.354780516Z namespaces/openshift-network-diagnostics/pods/network-check-target-zsdxr/network-check-target-container/network-check-target-container/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.354830619Z namespaces/openshift-network-diagnostics/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.354875052Z namespaces/openshift-network-diagnostics/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.354938855Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.354960466Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.355012439Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/rolebindings/network-diagnostics.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.355126625Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/rolebindings/prometheus-k8s.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.355199529Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.355263893Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/roles/network-diagnostics.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.355359518Z namespaces/openshift-network-diagnostics/rbac.authorization.k8s.io/roles/prometheus-k8s.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.355433752Z namespaces/openshift-network-diagnostics/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.355455033Z namespaces/openshift-network-diagnostics/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.355523427Z namespaces/openshift-network-node-identity/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.35557513Z namespaces/openshift-network-node-identity/openshift-network-node-identity.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.355657934Z namespaces/openshift-network-node-identity/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.355688656Z namespaces/openshift-network-node-identity/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.35577111Z namespaces/openshift-network-node-identity/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.355791001Z namespaces/openshift-network-node-identity/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.355910128Z namespaces/openshift-network-node-identity/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.356413955Z namespaces/openshift-network-node-identity/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.356484049Z namespaces/openshift-network-node-identity/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.356541092Z namespaces/openshift-network-node-identity/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.356583394Z namespaces/openshift-network-node-identity/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.356649168Z namespaces/openshift-network-node-identity/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.356701791Z namespaces/openshift-network-node-identity/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.356802526Z namespaces/openshift-network-node-identity/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.356856579Z namespaces/openshift-network-node-identity/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.356892681Z namespaces/openshift-network-node-identity/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.357007857Z namespaces/openshift-network-node-identity/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.35704609Z namespaces/openshift-network-node-identity/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.35705746Z namespaces/openshift-network-node-identity/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.357337625Z namespaces/openshift-network-node-identity/coordination.k8s.io/leases/ovnkube-identity.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.357361156Z namespaces/openshift-network-node-identity/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.357373787Z namespaces/openshift-network-node-identity/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.357451181Z namespaces/openshift-network-node-identity/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.357465022Z namespaces/openshift-network-node-identity/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.357581128Z namespaces/openshift-network-node-identity/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.357675544Z namespaces/openshift-network-node-identity/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.357769569Z namespaces/openshift-network-node-identity/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.35796904Z namespaces/openshift-network-node-identity/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.358097616Z namespaces/openshift-network-node-identity/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.358151719Z namespaces/openshift-network-node-identity/core/serviceaccounts/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.358223723Z namespaces/openshift-network-node-identity/core/serviceaccounts/network-node-identity.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.358299847Z namespaces/openshift-network-node-identity/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.358338089Z namespaces/openshift-network-node-identity/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.358406663Z namespaces/openshift-network-node-identity/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.358426194Z namespaces/openshift-network-node-identity/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.358515599Z namespaces/openshift-network-node-identity/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.35853403Z namespaces/openshift-network-node-identity/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.358635846Z namespaces/openshift-network-node-identity/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.358743802Z namespaces/openshift-network-node-identity/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.358796714Z namespaces/openshift-network-node-identity/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.358839677Z namespaces/openshift-network-node-identity/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.358891879Z namespaces/openshift-network-node-identity/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.358909451Z namespaces/openshift-network-node-identity/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.358995745Z namespaces/openshift-network-node-identity/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.359008796Z namespaces/openshift-network-node-identity/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.359019357Z namespaces/openshift-network-node-identity/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.359203116Z namespaces/openshift-network-node-identity/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.35945526Z namespaces/openshift-network-node-identity/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.359596488Z namespaces/openshift-network-node-identity/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.360236432Z namespaces/openshift-network-node-identity/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.360267164Z namespaces/openshift-network-node-identity/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.360275425Z namespaces/openshift-network-node-identity/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.360289365Z namespaces/openshift-network-node-identity/rbac.authorization.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.360296006Z namespaces/openshift-network-node-identity/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.360301626Z namespaces/openshift-network-node-identity/rbac.authorization.k8s.io/rolebindings/network-node-identity-leases.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.360307236Z namespaces/openshift-network-node-identity/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.360312756Z namespaces/openshift-network-node-identity/rbac.authorization.k8s.io/roles/network-node-identity-leases.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.360333678Z namespaces/openshift-network-node-identity/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.360346388Z namespaces/openshift-network-node-identity/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.360401261Z namespaces/openshift-network-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.360458164Z namespaces/openshift-network-operator/openshift-network-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.360523418Z namespaces/openshift-network-operator/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.360587462Z namespaces/openshift-network-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.360617113Z namespaces/openshift-network-operator/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.360675376Z namespaces/openshift-network-operator/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.360807054Z namespaces/openshift-network-operator/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.360880137Z namespaces/openshift-network-operator/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.360960692Z namespaces/openshift-network-operator/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.361001484Z namespaces/openshift-network-operator/apps/daemonsets/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.361054967Z namespaces/openshift-network-operator/apps/daemonsets/iptables-alerter.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.36110157Z namespaces/openshift-network-operator/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.361157033Z namespaces/openshift-network-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.361242687Z namespaces/openshift-network-operator/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.361264748Z namespaces/openshift-network-operator/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.361370114Z namespaces/openshift-network-operator/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.361397015Z namespaces/openshift-network-operator/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.361457869Z namespaces/openshift-network-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.361545514Z namespaces/openshift-network-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.361565515Z namespaces/openshift-network-operator/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.361574385Z namespaces/openshift-network-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.361624798Z namespaces/openshift-network-operator/coordination.k8s.io/leases/network-operator-lock.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.361677621Z namespaces/openshift-network-operator/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.361723043Z namespaces/openshift-network-operator/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.36185932Z namespaces/openshift-network-operator/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.361945795Z namespaces/openshift-network-operator/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.362099244Z namespaces/openshift-network-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.362191778Z namespaces/openshift-network-operator/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.36240283Z namespaces/openshift-network-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.362486625Z namespaces/openshift-network-operator/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.362614952Z namespaces/openshift-network-operator/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.362668944Z namespaces/openshift-network-operator/core/configmaps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.362692056Z namespaces/openshift-network-operator/core/configmaps/applied-cluster.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.362799731Z namespaces/openshift-network-operator/core/configmaps/iptables-alerter-script.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.362859295Z namespaces/openshift-network-operator/core/serviceaccounts/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.362877236Z namespaces/openshift-network-operator/core/serviceaccounts/iptables-alerter.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.36295139Z namespaces/openshift-network-operator/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.362972481Z namespaces/openshift-network-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.363041035Z namespaces/openshift-network-operator/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.363060005Z namespaces/openshift-network-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.363115908Z namespaces/openshift-network-operator/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.363189252Z namespaces/openshift-network-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.363280377Z namespaces/openshift-network-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.363364322Z namespaces/openshift-network-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.363406394Z namespaces/openshift-network-operator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.363488039Z namespaces/openshift-network-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.363543302Z namespaces/openshift-network-operator/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.363582934Z namespaces/openshift-network-operator/monitoring.coreos.com/prometheusrules/openshift-network-operator-ipsec-rules.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.363643977Z namespaces/openshift-network-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.363683199Z namespaces/openshift-network-operator/monitoring.coreos.com/servicemonitors/network-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.363740113Z namespaces/openshift-network-operator/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.363770764Z namespaces/openshift-network-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.363816277Z namespaces/openshift-network-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.363823467Z namespaces/openshift-network-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.363858849Z namespaces/openshift-network-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.364006887Z namespaces/openshift-network-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.364454851Z namespaces/openshift-network-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.364593289Z namespaces/openshift-network-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.364812271Z namespaces/openshift-network-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.365014092Z namespaces/openshift-network-operator/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.365032273Z namespaces/openshift-network-operator/pods/iptables-alerter-hbbx2/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.365062604Z namespaces/openshift-network-operator/pods/iptables-alerter-hbbx2/iptables-alerter-hbbx2.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.365144799Z namespaces/openshift-network-operator/pods/iptables-alerter-hbbx2/iptables-alerter/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.365156669Z namespaces/openshift-network-operator/pods/iptables-alerter-hbbx2/iptables-alerter/iptables-alerter/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.36517886Z namespaces/openshift-network-operator/pods/iptables-alerter-hbbx2/iptables-alerter/iptables-alerter/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.365239604Z namespaces/openshift-network-operator/pods/iptables-alerter-hbbx2/iptables-alerter/iptables-alerter/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.3653517Z namespaces/openshift-network-operator/pods/iptables-alerter-hbbx2/iptables-alerter/iptables-alerter/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.365436245Z namespaces/openshift-network-operator/pods/iptables-alerter-hbbx2/iptables-alerter/iptables-alerter/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.365475957Z namespaces/openshift-network-operator/pods/iptables-alerter-p9f7p/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.365512319Z namespaces/openshift-network-operator/pods/iptables-alerter-p9f7p/iptables-alerter-p9f7p.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.365607524Z namespaces/openshift-network-operator/pods/iptables-alerter-p9f7p/iptables-alerter/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.365615394Z namespaces/openshift-network-operator/pods/iptables-alerter-p9f7p/iptables-alerter/iptables-alerter/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.365619455Z namespaces/openshift-network-operator/pods/iptables-alerter-p9f7p/iptables-alerter/iptables-alerter/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.365675778Z namespaces/openshift-network-operator/pods/iptables-alerter-p9f7p/iptables-alerter/iptables-alerter/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.365788404Z namespaces/openshift-network-operator/pods/iptables-alerter-p9f7p/iptables-alerter/iptables-alerter/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.365866078Z namespaces/openshift-network-operator/pods/iptables-alerter-p9f7p/iptables-alerter/iptables-alerter/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.365925671Z namespaces/openshift-network-operator/pods/iptables-alerter-qwddx/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.365974484Z namespaces/openshift-network-operator/pods/iptables-alerter-qwddx/iptables-alerter-qwddx.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.366046167Z namespaces/openshift-network-operator/pods/iptables-alerter-qwddx/iptables-alerter/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.366053148Z namespaces/openshift-network-operator/pods/iptables-alerter-qwddx/iptables-alerter/iptables-alerter/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.366057018Z namespaces/openshift-network-operator/pods/iptables-alerter-qwddx/iptables-alerter/iptables-alerter/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.366107411Z namespaces/openshift-network-operator/pods/iptables-alerter-qwddx/iptables-alerter/iptables-alerter/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.366236218Z namespaces/openshift-network-operator/pods/iptables-alerter-qwddx/iptables-alerter/iptables-alerter/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.366302201Z namespaces/openshift-network-operator/pods/iptables-alerter-qwddx/iptables-alerter/iptables-alerter/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.366357724Z namespaces/openshift-network-operator/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.366392066Z namespaces/openshift-network-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.366440579Z namespaces/openshift-network-operator/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.366514953Z namespaces/openshift-network-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.366575756Z namespaces/openshift-node/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.366590217Z namespaces/openshift-node/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.366596897Z namespaces/openshift-node/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.366633049Z namespaces/openshift-node/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.366875683Z namespaces/openshift-node/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.367083054Z namespaces/openshift-node/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.367283885Z namespaces/openshift-node/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.367520538Z namespaces/openshift-node/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.367889678Z namespaces/openshift-operator-lifecycle-manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.3679412Z namespaces/openshift-operator-lifecycle-manager/openshift-operator-lifecycle-manager.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.368055796Z namespaces/openshift-operator-lifecycle-manager/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.368103149Z namespaces/openshift-operator-lifecycle-manager/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.368201835Z namespaces/openshift-operator-lifecycle-manager/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.368349652Z namespaces/openshift-operator-lifecycle-manager/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.368451618Z namespaces/openshift-operator-lifecycle-manager/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.368577635Z namespaces/openshift-operator-lifecycle-manager/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.368659379Z namespaces/openshift-operator-lifecycle-manager/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.368696471Z namespaces/openshift-operator-lifecycle-manager/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.368802167Z namespaces/openshift-operator-lifecycle-manager/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.368836349Z namespaces/openshift-operator-lifecycle-manager/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.368897092Z namespaces/openshift-operator-lifecycle-manager/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.368997378Z namespaces/openshift-operator-lifecycle-manager/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.369019649Z namespaces/openshift-operator-lifecycle-manager/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.369085332Z namespaces/openshift-operator-lifecycle-manager/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.369210749Z namespaces/openshift-operator-lifecycle-manager/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.369264392Z namespaces/openshift-operator-lifecycle-manager/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.369328376Z namespaces/openshift-operator-lifecycle-manager/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.369446952Z namespaces/openshift-operator-lifecycle-manager/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.369534387Z namespaces/openshift-operator-lifecycle-manager/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.369647603Z namespaces/openshift-operator-lifecycle-manager/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.369727317Z namespaces/openshift-operator-lifecycle-manager/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.369817442Z namespaces/openshift-operator-lifecycle-manager/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.369984811Z namespaces/openshift-operator-lifecycle-manager/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.370228384Z namespaces/openshift-operator-lifecycle-manager/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.370295848Z namespaces/openshift-operator-lifecycle-manager/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.37033713Z namespaces/openshift-operator-lifecycle-manager/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.370410674Z namespaces/openshift-operator-lifecycle-manager/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.370459137Z namespaces/openshift-operator-lifecycle-manager/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.370504719Z namespaces/openshift-operator-lifecycle-manager/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.370560072Z namespaces/openshift-operator-lifecycle-manager/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.370658948Z namespaces/openshift-operator-lifecycle-manager/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.370748242Z namespaces/openshift-operator-lifecycle-manager/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.370796625Z namespaces/openshift-operator-lifecycle-manager/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.370853978Z namespaces/openshift-operator-lifecycle-manager/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.370899011Z namespaces/openshift-operator-lifecycle-manager/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.371049209Z namespaces/openshift-operator-lifecycle-manager/monitoring.coreos.com/prometheusrules/olm-alert-rules.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.371112602Z namespaces/openshift-operator-lifecycle-manager/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.371202207Z namespaces/openshift-operator-lifecycle-manager/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.371275961Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.371289212Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.371302412Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.371755177Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.371953708Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.372108186Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.37236937Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.372561541Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.372584302Z namespaces/openshift-operator-lifecycle-manager/operators.coreos.com/operatorgroups/olm-operators.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.372664457Z namespaces/openshift-operator-lifecycle-manager/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.372710799Z namespaces/openshift-operator-lifecycle-manager/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.372777613Z namespaces/openshift-operator-lifecycle-manager/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.372821105Z namespaces/openshift-operator-lifecycle-manager/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.372887418Z namespaces/openshift-operators/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.372899139Z namespaces/openshift-operators/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.372904919Z namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.37291311Z namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.3731047Z namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.373321912Z namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.373488891Z namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.373725524Z namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.373935455Z namespaces/openshift-operators/operators.coreos.com/operatorgroups/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.373972997Z namespaces/openshift-operators/operators.coreos.com/operatorgroups/global-operators.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.374051002Z namespaces/openshift-ovn-kubernetes/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.374101434Z namespaces/openshift-ovn-kubernetes/openshift-ovn-kubernetes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.37420613Z namespaces/openshift-ovn-kubernetes/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.374261433Z namespaces/openshift-ovn-kubernetes/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.374300395Z namespaces/openshift-ovn-kubernetes/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.374347378Z namespaces/openshift-ovn-kubernetes/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.374545719Z namespaces/openshift-ovn-kubernetes/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.374621343Z namespaces/openshift-ovn-kubernetes/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.374702917Z namespaces/openshift-ovn-kubernetes/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.37475465Z namespaces/openshift-ovn-kubernetes/apps/daemonsets/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.374788382Z namespaces/openshift-ovn-kubernetes/apps/daemonsets/ovnkube-node.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.374965521Z namespaces/openshift-ovn-kubernetes/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.374983202Z namespaces/openshift-ovn-kubernetes/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.375040835Z namespaces/openshift-ovn-kubernetes/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.375099989Z namespaces/openshift-ovn-kubernetes/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.375204284Z namespaces/openshift-ovn-kubernetes/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.375265778Z namespaces/openshift-ovn-kubernetes/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.37530573Z namespaces/openshift-ovn-kubernetes/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.375393414Z namespaces/openshift-ovn-kubernetes/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.375438647Z namespaces/openshift-ovn-kubernetes/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.375452558Z namespaces/openshift-ovn-kubernetes/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.375477889Z namespaces/openshift-ovn-kubernetes/coordination.k8s.io/leases/ovn-kubernetes-master.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.375533602Z namespaces/openshift-ovn-kubernetes/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.375577244Z namespaces/openshift-ovn-kubernetes/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.375843359Z namespaces/openshift-ovn-kubernetes/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.375946264Z namespaces/openshift-ovn-kubernetes/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.376640952Z namespaces/openshift-ovn-kubernetes/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.376756679Z namespaces/openshift-ovn-kubernetes/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.377248435Z namespaces/openshift-ovn-kubernetes/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.377354741Z namespaces/openshift-ovn-kubernetes/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.37751925Z namespaces/openshift-ovn-kubernetes/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.377594974Z namespaces/openshift-ovn-kubernetes/core/configmaps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.377614975Z namespaces/openshift-ovn-kubernetes/core/configmaps/ovnkube-config.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.377719971Z namespaces/openshift-ovn-kubernetes/core/configmaps/ovnkube-script-lib.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.377882169Z namespaces/openshift-ovn-kubernetes/core/serviceaccounts/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.37790347Z namespaces/openshift-ovn-kubernetes/core/serviceaccounts/ovn-kubernetes-control-plane.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.377997716Z namespaces/openshift-ovn-kubernetes/core/serviceaccounts/ovn-kubernetes-node.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.378053909Z namespaces/openshift-ovn-kubernetes/core/services/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.378087271Z namespaces/openshift-ovn-kubernetes/core/services/ovn-kubernetes-node.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.378148864Z namespaces/openshift-ovn-kubernetes/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.378231448Z namespaces/openshift-ovn-kubernetes/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.378309943Z namespaces/openshift-ovn-kubernetes/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.378371486Z namespaces/openshift-ovn-kubernetes/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.37845248Z namespaces/openshift-ovn-kubernetes/k8s.cni.cncf.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.378466311Z namespaces/openshift-ovn-kubernetes/k8s.cni.cncf.io/network-attachment-definitions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.378485292Z namespaces/openshift-ovn-kubernetes/k8s.cni.cncf.io/network-attachment-definitions/default.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.378553366Z namespaces/openshift-ovn-kubernetes/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.378614579Z namespaces/openshift-ovn-kubernetes/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.378743616Z namespaces/openshift-ovn-kubernetes/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.378831241Z namespaces/openshift-ovn-kubernetes/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.378911535Z namespaces/openshift-ovn-kubernetes/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.379021241Z namespaces/openshift-ovn-kubernetes/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.379035712Z namespaces/openshift-ovn-kubernetes/monitoring.coreos.com/prometheusrules/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.379046453Z namespaces/openshift-ovn-kubernetes/monitoring.coreos.com/prometheusrules/networking-rules.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.379140258Z namespaces/openshift-ovn-kubernetes/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.379197091Z namespaces/openshift-ovn-kubernetes/monitoring.coreos.com/servicemonitors/monitor-ovn-node.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.379267545Z namespaces/openshift-ovn-kubernetes/network.operator.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.379282065Z namespaces/openshift-ovn-kubernetes/network.operator.openshift.io/operatorpkis/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.379295526Z namespaces/openshift-ovn-kubernetes/network.operator.openshift.io/operatorpkis/ovn.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.379394362Z namespaces/openshift-ovn-kubernetes/network.operator.openshift.io/operatorpkis/signer.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.379439384Z namespaces/openshift-ovn-kubernetes/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.379472656Z namespaces/openshift-ovn-kubernetes/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.379525649Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.379533979Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.379583052Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.37974071Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.37992922Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.380119641Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.380383345Z namespaces/openshift-ovn-kubernetes/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.380567925Z namespaces/openshift-ovn-kubernetes/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.380581306Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.380627928Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ovnkube-node-gb8xd.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.380993468Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/kube-rbac-proxy-node/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.381006219Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/kube-rbac-proxy-node/kube-rbac-proxy-node/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.381012149Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.381041541Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.381188479Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.381283564Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.381334917Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/kube-rbac-proxy-ovn-metrics/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.381342907Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.381348837Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.381377449Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.381518997Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.38158773Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.381601961Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/nbdb/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.381611152Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/nbdb/nbdb/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.381616812Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/nbdb/nbdb/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.381676945Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/nbdb/nbdb/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.381807972Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/nbdb/nbdb/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.381884266Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/nbdb/nbdb/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.38194531Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/northd/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.381962261Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/northd/northd/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.381969591Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/northd/northd/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.382011413Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/northd/northd/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.382156341Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/northd/northd/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.382274348Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/northd/northd/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.382327631Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ovn-acl-logging/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.382341201Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ovn-acl-logging/ovn-acl-logging/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.382417006Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ovn-acl-logging/ovn-acl-logging/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.382430836Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ovn-acl-logging/ovn-acl-logging/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.382527952Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ovn-acl-logging/ovn-acl-logging/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.38268034Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ovn-acl-logging/ovn-acl-logging/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.382765854Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ovn-controller/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.382777485Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ovn-controller/ovn-controller/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.382783855Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ovn-controller/ovn-controller/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.382828388Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ovn-controller/ovn-controller/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.383316774Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ovn-controller/ovn-controller/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.383387678Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ovn-controller/ovn-controller/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.383404979Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ovnkube-controller/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.38342157Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ovnkube-controller/ovnkube-controller/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.38342609Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ovnkube-controller/ovnkube-controller/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.383464442Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ovnkube-controller/ovnkube-controller/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.385648401Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ovnkube-controller/ovnkube-controller/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.385720434Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/ovnkube-controller/ovnkube-controller/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.385758397Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/sbdb/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.385770577Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/sbdb/sbdb/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.385776488Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/sbdb/sbdb/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.385807339Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/sbdb/sbdb/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.385909075Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/sbdb/sbdb/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.385986499Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-gb8xd/sbdb/sbdb/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.38600399Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.386094825Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ovnkube-node-jxfhc.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.386277215Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/kube-rbac-proxy-node/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.386293116Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/kube-rbac-proxy-node/kube-rbac-proxy-node/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.386304126Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.386313977Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.386443244Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.38654927Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.386573641Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/kube-rbac-proxy-ovn-metrics/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.386586261Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.386592422Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.386625124Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.386778522Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.386849376Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.386898869Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/nbdb/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.386913929Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/nbdb/nbdb/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.38692515Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/nbdb/nbdb/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.386967432Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/nbdb/nbdb/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.387119161Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/nbdb/nbdb/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.387206595Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/nbdb/nbdb/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.387335352Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/northd/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.387348343Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/northd/northd/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.387354743Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/northd/northd/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.387397505Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/northd/northd/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.387527732Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/northd/northd/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.387591356Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/northd/northd/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.387631858Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ovn-acl-logging/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.387642109Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ovn-acl-logging/ovn-acl-logging/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.387648419Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ovn-acl-logging/ovn-acl-logging/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.387681951Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ovn-acl-logging/ovn-acl-logging/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.387784557Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ovn-acl-logging/ovn-acl-logging/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.38785123Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ovn-acl-logging/ovn-acl-logging/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.387890562Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ovn-controller/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.387899573Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ovn-controller/ovn-controller/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.387905303Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ovn-controller/ovn-controller/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.387932854Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ovn-controller/ovn-controller/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.388200869Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ovn-controller/ovn-controller/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.388271643Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ovn-controller/ovn-controller/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.388326376Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ovnkube-controller/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.388342757Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ovnkube-controller/ovnkube-controller/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.388349717Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ovnkube-controller/ovnkube-controller/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.388389789Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ovnkube-controller/ovnkube-controller/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.389906212Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ovnkube-controller/ovnkube-controller/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.389986066Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/ovnkube-controller/ovnkube-controller/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.390021648Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/sbdb/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.390033808Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/sbdb/sbdb/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.390041269Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/sbdb/sbdb/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.390048419Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/sbdb/sbdb/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.390154065Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/sbdb/sbdb/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.390276042Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-jxfhc/sbdb/sbdb/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.390304163Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.390400868Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ovnkube-node-rqpfq.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.390564667Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/kube-rbac-proxy-node/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.390578058Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/kube-rbac-proxy-node/kube-rbac-proxy-node/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.390584168Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.39061763Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.390781319Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.390882514Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/kube-rbac-proxy-node/kube-rbac-proxy-node/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.390923077Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/kube-rbac-proxy-ovn-metrics/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.390930827Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.390936457Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.390995581Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.391131708Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.391251414Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/kube-rbac-proxy-ovn-metrics/kube-rbac-proxy-ovn-metrics/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.391301317Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/nbdb/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.391314928Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/nbdb/nbdb/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.391321118Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/nbdb/nbdb/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.391366901Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/nbdb/nbdb/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.391476517Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/nbdb/nbdb/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.391555731Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/nbdb/nbdb/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.391616034Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/northd/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.391629045Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/northd/northd/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.391635265Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/northd/northd/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.391663697Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/northd/northd/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.391818575Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/northd/northd/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.39190776Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/northd/northd/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.391931941Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ovn-acl-logging/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.391944182Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ovn-acl-logging/ovn-acl-logging/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.391951783Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ovn-acl-logging/ovn-acl-logging/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.392018316Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ovn-acl-logging/ovn-acl-logging/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.392117052Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ovn-acl-logging/ovn-acl-logging/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.392235938Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ovn-acl-logging/ovn-acl-logging/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.39227499Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ovn-controller/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.39228369Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ovn-controller/ovn-controller/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.392287831Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ovn-controller/ovn-controller/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.392342494Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ovn-controller/ovn-controller/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.392663121Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ovn-controller/ovn-controller/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.392729615Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ovn-controller/ovn-controller/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.392768847Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ovnkube-controller/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.392776417Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ovnkube-controller/ovnkube-controller/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.392781708Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ovnkube-controller/ovnkube-controller/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.39282639Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ovnkube-controller/ovnkube-controller/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.394985927Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ovnkube-controller/ovnkube-controller/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.395067692Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/ovnkube-controller/ovnkube-controller/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.395122535Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/sbdb/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.395133575Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/sbdb/sbdb/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.395139535Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/sbdb/sbdb/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.395237571Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/sbdb/sbdb/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.395355777Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/sbdb/sbdb/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.395434661Z namespaces/openshift-ovn-kubernetes/pods/ovnkube-node-rqpfq/sbdb/sbdb/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.395470093Z namespaces/openshift-ovn-kubernetes/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.395535127Z namespaces/openshift-ovn-kubernetes/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.39559247Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.39559987Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/rolebindings/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.395657384Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/rolebindings/openshift-ovn-kubernetes-control-plane-limited.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.39576879Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/rolebindings/openshift-ovn-kubernetes-nodes-identity-limited.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.395918487Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/rolebindings/prometheus-k8s.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.395978941Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/roles/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.396048525Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/roles/openshift-ovn-kubernetes-control-plane-limited.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.396159401Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/roles/openshift-ovn-kubernetes-node-limited.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.396281727Z namespaces/openshift-ovn-kubernetes/rbac.authorization.k8s.io/roles/prometheus-k8s.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.396348301Z namespaces/openshift-ovn-kubernetes/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.396395844Z namespaces/openshift-ovn-kubernetes/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.396463917Z namespaces/openshift-route-controller-manager/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.396471468Z namespaces/openshift-route-controller-manager/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.396475688Z namespaces/openshift-route-controller-manager/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.39651613Z namespaces/openshift-route-controller-manager/coordination.k8s.io/leases/openshift-route-controllers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.396585894Z namespaces/openshift-route-controller-manager/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.396593134Z namespaces/openshift-route-controller-manager/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.396650607Z namespaces/openshift-route-controller-manager/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.396862199Z namespaces/openshift-route-controller-manager/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.39707491Z namespaces/openshift-route-controller-manager/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.397282812Z namespaces/openshift-route-controller-manager/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.397757677Z namespaces/openshift-route-controller-manager/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.397973019Z namespaces/openshift-service-ca-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.398024982Z namespaces/openshift-service-ca-operator/openshift-service-ca-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.398103426Z namespaces/openshift-service-ca-operator/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.398145479Z namespaces/openshift-service-ca-operator/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.398244704Z namespaces/openshift-service-ca-operator/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.398282626Z namespaces/openshift-service-ca-operator/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.398404253Z namespaces/openshift-service-ca-operator/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.398528069Z namespaces/openshift-service-ca-operator/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.398655006Z namespaces/openshift-service-ca-operator/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.398695828Z namespaces/openshift-service-ca-operator/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.398771272Z namespaces/openshift-service-ca-operator/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.398828836Z namespaces/openshift-service-ca-operator/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.398887819Z namespaces/openshift-service-ca-operator/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.398993464Z namespaces/openshift-service-ca-operator/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.399048097Z namespaces/openshift-service-ca-operator/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.399119081Z namespaces/openshift-service-ca-operator/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.399248628Z namespaces/openshift-service-ca-operator/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.399322372Z namespaces/openshift-service-ca-operator/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.399333833Z namespaces/openshift-service-ca-operator/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.399376105Z namespaces/openshift-service-ca-operator/coordination.k8s.io/leases/service-ca-operator-lock.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.399439598Z namespaces/openshift-service-ca-operator/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.399487301Z namespaces/openshift-service-ca-operator/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.399614578Z namespaces/openshift-service-ca-operator/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.399715673Z namespaces/openshift-service-ca-operator/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.399921155Z namespaces/openshift-service-ca-operator/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.40001798Z namespaces/openshift-service-ca-operator/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.400145617Z namespaces/openshift-service-ca-operator/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.400325807Z namespaces/openshift-service-ca-operator/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.400527468Z namespaces/openshift-service-ca-operator/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.400621873Z namespaces/openshift-service-ca-operator/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.400686706Z namespaces/openshift-service-ca-operator/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.40075675Z namespaces/openshift-service-ca-operator/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.400910789Z namespaces/openshift-service-ca-operator/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.400965701Z namespaces/openshift-service-ca-operator/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.401025015Z namespaces/openshift-service-ca-operator/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.4011216Z namespaces/openshift-service-ca-operator/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.401253047Z namespaces/openshift-service-ca-operator/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.40131011Z namespaces/openshift-service-ca-operator/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.401369243Z namespaces/openshift-service-ca-operator/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.401449698Z namespaces/openshift-service-ca-operator/monitoring.coreos.com/servicemonitors/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.40149191Z namespaces/openshift-service-ca-operator/monitoring.coreos.com/servicemonitors/service-ca-operator.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.401562584Z namespaces/openshift-service-ca-operator/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.401609076Z namespaces/openshift-service-ca-operator/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.4016716Z namespaces/openshift-service-ca-operator/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.40167884Z namespaces/openshift-service-ca-operator/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.401728633Z namespaces/openshift-service-ca-operator/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.401904122Z namespaces/openshift-service-ca-operator/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.402095233Z namespaces/openshift-service-ca-operator/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.402279523Z namespaces/openshift-service-ca-operator/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.402536557Z namespaces/openshift-service-ca-operator/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.402729897Z namespaces/openshift-service-ca-operator/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.402742348Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-5d46d9ffd4-65gf9/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.40278514Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-5d46d9ffd4-65gf9/service-ca-operator-5d46d9ffd4-65gf9.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.402892166Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-5d46d9ffd4-65gf9/service-ca-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.402903657Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-5d46d9ffd4-65gf9/service-ca-operator/service-ca-operator/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.402909947Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-5d46d9ffd4-65gf9/service-ca-operator/service-ca-operator/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.402950319Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-5d46d9ffd4-65gf9/service-ca-operator/service-ca-operator/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.40315595Z namespaces/openshift-service-ca-operator/pods/service-ca-operator-5d46d9ffd4-65gf9/service-ca-operator/service-ca-operator/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.403375352Z namespaces/openshift-service-ca-operator/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.403412504Z namespaces/openshift-service-ca-operator/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.403467907Z namespaces/openshift-service-ca-operator/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.40351197Z namespaces/openshift-service-ca-operator/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.403563612Z namespaces/openshift-service-ca/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.403597574Z namespaces/openshift-service-ca/openshift-service-ca.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.403671158Z namespaces/openshift-service-ca/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.403714961Z namespaces/openshift-service-ca/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.403777454Z namespaces/openshift-service-ca/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.403828827Z namespaces/openshift-service-ca/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.403941853Z namespaces/openshift-service-ca/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.404056769Z namespaces/openshift-service-ca/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.404187746Z namespaces/openshift-service-ca/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.404498183Z namespaces/openshift-service-ca/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.404517454Z namespaces/openshift-service-ca/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.404591908Z namespaces/openshift-service-ca/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.404639781Z namespaces/openshift-service-ca/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.404738196Z namespaces/openshift-service-ca/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.40480545Z namespaces/openshift-service-ca/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.404859892Z namespaces/openshift-service-ca/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.404969949Z namespaces/openshift-service-ca/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.405025621Z namespaces/openshift-service-ca/coordination.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.405036872Z namespaces/openshift-service-ca/coordination.k8s.io/leases/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.405093475Z namespaces/openshift-service-ca/coordination.k8s.io/leases/service-ca-controller-lock.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.405150078Z namespaces/openshift-service-ca/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.405226423Z namespaces/openshift-service-ca/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.40536532Z namespaces/openshift-service-ca/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.405453475Z namespaces/openshift-service-ca/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.405583072Z namespaces/openshift-service-ca/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.405693518Z namespaces/openshift-service-ca/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.405816054Z namespaces/openshift-service-ca/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.405964592Z namespaces/openshift-service-ca/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.406152253Z namespaces/openshift-service-ca/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.406217046Z namespaces/openshift-service-ca/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.40629466Z namespaces/openshift-service-ca/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.406351173Z namespaces/openshift-service-ca/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.406390715Z namespaces/openshift-service-ca/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.40646401Z namespaces/openshift-service-ca/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.406512532Z namespaces/openshift-service-ca/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.406617028Z namespaces/openshift-service-ca/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.406719813Z namespaces/openshift-service-ca/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.406760106Z namespaces/openshift-service-ca/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.406829979Z namespaces/openshift-service-ca/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.406868361Z namespaces/openshift-service-ca/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.406929495Z namespaces/openshift-service-ca/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.406982848Z namespaces/openshift-service-ca/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.406992758Z namespaces/openshift-service-ca/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.407064502Z namespaces/openshift-service-ca/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.407259013Z namespaces/openshift-service-ca/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.407452383Z namespaces/openshift-service-ca/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.407598231Z namespaces/openshift-service-ca/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.407829294Z namespaces/openshift-service-ca/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.408018014Z namespaces/openshift-service-ca/pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.408029984Z namespaces/openshift-service-ca/pods/service-ca-758f599c5-f4js8/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.408052566Z namespaces/openshift-service-ca/pods/service-ca-758f599c5-f4js8/service-ca-758f599c5-f4js8.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.408185713Z namespaces/openshift-service-ca/pods/service-ca-758f599c5-f4js8/service-ca-controller/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.408202284Z namespaces/openshift-service-ca/pods/service-ca-758f599c5-f4js8/service-ca-controller/service-ca-controller/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.408209114Z namespaces/openshift-service-ca/pods/service-ca-758f599c5-f4js8/service-ca-controller/service-ca-controller/logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.408219755Z namespaces/openshift-service-ca/pods/service-ca-758f599c5-f4js8/service-ca-controller/service-ca-controller/logs/current.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.40850535Z namespaces/openshift-service-ca/pods/service-ca-758f599c5-f4js8/service-ca-controller/service-ca-controller/logs/previous.insecure.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.408590445Z namespaces/openshift-service-ca/pods/service-ca-758f599c5-f4js8/service-ca-controller/service-ca-controller/logs/previous.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.408636027Z namespaces/openshift-service-ca/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.408701001Z namespaces/openshift-service-ca/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.408763374Z namespaces/openshift-service-ca/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.408808327Z namespaces/openshift-service-ca/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.40887386Z namespaces/openshift-user-workload-monitoring/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.408930613Z namespaces/openshift-user-workload-monitoring/openshift-user-workload-monitoring.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.409007128Z namespaces/openshift-user-workload-monitoring/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.409100582Z namespaces/openshift-user-workload-monitoring/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.409202468Z namespaces/openshift-user-workload-monitoring/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.409247861Z namespaces/openshift-user-workload-monitoring/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.409321254Z namespaces/openshift-user-workload-monitoring/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.40941655Z namespaces/openshift-user-workload-monitoring/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.409530136Z namespaces/openshift-user-workload-monitoring/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.409595909Z namespaces/openshift-user-workload-monitoring/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.409662923Z namespaces/openshift-user-workload-monitoring/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.409710796Z namespaces/openshift-user-workload-monitoring/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.409776149Z namespaces/openshift-user-workload-monitoring/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.409871654Z namespaces/openshift-user-workload-monitoring/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.409927027Z namespaces/openshift-user-workload-monitoring/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.409998491Z namespaces/openshift-user-workload-monitoring/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.410104567Z namespaces/openshift-user-workload-monitoring/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.410147159Z namespaces/openshift-user-workload-monitoring/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.410249375Z namespaces/openshift-user-workload-monitoring/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.410367301Z namespaces/openshift-user-workload-monitoring/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.410471127Z namespaces/openshift-user-workload-monitoring/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.410594883Z namespaces/openshift-user-workload-monitoring/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.410695879Z namespaces/openshift-user-workload-monitoring/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.410795365Z namespaces/openshift-user-workload-monitoring/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.410919241Z namespaces/openshift-user-workload-monitoring/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.41107946Z namespaces/openshift-user-workload-monitoring/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.411127012Z namespaces/openshift-user-workload-monitoring/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.411281511Z namespaces/openshift-user-workload-monitoring/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.411324193Z namespaces/openshift-user-workload-monitoring/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.411372466Z namespaces/openshift-user-workload-monitoring/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.411428399Z namespaces/openshift-user-workload-monitoring/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.411469501Z namespaces/openshift-user-workload-monitoring/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.411562736Z namespaces/openshift-user-workload-monitoring/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.4116325Z namespaces/openshift-user-workload-monitoring/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.411680253Z namespaces/openshift-user-workload-monitoring/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.411727255Z namespaces/openshift-user-workload-monitoring/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.411774888Z namespaces/openshift-user-workload-monitoring/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.411808Z namespaces/openshift-user-workload-monitoring/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.411859502Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.411869393Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.411899044Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.412048942Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.412250393Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.412646455Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.412859746Z namespaces/openshift-user-workload-monitoring/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.413027506Z namespaces/openshift-user-workload-monitoring/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.413042986Z namespaces/openshift-user-workload-monitoring/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.41310265Z namespaces/openshift-user-workload-monitoring/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.413144402Z namespaces/openshift-user-workload-monitoring/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.413223496Z namespaces/openshift/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.413259778Z namespaces/openshift/openshift.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.413330712Z namespaces/openshift/apps.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.413378874Z namespaces/openshift/apps.openshift.io/deploymentconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.413452969Z namespaces/openshift/apps/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.413496311Z namespaces/openshift/apps/daemonsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.413577285Z namespaces/openshift/apps/deployments.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.413706222Z namespaces/openshift/apps/replicasets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.413779736Z namespaces/openshift/apps/statefulsets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.413829849Z namespaces/openshift/autoscaling/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.413874301Z namespaces/openshift/autoscaling/horizontalpodautoscalers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.413918794Z namespaces/openshift/batch/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.413960166Z namespaces/openshift/batch/cronjobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.41403254Z namespaces/openshift/batch/jobs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.414085313Z namespaces/openshift/build.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.414125395Z namespaces/openshift/build.openshift.io/buildconfigs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.414255232Z namespaces/openshift/build.openshift.io/builds.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.414296684Z namespaces/openshift/core/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.414348057Z namespaces/openshift/core/configmaps.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.414442952Z namespaces/openshift/core/endpoints.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.414524037Z namespaces/openshift/core/events.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.414601191Z namespaces/openshift/core/persistentvolumeclaims.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.414687036Z namespaces/openshift/core/pods.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.41476475Z namespaces/openshift/core/replicationcontrollers.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.414888236Z namespaces/openshift/core/secrets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.415063476Z namespaces/openshift/core/services.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.415101048Z namespaces/openshift/discovery.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.415158031Z namespaces/openshift/discovery.k8s.io/endpointslices.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.415236475Z namespaces/openshift/image.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.415289608Z namespaces/openshift/image.openshift.io/imagestreams.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.416772969Z namespaces/openshift/image.openshift.io/imagestreams/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.41679777Z namespaces/openshift/image.openshift.io/imagestreams/cli-artifacts.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.416916877Z namespaces/openshift/image.openshift.io/imagestreams/cli.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.417094876Z namespaces/openshift/image.openshift.io/imagestreams/dotnet-runtime.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.417243744Z namespaces/openshift/image.openshift.io/imagestreams/dotnet.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.41736167Z namespaces/openshift/image.openshift.io/imagestreams/driver-toolkit.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.417439765Z namespaces/openshift/image.openshift.io/imagestreams/fuse7-eap-openshift-java11.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.417611404Z namespaces/openshift/image.openshift.io/imagestreams/fuse7-eap-openshift.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.417769623Z namespaces/openshift/image.openshift.io/imagestreams/fuse7-java-openshift.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.41790484Z namespaces/openshift/image.openshift.io/imagestreams/fuse7-java11-openshift.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.418021946Z namespaces/openshift/image.openshift.io/imagestreams/fuse7-karaf-openshift-jdk11.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.418190816Z namespaces/openshift/image.openshift.io/imagestreams/fuse7-karaf-openshift.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.418349944Z namespaces/openshift/image.openshift.io/imagestreams/golang.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.418504643Z namespaces/openshift/image.openshift.io/imagestreams/httpd.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.418625409Z namespaces/openshift/image.openshift.io/imagestreams/installer-artifacts.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.418751466Z namespaces/openshift/image.openshift.io/imagestreams/installer.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.418861862Z namespaces/openshift/image.openshift.io/imagestreams/java-runtime.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.418970638Z namespaces/openshift/image.openshift.io/imagestreams/java.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.419105385Z namespaces/openshift/image.openshift.io/imagestreams/jboss-datagrid73-openshift.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.419352698Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap-xp3-openjdk11-openshift.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.419470285Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap-xp3-openjdk11-runtime-openshift.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.419583091Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap-xp4-openjdk11-openshift.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.419719729Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap-xp4-openjdk11-runtime-openshift.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.419822474Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap74-openjdk11-openshift.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.420008854Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap74-openjdk11-runtime-openshift.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.420048836Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap74-openjdk8-openshift.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.420185014Z namespaces/openshift/image.openshift.io/imagestreams/jboss-eap74-openjdk8-runtime-openshift.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.420323961Z namespaces/openshift/image.openshift.io/imagestreams/jboss-webserver57-openjdk11-tomcat9-openshift-ubi8.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.420448958Z namespaces/openshift/image.openshift.io/imagestreams/jboss-webserver57-openjdk8-tomcat9-openshift-ubi8.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.420585355Z namespaces/openshift/image.openshift.io/imagestreams/jenkins-agent-base.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.420931954Z namespaces/openshift/image.openshift.io/imagestreams/jenkins.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.420946485Z namespaces/openshift/image.openshift.io/imagestreams/mariadb.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.420984547Z namespaces/openshift/image.openshift.io/imagestreams/must-gather.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.421079512Z namespaces/openshift/image.openshift.io/imagestreams/mysql.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.4212344Z namespaces/openshift/image.openshift.io/imagestreams/network-tools.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.421362767Z namespaces/openshift/image.openshift.io/imagestreams/nginx.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.421497615Z namespaces/openshift/image.openshift.io/imagestreams/nodejs.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.421664434Z namespaces/openshift/image.openshift.io/imagestreams/oauth-proxy.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.42176866Z namespaces/openshift/image.openshift.io/imagestreams/openjdk-11-rhel7.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.421902927Z namespaces/openshift/image.openshift.io/imagestreams/perl.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.422052395Z namespaces/openshift/image.openshift.io/imagestreams/php.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.422221834Z namespaces/openshift/image.openshift.io/imagestreams/postgresql.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.422370472Z namespaces/openshift/image.openshift.io/imagestreams/postgresql13-for-sso75-openshift-rhel8.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.422462897Z namespaces/openshift/image.openshift.io/imagestreams/postgresql13-for-sso76-openshift-rhel8.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.422556212Z namespaces/openshift/image.openshift.io/imagestreams/python.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.422679989Z namespaces/openshift/image.openshift.io/imagestreams/redhat-openjdk18-openshift.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.422811676Z namespaces/openshift/image.openshift.io/imagestreams/redis.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.422918262Z namespaces/openshift/image.openshift.io/imagestreams/ruby.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.423029028Z namespaces/openshift/image.openshift.io/imagestreams/sso75-openshift-rhel8.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.423136084Z namespaces/openshift/image.openshift.io/imagestreams/sso76-openshift-rhel8.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.423319244Z namespaces/openshift/image.openshift.io/imagestreams/tests.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.423412149Z namespaces/openshift/image.openshift.io/imagestreams/tools.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.423536556Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-11-runtime.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.423655892Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-11.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.423777589Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-17-runtime.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.423889455Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-17.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.424019992Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-21-runtime.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.424100196Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-21.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.424223713Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-8-runtime.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.42435329Z namespaces/openshift/image.openshift.io/imagestreams/ubi8-openjdk-8.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.424428164Z namespaces/openshift/k8s.ovn.org/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.424491077Z namespaces/openshift/k8s.ovn.org/egressfirewalls.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.424573642Z namespaces/openshift/k8s.ovn.org/egressqoses.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.424677137Z namespaces/openshift/k8s.ovn.org/userdefinednetworks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.424697268Z namespaces/openshift/monitoring.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.424763172Z namespaces/openshift/monitoring.coreos.com/servicemonitors.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.424811495Z namespaces/openshift/networking.k8s.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.424885439Z namespaces/openshift/networking.k8s.io/networkpolicies.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.424948982Z namespaces/openshift/operators.coreos.com/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.424961303Z namespaces/openshift/operators.coreos.com/clusterserviceversions/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.425005645Z namespaces/openshift/operators.coreos.com/clusterserviceversions/authorino-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.425221137Z namespaces/openshift/operators.coreos.com/clusterserviceversions/cert-manager-operator.v1.20.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.425446389Z namespaces/openshift/operators.coreos.com/clusterserviceversions/dns-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.425593597Z namespaces/openshift/operators.coreos.com/clusterserviceversions/limitador-operator.v1.4.0.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.42582418Z namespaces/openshift/operators.coreos.com/clusterserviceversions/rhcl-operator.v1.4.1.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.42601252Z namespaces/openshift/policy/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.426059142Z namespaces/openshift/policy/poddisruptionbudgets.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.426124616Z namespaces/openshift/route.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.426188869Z namespaces/openshift/route.openshift.io/routes.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.426258063Z namespaces/openshift/template.openshift.io/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.426267874Z namespaces/openshift/template.openshift.io/templates/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.426317776Z namespaces/openshift/template.openshift.io/templates/cache-service.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.426453374Z namespaces/openshift/template.openshift.io/templates/cakephp-mysql-example.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.426589161Z namespaces/openshift/template.openshift.io/templates/cakephp-mysql-persistent.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.426713068Z namespaces/openshift/template.openshift.io/templates/dancer-mysql-example.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.426836684Z namespaces/openshift/template.openshift.io/templates/dancer-mysql-persistent.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.427038135Z namespaces/openshift/template.openshift.io/templates/datagrid-service.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.427181193Z namespaces/openshift/template.openshift.io/templates/django-psql-example.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.427339022Z namespaces/openshift/template.openshift.io/templates/django-psql-persistent.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.427471629Z namespaces/openshift/template.openshift.io/templates/eap-xp3-basic-s2i.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.427623807Z namespaces/openshift/template.openshift.io/templates/eap-xp4-basic-s2i.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.427741624Z namespaces/openshift/template.openshift.io/templates/eap74-basic-s2i.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.427878731Z namespaces/openshift/template.openshift.io/templates/eap74-https-s2i.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.428017879Z namespaces/openshift/template.openshift.io/templates/eap74-sso-s2i.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.428179987Z namespaces/openshift/template.openshift.io/templates/httpd-example.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.428325695Z namespaces/openshift/template.openshift.io/templates/jenkins-ephemeral-monitored.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.428471233Z namespaces/openshift/template.openshift.io/templates/jenkins-ephemeral.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.428587389Z namespaces/openshift/template.openshift.io/templates/jenkins-persistent-monitored.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.42896157Z namespaces/openshift/template.openshift.io/templates/jenkins-persistent.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.429088317Z namespaces/openshift/template.openshift.io/templates/jws57-openjdk11-tomcat9-ubi8-basic-s2i.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.429233865Z namespaces/openshift/template.openshift.io/templates/jws57-openjdk11-tomcat9-ubi8-https-s2i.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.429382093Z namespaces/openshift/template.openshift.io/templates/jws57-openjdk8-tomcat9-ubi8-basic-s2i.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.429504489Z namespaces/openshift/template.openshift.io/templates/jws57-openjdk8-tomcat9-ubi8-https-s2i.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.429621475Z namespaces/openshift/template.openshift.io/templates/mariadb-ephemeral.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.429849158Z namespaces/openshift/template.openshift.io/templates/mariadb-persistent.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.429969704Z namespaces/openshift/template.openshift.io/templates/mysql-ephemeral.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.430093161Z namespaces/openshift/template.openshift.io/templates/mysql-persistent.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.43025505Z namespaces/openshift/template.openshift.io/templates/nginx-example.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.430376716Z namespaces/openshift/template.openshift.io/templates/nodejs-postgresql-example.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.430510574Z namespaces/openshift/template.openshift.io/templates/nodejs-postgresql-persistent.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.430655142Z namespaces/openshift/template.openshift.io/templates/openjdk-web-basic-s2i.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.430775348Z namespaces/openshift/template.openshift.io/templates/postgresql-ephemeral.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.430899505Z namespaces/openshift/template.openshift.io/templates/postgresql-persistent.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.431023742Z namespaces/openshift/template.openshift.io/templates/rails-pgsql-persistent.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.431195341Z namespaces/openshift/template.openshift.io/templates/rails-postgresql-example.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.431406592Z namespaces/openshift/template.openshift.io/templates/react-web-app-example.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.431515948Z namespaces/openshift/template.openshift.io/templates/redis-ephemeral.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.431617004Z namespaces/openshift/template.openshift.io/templates/redis-persistent.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.43173432Z namespaces/openshift/template.openshift.io/templates/s2i-fuse712-spring-boot-2-camel-rest-3scale.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.431840916Z namespaces/openshift/template.openshift.io/templates/s2i-fuse712-spring-boot-2-camel-xml.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.431962893Z namespaces/openshift/template.openshift.io/templates/s2i-fuse712-spring-boot-2-camel.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.432069208Z namespaces/openshift/template.openshift.io/templates/sso75-https.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.432214516Z namespaces/openshift/template.openshift.io/templates/sso75-ocp4-x509-https.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.432344923Z namespaces/openshift/template.openshift.io/templates/sso75-ocp4-x509-postgresql-persistent.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.43247693Z namespaces/openshift/template.openshift.io/templates/sso75-postgresql-persistent.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.432593927Z namespaces/openshift/template.openshift.io/templates/sso75-postgresql.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.432720584Z namespaces/openshift/template.openshift.io/templates/sso76-ocp4-https.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.432875022Z namespaces/openshift/template.openshift.io/templates/sso76-ocp4-postgresql-persistent.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.433003539Z namespaces/openshift/template.openshift.io/templates/sso76-ocp4-postgresql.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.433129096Z namespaces/openshift/template.openshift.io/templates/sso76-ocp4-x509-https.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.433285364Z namespaces/openshift/template.openshift.io/templates/sso76-ocp4-x509-postgresql-persistent.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.433416691Z network_logs/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.433456894Z network_logs/cluster_scale [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.433547288Z network_logs/ippools.whereabouts.cni.cncf.io [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.433616442Z network_logs/multi-networkpolicy [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.433698516Z network_logs/net-attach-def [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.433784261Z network_logs/overlappingrangeipreservations.whereabouts.cni.cncf.io [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.43394597Z network_logs/ovn_kubernetes_top_pods [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.434034845Z network_logs/ovnk_database_store.tar.gz [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.436819756Z nodes/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.436866339Z nodes/debug [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.436979805Z nodes/ip-10-0-128-142.ec2.internal/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.437047778Z nodes/ip-10-0-128-142.ec2.internal/cpu_affinities.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.437394917Z nodes/ip-10-0-128-142.ec2.internal/dmesg [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.437711454Z nodes/ip-10-0-128-142.ec2.internal/ethtool_channels [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.437789469Z nodes/ip-10-0-128-142.ec2.internal/ethtool_features [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.437886644Z nodes/ip-10-0-128-142.ec2.internal/ip-10-0-128-142.ec2.internal_logs_kubelet.gz [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.438481876Z nodes/ip-10-0-128-142.ec2.internal/irq_affinities.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.438629704Z nodes/ip-10-0-128-142.ec2.internal/lscpu [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.438759911Z nodes/ip-10-0-128-142.ec2.internal/lspci [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.438856926Z nodes/ip-10-0-128-142.ec2.internal/podresources.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.438963782Z nodes/ip-10-0-128-142.ec2.internal/pods_info.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.439089609Z nodes/ip-10-0-128-142.ec2.internal/proc_cmdline [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.439191534Z nodes/ip-10-0-128-142.ec2.internal/sysinfo.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.441068916Z nodes/ip-10-0-128-142.ec2.internal/sysinfo.tgz [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.441276987Z nodes/ip-10-0-130-182.ec2.internal/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.441350982Z nodes/ip-10-0-130-182.ec2.internal/cpu_affinities.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.44169369Z nodes/ip-10-0-130-182.ec2.internal/dmesg [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.442012298Z nodes/ip-10-0-130-182.ec2.internal/ethtool_channels [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.442094292Z nodes/ip-10-0-130-182.ec2.internal/ethtool_features [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.442190717Z nodes/ip-10-0-130-182.ec2.internal/ip-10-0-130-182.ec2.internal_logs_kubelet.gz [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.442824511Z nodes/ip-10-0-130-182.ec2.internal/irq_affinities.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.442971059Z nodes/ip-10-0-130-182.ec2.internal/lscpu [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.443210552Z nodes/ip-10-0-130-182.ec2.internal/lspci [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.443304998Z nodes/ip-10-0-130-182.ec2.internal/podresources.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.443418534Z nodes/ip-10-0-130-182.ec2.internal/pods_info.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.443546211Z nodes/ip-10-0-130-182.ec2.internal/proc_cmdline [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.443627315Z nodes/ip-10-0-130-182.ec2.internal/sysinfo.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.445477755Z nodes/ip-10-0-130-182.ec2.internal/sysinfo.tgz [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.445764471Z nodes/ip-10-0-142-172.ec2.internal/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.445784092Z nodes/ip-10-0-142-172.ec2.internal/cpu_affinities.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.44593773Z nodes/ip-10-0-142-172.ec2.internal/dmesg [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.446239627Z nodes/ip-10-0-142-172.ec2.internal/ethtool_channels [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.446326011Z nodes/ip-10-0-142-172.ec2.internal/ethtool_features [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.446428577Z nodes/ip-10-0-142-172.ec2.internal/ip-10-0-142-172.ec2.internal_logs_kubelet.gz [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.446801067Z nodes/ip-10-0-142-172.ec2.internal/irq_affinities.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.446952195Z nodes/ip-10-0-142-172.ec2.internal/lscpu [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.447091793Z nodes/ip-10-0-142-172.ec2.internal/lspci [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.44722793Z nodes/ip-10-0-142-172.ec2.internal/podresources.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.447346517Z nodes/ip-10-0-142-172.ec2.internal/pods_info.json [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.447462273Z nodes/ip-10-0-142-172.ec2.internal/proc_cmdline [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.447545078Z nodes/ip-10-0-142-172.ec2.internal/sysinfo.log [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.449653742Z nodes/ip-10-0-142-172.ec2.internal/sysinfo.tgz [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.449847612Z pod_network_connectivity_check/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.449874854Z pod_network_connectivity_check/podnetworkconnectivitychecks.yaml [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.44999237Z static-pods/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.450005691Z static-pods/kube-apiserver/ [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.456907465Z [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.456939557Z sent 71,549 bytes received 7,940,548 bytes 5,341,398.00 bytes/sec [must-gather] [must-gather-4m7rl] OUT 2026-07-08T17:57:11.456951368Z total size is 91,264,157 speedup is 11.39 [must-gather] [must-gather ] OUT 2026-07-08T17:57:11.788900761Z namespace/openshift-must-gather-wf794 deleted [must-gather] [must-gather] [must-gather] Reprinting Cluster State: [must-gather] When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: [must-gather] ClusterID: fbdb0928-57e1-433e-b0d4-f6cf1e5b45cb [must-gather] ClientVersion: 4.21.10 [must-gather] ClusterVersion: Stable at "4.21.23" [must-gather] ClusterOperators: [must-gather] clusteroperator/authentication is missing [must-gather] clusteroperator/cloud-credential is missing [must-gather] clusteroperator/cluster-autoscaler is missing [must-gather] clusteroperator/config-operator is missing [must-gather] clusteroperator/etcd is missing [must-gather] clusteroperator/machine-api is missing [must-gather] clusteroperator/machine-approver is missing [must-gather] clusteroperator/machine-config is missing [must-gather] clusteroperator/marketplace is missing [must-gather] [must-gather] [git-push-artifacts] WORK_DIR: /workspace/odh-ci-artifacts [git-push-artifacts] REPO_PATH: opendatahub-io/odh-build-metadata [git-push-artifacts] REPO_BRANCH: ci-artifacts [git-push-artifacts] SPARSE_FILE_PATH: test-artifacts/docs [git-push-artifacts] SOURCE_PATH: /workspace/artifacts-dir [git-push-artifacts] DEST_PATH: test-artifacts/kserve-group-test-lmb6n [git-push-artifacts] ALWAYS_PASS: false [git-push-artifacts] configuring gh token [git-push-artifacts] taking github token from Konflux bot [git-push-artifacts] Initialized empty Git repository in /workspace/odh-ci-artifacts/.git/ [git-push-artifacts] Using partial fetch with sparse checkout for: test-artifacts/docs [git-push-artifacts] From https://github.com/opendatahub-io/odh-build-metadata [git-push-artifacts] * branch ci-artifacts -> FETCH_HEAD [git-push-artifacts] * [new branch] ci-artifacts -> origin/ci-artifacts [git-push-artifacts] Already on 'ci-artifacts' [git-push-artifacts] branch 'ci-artifacts' set up to track 'origin/ci-artifacts'. [git-push-artifacts] TASK_NAME=kserve-group-test-lmb6n-e2e-llm-inference-service [git-push-artifacts] PIPELINERUN_NAME=kserve-group-test-lmb6n [git-push-artifacts] From https://github.com/opendatahub-io/odh-build-metadata [git-push-artifacts] * branch ci-artifacts -> FETCH_HEAD [git-push-artifacts] d377017..5cef841 ci-artifacts -> origin/ci-artifacts [git-push-artifacts] Updating d377017..5cef841 [git-push-artifacts] Fast-forward [git-push-artifacts] .../maas-group-test-mk7b5/e2e-maas-openshift.tar.gz | Bin 0 -> 14518636 bytes [git-push-artifacts] 1 file changed, 0 insertions(+), 0 deletions(-) [git-push-artifacts] create mode 100644 test-artifacts/maas-group-test-mk7b5/e2e-maas-openshift.tar.gz [git-push-artifacts] -rw-r--r--. 1 root 1001540000 15498959 Jul 8 17:58 /workspace/odh-ci-artifacts/test-artifacts/kserve-group-test-lmb6n/e2e-llm-inference-service.tar.gz [git-push-artifacts] [ci-artifacts 81bdf84] Updating CI Artifacts in e2e-llm-inference-service [git-push-artifacts] 1 file changed, 0 insertions(+), 0 deletions(-) [git-push-artifacts] create mode 100644 test-artifacts/kserve-group-test-lmb6n/e2e-llm-inference-service.tar.gz [git-push-artifacts] From https://github.com/opendatahub-io/odh-build-metadata [git-push-artifacts] * branch ci-artifacts -> FETCH_HEAD [git-push-artifacts] Already up to date. [git-push-artifacts] To https://github.com/opendatahub-io/odh-build-metadata.git [git-push-artifacts] 5cef841..81bdf84 ci-artifacts -> ci-artifacts [fail-if-needed] Failing pipeline because deploy-and-e2e step failed container step-fail-if-needed has failed : [{"key":"StartedAt","value":"2026-07-08T17:58:47.944Z","type":3}]