/workspace/source/test/maas-e2e/test/e2e/tests/test_api_keys.py:1429: Cannot find maas-api pod in odh-ai-gateway-infra: error: error executing jsonpath "{.items[0].metadata.name}": Error executing template: array index out of bounds: index 0, length 0. Printing more information for debugging the template: template was: {.items[0].metadata.name} object given to jsonpath engine was: map[string]interface {}{"apiVersion":"v1", "items":[]interface {}{}, "kind":"List", "metadata":map[string]interface {}{"resourceVersion":""}}/workspace/source/test/maas-e2e/test/e2e/tests/test_namespace_scoping.py:247: test_namespace_scoping validates single-tenant dormant mode; skipped when ENABLE_TENANT_NAMESPACE_DISCOVERY=true/workspace/source/test/maas-e2e/test/e2e/tests/test_namespace_scoping.py:287: test_namespace_scoping validates single-tenant dormant mode; skipped when ENABLE_TENANT_NAMESPACE_DISCOVERY=true/workspace/source/test/maas-e2e/test/e2e/tests/test_namespace_scoping.py:324: test_namespace_scoping validates single-tenant dormant mode; skipped when ENABLE_TENANT_NAMESPACE_DISCOVERY=true/workspace/source/test/maas-e2e/test/e2e/tests/test_namespace_scoping.py:382: test_namespace_scoping validates single-tenant dormant mode; skipped when ENABLE_TENANT_NAMESPACE_DISCOVERY=true/workspace/source/test/maas-e2e/test/e2e/tests/test_namespace_scoping.py:456: test_namespace_scoping validates single-tenant dormant mode; skipped when ENABLE_TENANT_NAMESPACE_DISCOVERY=true/workspace/source/test/maas-e2e/test/e2e/tests/test_namespace_scoping.py:214: test_namespace_scoping validates single-tenant dormant mode; skipped when ENABLE_TENANT_NAMESPACE_DISCOVERY=trueself = <test_subscription_list_endpoints.TestListSubscriptions object at 0x7fc75bff0810> endpoint = '/v1/subscriptions' @pytest.mark.parametrize( "endpoint", [ "/v1/subscriptions", f"/v1/model/{MODEL_REF}/subscriptions", ], ids=["all-subscriptions", "subscriptions-for-model"], ) def test_unauthenticated_returns_401(self, endpoint): """Both subscription-list endpoints require authentication.""" url = f"{_maas_api_url()}{endpoint}" r = requests.get(url, timeout=TIMEOUT, verify=TLS_VERIFY) > assert r.status_code == 401, f"Expected 401, got {r.status_code}: {r.text}" E AssertionError: Expected 401, got 500: Internal Server Error. E E assert 500 == 401 E + where 500 = <Response [500]>.status_code test/maas-e2e/test/e2e/tests/test_subscription_list_endpoints.py:282: AssertionErrorself = <test_subscription_list_endpoints.TestListSubscriptions object at 0x7f5230cd0590> endpoint = '/v1/model/facebook-opt-125m-simulated/subscriptions' @pytest.mark.parametrize( "endpoint", [ "/v1/subscriptions", f"/v1/model/{MODEL_REF}/subscriptions", ], ids=["all-subscriptions", "subscriptions-for-model"], ) def test_unauthenticated_returns_401(self, endpoint): """Both subscription-list endpoints require authentication.""" url = f"{_maas_api_url()}{endpoint}" r = requests.get(url, timeout=TIMEOUT, verify=TLS_VERIFY) > assert r.status_code == 401, f"Expected 401, got {r.status_code}: {r.text}" E AssertionError: Expected 401, got 500: Internal Server Error. E E assert 500 == 401 E + where 500 = <Response [500]>.status_code test/maas-e2e/test/e2e/tests/test_subscription_list_endpoints.py:282: AssertionErrormaas_api_internal_url = 'https://maas-api.odh-ai-gateway-infra.svc.cluster.local:8443' def test_tenant_discovery_requires_auth(maas_api_internal_url: str): """ Verify /v1/tenants endpoint requires authentication. Without a bearer token, the endpoint should return 401 Unauthorized. Note: This endpoint is internal-only (not exposed through Gateway), so we use kubectl run with curl to access it from inside the cluster. """ url = maas_api_internal_url + "/v1/tenants" # Attempt without Authorization header status_code, body = _kubectl_curl(url) log.info(f"[tenant] GET {url} (no auth) -> HTTP {status_code}") print(f"[tenant] GET /v1/tenants without auth: HTTP {status_code}") > assert status_code == 401, f"Expected 401 without auth, got {status_code}" E AssertionError: Expected 401 without auth, got 0 E assert 0 == 401 test/maas-e2e/test/e2e/tests/test_tenant_discovery.py:43: AssertionError/workspace/source/test/maas-e2e/test/e2e/tests/test_tenant_discovery.py:79: Skipping when Gateway uses ClusterIP + OpenShift Route (unsupported configuration). This mixes incompatible routing paradigms. Gateway has no external hostname in spec.listeners, so /v1/tenants returns an error. Supported configuration: LoadBalancer service with hostname in spec.listeners./workspace/source/test/maas-e2e/test/e2e/tests/test_tenant_discovery.py:155: Skipping when Gateway uses ClusterIP + OpenShift Route (unsupported configuration). This mixes incompatible routing paradigms. Gateway has no external hostname in spec.listeners, so /v1/tenants returns an error. Supported configuration: LoadBalancer service with hostname in spec.listeners.maas_api_base_url = 'https://maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev/maas-api' headers = {'Authorization': 'Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjlwcEZfM2dsRWxCeUlOZV95MzJicHVNRjgxSExMc09ocFNyVHM1ck8tU3cifQ.e...noMpqB18acHegLSevKBFNedCmMbz9DHpT0pKDmdTpt88WV_p4wYCkpBqGW3MpX2WZOd_zOZ-A78KlOHtA', 'Content-Type': 'application/json'} @pytest.fixture(scope="session") def model_catalog(maas_api_base_url: str, headers: dict): r = requests.get(f"{maas_api_base_url}/v1/models", headers=headers, timeout=45, verify=TLS_VERIFY) > r.raise_for_status() test/maas-e2e/test/e2e/tests/conftest.py:289: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = <Response [500]> def raise_for_status(self) -> None: """Raises :class:`HTTPError`, if one occurred.""" http_error_msg = "" if isinstance(self.reason, bytes): # We attempt to decode utf-8 first because some servers # choose to localize their reason strings. If the string # isn't utf-8, we fall back to iso-8859-1 for all other # encodings. (See PR #3538) try: reason = self.reason.decode("utf-8") except UnicodeDecodeError: reason = self.reason.decode("iso-8859-1") else: reason = self.reason if 400 <= self.status_code < 500: http_error_msg = ( f"{self.status_code} Client Error: {reason} for url: {self.url}" ) elif 500 <= self.status_code < 600: http_error_msg = ( f"{self.status_code} Server Error: {reason} for url: {self.url}" ) if http_error_msg: > raise HTTPError(http_error_msg, response=self) E requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://maas.apps.a24b3162596f31397072.prod.konflux-ocp-ci.dev/maas-api/v1/models test/e2e/.venv/lib64/python3.11/site-packages/requests/models.py:1167: HTTPErrorcls = <class 'test_models_endpoint.TestModelsEndpoint'> @classmethod def setup_class(cls): """Validate test environment prerequisites before running any tests.""" log.info("=" * 60) log.info("Validating /v1/models E2E Test Prerequisites") log.info("=" * 60) # Validate MODEL_REF exists and is Ready model = _get_cr("maasmodelref", MODEL_REF, MODEL_NAMESPACE) if not model: pytest.fail(f"PREREQUISITE MISSING: MaaSModelRef '{MODEL_REF}' not found in namespace '{MODEL_NAMESPACE}'. " f"Ensure prow setup has created the model.") phase = model.get("status", {}).get("phase") endpoint = model.get("status", {}).get("endpoint") if phase != "Ready" or not endpoint: > pytest.fail(f"PREREQUISITE INVALID: MaaSModelRef '{MODEL_REF}' not Ready " f"(phase={phase}, endpoint={endpoint or 'none'}). " f"Wait for reconciliation or check controller logs.") E Failed: PREREQUISITE INVALID: MaaSModelRef 'simulator-w1-b8aee1' not Ready (phase=Unhealthy, endpoint=none). Wait for reconciliation or check controller logs. test/maas-e2e/test/e2e/tests/test_models_endpoint.py:381: Failed/workspace/source/test/maas-e2e/test/e2e/tests/test_tenant_namespace_discovery.py:190: OIDC_ISSUER_URL not set; per-tenant OIDC E2E requires external OIDC deploy