/workspace/source/test/e2e/tests/test_namespace_scoping.py:214: test_namespace_scoping validates single-tenant dormant mode; skipped when ENABLE_TENANT_NAMESPACE_DISCOVERY=true/workspace/source/test/e2e/tests/test_namespace_scoping.py:247: test_namespace_scoping validates single-tenant dormant mode; skipped when ENABLE_TENANT_NAMESPACE_DISCOVERY=true/workspace/source/test/e2e/tests/test_namespace_scoping.py:287: test_namespace_scoping validates single-tenant dormant mode; skipped when ENABLE_TENANT_NAMESPACE_DISCOVERY=true/workspace/source/test/e2e/tests/test_namespace_scoping.py:324: test_namespace_scoping validates single-tenant dormant mode; skipped when ENABLE_TENANT_NAMESPACE_DISCOVERY=true/workspace/source/test/e2e/tests/test_namespace_scoping.py:382: test_namespace_scoping validates single-tenant dormant mode; skipped when ENABLE_TENANT_NAMESPACE_DISCOVERY=true/workspace/source/test/e2e/tests/test_namespace_scoping.py:456: test_namespace_scoping validates single-tenant dormant mode; skipped when ENABLE_TENANT_NAMESPACE_DISCOVERY=true/workspace/source/test/e2e/tests/test_tenant_discovery.py:79: Skipping when Gateway uses ClusterIP + OpenShift Route (unsupported configuration). This mixes incompatible routing paradigms. Gateway has no external hostname in spec.listeners, so /v1/tenants returns an error. Supported configuration: LoadBalancer service with hostname in spec.listeners./workspace/source/test/e2e/tests/test_tenant_discovery.py:155: Skipping when Gateway uses ClusterIP + OpenShift Route (unsupported configuration). This mixes incompatible routing paradigms. Gateway has no external hostname in spec.listeners, so /v1/tenants returns an error. Supported configuration: LoadBalancer service with hostname in spec.listeners./workspace/source/test/e2e/tests/test_subscription.py:1069: gateway-only mode: per-model AuthPolicy is not created/workspace/source/test/e2e/tests/test_gateway_scoped_authpolicy.py:212: gateway-default-auth not present (maas-gateway-auth is active); scoping is validated by unit tests/workspace/source/test/e2e/tests/test_tenant_namespace_discovery.py:189: OIDC_ISSUER_URL not set; per-tenant OIDC E2E requires external OIDC deploy/workspace/source/test/e2e/tests/test_tenant_namespace_discovery.py:355: Dormant-mode test mutates controller flags; set ENABLE_TENANT_DISCOVERY_DORMANT_E2E=true/workspace/source/test/e2e/tests/test_tenant_auth_isolation.py:215: Per-tenant OIDC tokens unavailable — set OIDC_TOKEN_URL (tenant-a) and OIDC_TOKEN_URL_TENANT_B (tenant-b), or OIDC_TOKEN_TENANT_A / OIDC_TOKEN_TENANT_B/workspace/source/test/e2e/tests/test_tenant_discovery_isolation.py:93: Skipping when Gateway uses ClusterIP + OpenShift Route (unsupported configuration). This mixes incompatible routing paradigms. Gateway has no external hostname in spec.listeners, so /v1/tenants returns an error. Supported configuration: LoadBalancer service with hostname in spec.listeners./workspace/source/test/e2e/tests/test_tenant_discovery_isolation.py:141: Skipping when Gateway uses ClusterIP + OpenShift Route (unsupported configuration). This mixes incompatible routing paradigms. Gateway has no external hostname in spec.listeners, so /v1/tenants returns an error. Supported configuration: LoadBalancer service with hostname in spec.listeners./workspace/source/test/e2e/tests/test_tenant_discovery_isolation.py:228: Skipping when Gateway uses ClusterIP + OpenShift Route (unsupported configuration). This mixes incompatible routing paradigms. Gateway has no external hostname in spec.listeners, so /v1/tenants returns an error. Supported configuration: LoadBalancer service with hostname in spec.listeners.self = <test_per_tenant_ipp_isolation.TestPerTenantIPPRouting object at 0x7f22a1e04b50> ipp_tenant_cases = ({'gateway_name': 'e2e-ipp-a-d54fc1', 'policy_name': 'e2e-ipp-a-d54fc1-policy', 'subscription_name': 'e2e-ipp-a-d54fc1...a377', 'policy_name': 'e2e-ipp-b-c1a377-policy', 'subscription_name': 'e2e-ipp-b-c1a377-sub', 'suffix': 'c1a377', ...}) def test_default_gateway_hits_default_ipp_only(self, ipp_tenant_cases): _, case_b = ipp_tenant_cases default_names = per_tenant_ipp_names(DEFAULT_AITENANT_NAME) tenant_names = per_tenant_ipp_names(case_b["tenant_label_name"]) _wait_for_gateway_auth_enforced() api_key = _create_default_api_key() # Retry transient auth propagation (403, 500 AUTH_FAILURE) but fail fast # on terminal errors (404, 405, 422) that indicate misconfiguration. _TRANSIENT_WARMUP = {403, 500, 502, 503} deadline = time.time() + 90 warmup = None while time.time() < deadline: warmup = _post_hybrid_chat(_gateway_url(), MODEL_PATH, api_key) if warmup.status_code == 200: break if warmup.status_code not in _TRANSIENT_WARMUP: log.warning( "Default gateway warmup got terminal %d, not retrying (body: %.300s)", warmup.status_code, redact_sensitive(warmup.text[:300]), ) break log.warning( "Default gateway warmup got %d (body: %.300s), retrying...", warmup.status_code, redact_sensitive(warmup.text[:300]), ) time.sleep(2) assert warmup is not None and warmup.status_code == 200, ( f"Default gateway inference warmup failed: " f"{warmup.status_code if warmup is not None else 'no response'} " f"{redact_sensitive(warmup.text[:500]) if warmup is not None else ''}" ) response = _post_hybrid_chat(_gateway_url(), MODEL_PATH, api_key) assert response.status_code == 200, ( f"Default gateway hybrid BBR failed: {response.status_code} " f"{redact_sensitive(response.text[:500])}" ) time.sleep(2) default_logs = deployment_log_snapshot( default_names["processing_deployment"], since="1m" ) tenant_logs = deployment_log_snapshot( tenant_names["processing_deployment"], since="1m" ) > assert ipp_logs_show_recent_activity(default_logs), ( "Expected ext_proc activity in default payload-processing logs" ) E AssertionError: Expected ext_proc activity in default payload-processing logs E assert False E + where False = ipp_logs_show_recent_activity('') test/e2e/tests/test_per_tenant_ipp_isolation.py:374: AssertionError